00:00:00.000 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v22.11" build number 1000 00:00:00.000 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3667 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.185 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.187 The recommended git tool is: git 00:00:00.187 using credential 00000000-0000-0000-0000-000000000002 00:00:00.206 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.232 Fetching changes from the remote Git repository 00:00:00.234 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.258 Using shallow fetch with depth 1 00:00:00.258 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.258 > git --version # timeout=10 00:00:00.267 > git --version # 'git version 2.39.2' 00:00:00.267 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.277 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.277 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.032 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.044 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.056 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.056 > git config core.sparsecheckout # timeout=10 00:00:05.066 > git read-tree -mu HEAD # timeout=10 00:00:05.081 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.103 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.103 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.183 [Pipeline] Start of Pipeline 00:00:05.195 [Pipeline] library 00:00:05.196 Loading library shm_lib@master 00:00:05.196 Library shm_lib@master is cached. Copying from home. 00:00:05.210 [Pipeline] node 00:00:05.217 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.219 [Pipeline] { 00:00:05.225 [Pipeline] catchError 00:00:05.226 [Pipeline] { 00:00:05.235 [Pipeline] wrap 00:00:05.240 [Pipeline] { 00:00:05.248 [Pipeline] stage 00:00:05.249 [Pipeline] { (Prologue) 00:00:05.550 [Pipeline] sh 00:00:05.837 + logger -p user.info -t JENKINS-CI 00:00:05.853 [Pipeline] echo 00:00:05.854 Node: GP11 00:00:05.864 [Pipeline] sh 00:00:06.163 [Pipeline] setCustomBuildProperty 00:00:06.173 [Pipeline] echo 00:00:06.175 Cleanup processes 00:00:06.180 [Pipeline] sh 00:00:06.462 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.462 2701907 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.475 [Pipeline] sh 00:00:06.756 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.756 ++ grep -v 'sudo pgrep' 00:00:06.756 ++ awk '{print $1}' 00:00:06.756 + sudo kill -9 00:00:06.756 + true 00:00:06.771 [Pipeline] cleanWs 00:00:06.781 [WS-CLEANUP] Deleting project workspace... 00:00:06.781 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.787 [WS-CLEANUP] done 00:00:06.791 [Pipeline] setCustomBuildProperty 00:00:06.805 [Pipeline] sh 00:00:07.089 + sudo git config --global --replace-all safe.directory '*' 00:00:07.182 [Pipeline] httpRequest 00:00:09.506 [Pipeline] echo 00:00:09.508 Sorcerer 10.211.164.101 is alive 00:00:09.518 [Pipeline] retry 00:00:09.520 [Pipeline] { 00:00:09.533 [Pipeline] httpRequest 00:00:09.538 HttpMethod: GET 00:00:09.538 URL: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.539 Sending request to url: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.561 Response Code: HTTP/1.1 200 OK 00:00:09.561 Success: Status code 200 is in the accepted range: 200,404 00:00:09.562 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:13.638 [Pipeline] } 00:00:13.656 [Pipeline] // retry 00:00:13.664 [Pipeline] sh 00:00:13.952 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:13.970 [Pipeline] httpRequest 00:00:14.372 [Pipeline] echo 00:00:14.374 Sorcerer 10.211.164.101 is alive 00:00:14.385 [Pipeline] retry 00:00:14.387 [Pipeline] { 00:00:14.403 [Pipeline] httpRequest 00:00:14.408 HttpMethod: GET 00:00:14.408 URL: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:14.409 Sending request to url: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:14.413 Response Code: HTTP/1.1 200 OK 00:00:14.413 Success: Status code 200 is in the accepted range: 200,404 00:00:14.414 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:29.301 [Pipeline] } 00:00:29.319 [Pipeline] // retry 00:00:29.327 [Pipeline] sh 00:00:29.614 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:32.165 [Pipeline] sh 00:00:32.452 + git -C spdk log --oneline -n5 00:00:32.453 c13c99a5e test: Various fixes for Fedora40 00:00:32.453 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:00:32.453 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:00:32.453 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:00:32.453 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:00:32.474 [Pipeline] withCredentials 00:00:32.486 > git --version # timeout=10 00:00:32.500 > git --version # 'git version 2.39.2' 00:00:32.519 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:00:32.521 [Pipeline] { 00:00:32.533 [Pipeline] retry 00:00:32.536 [Pipeline] { 00:00:32.555 [Pipeline] sh 00:00:32.841 + git ls-remote http://dpdk.org/git/dpdk-stable v22.11.4 00:00:33.115 [Pipeline] } 00:00:33.135 [Pipeline] // retry 00:00:33.142 [Pipeline] } 00:00:33.161 [Pipeline] // withCredentials 00:00:33.171 [Pipeline] httpRequest 00:00:33.979 [Pipeline] echo 00:00:33.981 Sorcerer 10.211.164.101 is alive 00:00:33.992 [Pipeline] retry 00:00:33.995 [Pipeline] { 00:00:34.009 [Pipeline] httpRequest 00:00:34.014 HttpMethod: GET 00:00:34.015 URL: http://10.211.164.101/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:34.015 Sending request to url: http://10.211.164.101/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:34.024 Response Code: HTTP/1.1 200 OK 00:00:34.024 Success: Status code 200 is in the accepted range: 200,404 00:00:34.025 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:03.439 [Pipeline] } 00:01:03.457 [Pipeline] // retry 00:01:03.465 [Pipeline] sh 00:01:03.752 + tar --no-same-owner -xf dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:05.672 [Pipeline] sh 00:01:05.960 + git -C dpdk log --oneline -n5 00:01:05.960 caf0f5d395 version: 22.11.4 00:01:05.960 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:05.960 dc9c799c7d vhost: fix missing spinlock unlock 00:01:05.960 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:05.960 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:05.973 [Pipeline] } 00:01:05.989 [Pipeline] // stage 00:01:06.000 [Pipeline] stage 00:01:06.003 [Pipeline] { (Prepare) 00:01:06.024 [Pipeline] writeFile 00:01:06.040 [Pipeline] sh 00:01:06.358 + logger -p user.info -t JENKINS-CI 00:01:06.371 [Pipeline] sh 00:01:06.652 + logger -p user.info -t JENKINS-CI 00:01:06.665 [Pipeline] sh 00:01:06.947 + cat autorun-spdk.conf 00:01:06.947 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:06.947 SPDK_TEST_NVMF=1 00:01:06.947 SPDK_TEST_NVME_CLI=1 00:01:06.947 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:06.947 SPDK_TEST_NVMF_NICS=e810 00:01:06.947 SPDK_TEST_VFIOUSER=1 00:01:06.947 SPDK_RUN_UBSAN=1 00:01:06.947 NET_TYPE=phy 00:01:06.947 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:06.947 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:06.955 RUN_NIGHTLY=1 00:01:06.959 [Pipeline] readFile 00:01:06.978 [Pipeline] withEnv 00:01:06.980 [Pipeline] { 00:01:06.990 [Pipeline] sh 00:01:07.276 + set -ex 00:01:07.276 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:07.276 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:07.276 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:07.276 ++ SPDK_TEST_NVMF=1 00:01:07.276 ++ SPDK_TEST_NVME_CLI=1 00:01:07.276 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:07.276 ++ SPDK_TEST_NVMF_NICS=e810 00:01:07.276 ++ SPDK_TEST_VFIOUSER=1 00:01:07.276 ++ SPDK_RUN_UBSAN=1 00:01:07.276 ++ NET_TYPE=phy 00:01:07.276 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:07.276 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:07.276 ++ RUN_NIGHTLY=1 00:01:07.276 + case $SPDK_TEST_NVMF_NICS in 00:01:07.276 + DRIVERS=ice 00:01:07.276 + [[ tcp == \r\d\m\a ]] 00:01:07.276 + [[ -n ice ]] 00:01:07.276 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:07.276 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:07.276 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:07.276 rmmod: ERROR: Module irdma is not currently loaded 00:01:07.276 rmmod: ERROR: Module i40iw is not currently loaded 00:01:07.276 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:07.276 + true 00:01:07.276 + for D in $DRIVERS 00:01:07.276 + sudo modprobe ice 00:01:07.276 + exit 0 00:01:07.287 [Pipeline] } 00:01:07.301 [Pipeline] // withEnv 00:01:07.305 [Pipeline] } 00:01:07.317 [Pipeline] // stage 00:01:07.324 [Pipeline] catchError 00:01:07.326 [Pipeline] { 00:01:07.338 [Pipeline] timeout 00:01:07.338 Timeout set to expire in 1 hr 0 min 00:01:07.340 [Pipeline] { 00:01:07.352 [Pipeline] stage 00:01:07.354 [Pipeline] { (Tests) 00:01:07.367 [Pipeline] sh 00:01:07.654 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:07.654 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:07.654 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:07.654 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:07.654 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:07.654 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:07.654 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:07.654 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:07.654 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:07.654 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:07.654 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:07.654 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:07.654 + source /etc/os-release 00:01:07.654 ++ NAME='Fedora Linux' 00:01:07.654 ++ VERSION='39 (Cloud Edition)' 00:01:07.654 ++ ID=fedora 00:01:07.654 ++ VERSION_ID=39 00:01:07.654 ++ VERSION_CODENAME= 00:01:07.654 ++ PLATFORM_ID=platform:f39 00:01:07.654 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:07.654 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:07.654 ++ LOGO=fedora-logo-icon 00:01:07.654 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:07.654 ++ HOME_URL=https://fedoraproject.org/ 00:01:07.654 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:07.654 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:07.654 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:07.654 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:07.654 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:07.654 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:07.654 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:07.654 ++ SUPPORT_END=2024-11-12 00:01:07.654 ++ VARIANT='Cloud Edition' 00:01:07.654 ++ VARIANT_ID=cloud 00:01:07.654 + uname -a 00:01:07.654 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:07.654 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:08.593 Hugepages 00:01:08.593 node hugesize free / total 00:01:08.593 node0 1048576kB 0 / 0 00:01:08.593 node0 2048kB 0 / 0 00:01:08.593 node1 1048576kB 0 / 0 00:01:08.593 node1 2048kB 0 / 0 00:01:08.593 00:01:08.593 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:08.593 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:08.593 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:08.593 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:08.593 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:08.593 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:08.593 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:08.593 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:08.593 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:08.593 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:08.593 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:08.593 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:08.593 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:08.593 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:08.593 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:08.593 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:08.593 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:08.593 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:08.593 + rm -f /tmp/spdk-ld-path 00:01:08.593 + source autorun-spdk.conf 00:01:08.593 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:08.593 ++ SPDK_TEST_NVMF=1 00:01:08.593 ++ SPDK_TEST_NVME_CLI=1 00:01:08.593 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:08.593 ++ SPDK_TEST_NVMF_NICS=e810 00:01:08.593 ++ SPDK_TEST_VFIOUSER=1 00:01:08.593 ++ SPDK_RUN_UBSAN=1 00:01:08.593 ++ NET_TYPE=phy 00:01:08.593 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:08.593 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:08.593 ++ RUN_NIGHTLY=1 00:01:08.593 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:08.593 + [[ -n '' ]] 00:01:08.593 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:08.593 + for M in /var/spdk/build-*-manifest.txt 00:01:08.593 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:08.593 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:08.593 + for M in /var/spdk/build-*-manifest.txt 00:01:08.593 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:08.593 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:08.593 + for M in /var/spdk/build-*-manifest.txt 00:01:08.593 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:08.593 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:08.593 ++ uname 00:01:08.593 + [[ Linux == \L\i\n\u\x ]] 00:01:08.593 + sudo dmesg -T 00:01:08.593 + sudo dmesg --clear 00:01:08.593 + dmesg_pid=2703223 00:01:08.593 + [[ Fedora Linux == FreeBSD ]] 00:01:08.593 + sudo dmesg -Tw 00:01:08.593 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:08.593 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:08.593 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:08.593 + [[ -x /usr/src/fio-static/fio ]] 00:01:08.593 + export FIO_BIN=/usr/src/fio-static/fio 00:01:08.593 + FIO_BIN=/usr/src/fio-static/fio 00:01:08.593 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:08.593 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:08.593 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:08.593 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:08.593 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:08.593 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:08.593 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:08.593 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:08.594 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:08.594 Test configuration: 00:01:08.594 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:08.594 SPDK_TEST_NVMF=1 00:01:08.594 SPDK_TEST_NVME_CLI=1 00:01:08.594 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:08.594 SPDK_TEST_NVMF_NICS=e810 00:01:08.594 SPDK_TEST_VFIOUSER=1 00:01:08.594 SPDK_RUN_UBSAN=1 00:01:08.594 NET_TYPE=phy 00:01:08.594 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:08.594 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:08.852 RUN_NIGHTLY=1 04:12:47 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:08.852 04:12:47 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:08.852 04:12:47 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:08.852 04:12:47 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:08.852 04:12:47 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:08.852 04:12:47 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:08.852 04:12:47 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:08.852 04:12:47 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:08.852 04:12:47 -- paths/export.sh@5 -- $ export PATH 00:01:08.852 04:12:47 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:08.852 04:12:47 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:08.852 04:12:47 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:08.852 04:12:47 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732590767.XXXXXX 00:01:08.852 04:12:47 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732590767.U10jDh 00:01:08.852 04:12:47 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:08.852 04:12:47 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:01:08.852 04:12:47 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:08.852 04:12:47 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:08.852 04:12:47 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:08.852 04:12:47 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:08.852 04:12:47 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:08.852 04:12:47 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:08.852 04:12:47 -- common/autotest_common.sh@10 -- $ set +x 00:01:08.852 04:12:47 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:08.852 04:12:47 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:08.852 04:12:47 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:08.852 04:12:47 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:08.852 04:12:47 -- spdk/autobuild.sh@16 -- $ date -u 00:01:08.852 Tue Nov 26 03:12:47 AM UTC 2024 00:01:08.852 04:12:47 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:08.852 LTS-67-gc13c99a5e 00:01:08.852 04:12:47 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:08.852 04:12:47 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:08.852 04:12:47 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:08.852 04:12:47 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:08.852 04:12:47 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:08.852 04:12:47 -- common/autotest_common.sh@10 -- $ set +x 00:01:08.852 ************************************ 00:01:08.852 START TEST ubsan 00:01:08.852 ************************************ 00:01:08.852 04:12:47 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:08.852 using ubsan 00:01:08.852 00:01:08.852 real 0m0.000s 00:01:08.852 user 0m0.000s 00:01:08.852 sys 0m0.000s 00:01:08.852 04:12:47 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:08.852 04:12:47 -- common/autotest_common.sh@10 -- $ set +x 00:01:08.852 ************************************ 00:01:08.852 END TEST ubsan 00:01:08.852 ************************************ 00:01:08.852 04:12:47 -- spdk/autobuild.sh@27 -- $ '[' -n v22.11.4 ']' 00:01:08.852 04:12:47 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:08.852 04:12:47 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:08.852 04:12:47 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:08.852 04:12:47 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:08.852 04:12:47 -- common/autotest_common.sh@10 -- $ set +x 00:01:08.852 ************************************ 00:01:08.852 START TEST build_native_dpdk 00:01:08.852 ************************************ 00:01:08.852 04:12:47 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:08.852 04:12:47 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:08.852 04:12:47 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:08.852 04:12:47 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:08.852 04:12:47 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:08.852 04:12:47 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:08.852 04:12:47 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:08.852 04:12:47 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:08.852 04:12:47 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:08.852 04:12:47 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:08.852 04:12:47 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:08.852 04:12:47 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:08.852 04:12:47 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:08.852 04:12:47 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:08.852 04:12:47 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:08.853 04:12:47 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:08.853 04:12:47 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:08.853 04:12:47 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:08.853 04:12:47 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:08.853 04:12:47 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:08.853 04:12:47 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:08.853 caf0f5d395 version: 22.11.4 00:01:08.853 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:08.853 dc9c799c7d vhost: fix missing spinlock unlock 00:01:08.853 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:08.853 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:08.853 04:12:47 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:08.853 04:12:47 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:08.853 04:12:47 -- common/autobuild_common.sh@87 -- $ dpdk_ver=22.11.4 00:01:08.853 04:12:47 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:08.853 04:12:47 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:08.853 04:12:47 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:08.853 04:12:47 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:08.853 04:12:47 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:08.853 04:12:47 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:08.853 04:12:47 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:08.853 04:12:47 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:08.853 04:12:47 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:08.853 04:12:47 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:08.853 04:12:47 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:08.853 04:12:47 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:08.853 04:12:47 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:08.853 04:12:47 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:08.853 04:12:47 -- common/autobuild_common.sh@169 -- $ lt 22.11.4 21.11.0 00:01:08.853 04:12:47 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 21.11.0 00:01:08.853 04:12:47 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:08.853 04:12:47 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:08.853 04:12:47 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:08.853 04:12:47 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:08.853 04:12:47 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:08.853 04:12:47 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:08.853 04:12:47 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:08.853 04:12:47 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:08.853 04:12:47 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:08.853 04:12:47 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:08.853 04:12:47 -- scripts/common.sh@343 -- $ case "$op" in 00:01:08.853 04:12:47 -- scripts/common.sh@344 -- $ : 1 00:01:08.853 04:12:47 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:08.853 04:12:47 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:08.853 04:12:47 -- scripts/common.sh@364 -- $ decimal 22 00:01:08.853 04:12:47 -- scripts/common.sh@352 -- $ local d=22 00:01:08.853 04:12:47 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:08.853 04:12:47 -- scripts/common.sh@354 -- $ echo 22 00:01:08.853 04:12:47 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:08.853 04:12:47 -- scripts/common.sh@365 -- $ decimal 21 00:01:08.853 04:12:47 -- scripts/common.sh@352 -- $ local d=21 00:01:08.853 04:12:47 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:08.853 04:12:47 -- scripts/common.sh@354 -- $ echo 21 00:01:08.853 04:12:47 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:08.853 04:12:47 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:08.853 04:12:47 -- scripts/common.sh@366 -- $ return 1 00:01:08.853 04:12:47 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:08.853 patching file config/rte_config.h 00:01:08.853 Hunk #1 succeeded at 60 (offset 1 line). 00:01:08.853 04:12:47 -- common/autobuild_common.sh@176 -- $ lt 22.11.4 24.07.0 00:01:08.853 04:12:47 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 24.07.0 00:01:08.853 04:12:47 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:08.853 04:12:47 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:08.853 04:12:47 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:08.853 04:12:47 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:08.853 04:12:47 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:08.853 04:12:47 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:08.853 04:12:47 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:08.853 04:12:47 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:08.853 04:12:47 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:08.853 04:12:47 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:08.853 04:12:47 -- scripts/common.sh@343 -- $ case "$op" in 00:01:08.853 04:12:47 -- scripts/common.sh@344 -- $ : 1 00:01:08.853 04:12:47 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:08.853 04:12:47 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:08.853 04:12:47 -- scripts/common.sh@364 -- $ decimal 22 00:01:08.853 04:12:47 -- scripts/common.sh@352 -- $ local d=22 00:01:08.853 04:12:47 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:08.853 04:12:47 -- scripts/common.sh@354 -- $ echo 22 00:01:08.853 04:12:47 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:08.853 04:12:47 -- scripts/common.sh@365 -- $ decimal 24 00:01:08.853 04:12:47 -- scripts/common.sh@352 -- $ local d=24 00:01:08.853 04:12:47 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:08.853 04:12:47 -- scripts/common.sh@354 -- $ echo 24 00:01:08.853 04:12:47 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:08.853 04:12:47 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:08.853 04:12:47 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:08.853 04:12:47 -- scripts/common.sh@367 -- $ return 0 00:01:08.853 04:12:47 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:08.853 patching file lib/pcapng/rte_pcapng.c 00:01:08.853 Hunk #1 succeeded at 110 (offset -18 lines). 00:01:08.853 04:12:47 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:08.853 04:12:47 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:08.853 04:12:47 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:08.853 04:12:47 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:08.853 04:12:47 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:13.043 The Meson build system 00:01:13.043 Version: 1.5.0 00:01:13.043 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:13.043 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:13.043 Build type: native build 00:01:13.043 Program cat found: YES (/usr/bin/cat) 00:01:13.043 Project name: DPDK 00:01:13.043 Project version: 22.11.4 00:01:13.043 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:13.043 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:13.043 Host machine cpu family: x86_64 00:01:13.043 Host machine cpu: x86_64 00:01:13.043 Message: ## Building in Developer Mode ## 00:01:13.043 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:13.043 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:13.043 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:13.043 Program objdump found: YES (/usr/bin/objdump) 00:01:13.043 Program python3 found: YES (/usr/bin/python3) 00:01:13.043 Program cat found: YES (/usr/bin/cat) 00:01:13.043 config/meson.build:83: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:13.043 Checking for size of "void *" : 8 00:01:13.043 Checking for size of "void *" : 8 (cached) 00:01:13.043 Library m found: YES 00:01:13.043 Library numa found: YES 00:01:13.043 Has header "numaif.h" : YES 00:01:13.043 Library fdt found: NO 00:01:13.043 Library execinfo found: NO 00:01:13.043 Has header "execinfo.h" : YES 00:01:13.043 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:13.043 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:13.043 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:13.043 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:13.043 Run-time dependency openssl found: YES 3.1.1 00:01:13.043 Run-time dependency libpcap found: YES 1.10.4 00:01:13.043 Has header "pcap.h" with dependency libpcap: YES 00:01:13.043 Compiler for C supports arguments -Wcast-qual: YES 00:01:13.043 Compiler for C supports arguments -Wdeprecated: YES 00:01:13.043 Compiler for C supports arguments -Wformat: YES 00:01:13.043 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:13.043 Compiler for C supports arguments -Wformat-security: NO 00:01:13.043 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:13.043 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:13.043 Compiler for C supports arguments -Wnested-externs: YES 00:01:13.043 Compiler for C supports arguments -Wold-style-definition: YES 00:01:13.043 Compiler for C supports arguments -Wpointer-arith: YES 00:01:13.043 Compiler for C supports arguments -Wsign-compare: YES 00:01:13.043 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:13.043 Compiler for C supports arguments -Wundef: YES 00:01:13.043 Compiler for C supports arguments -Wwrite-strings: YES 00:01:13.043 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:13.043 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:13.043 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:13.043 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:13.043 Compiler for C supports arguments -mavx512f: YES 00:01:13.043 Checking if "AVX512 checking" compiles: YES 00:01:13.043 Fetching value of define "__SSE4_2__" : 1 00:01:13.043 Fetching value of define "__AES__" : 1 00:01:13.043 Fetching value of define "__AVX__" : 1 00:01:13.043 Fetching value of define "__AVX2__" : (undefined) 00:01:13.043 Fetching value of define "__AVX512BW__" : (undefined) 00:01:13.043 Fetching value of define "__AVX512CD__" : (undefined) 00:01:13.043 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:13.043 Fetching value of define "__AVX512F__" : (undefined) 00:01:13.043 Fetching value of define "__AVX512VL__" : (undefined) 00:01:13.043 Fetching value of define "__PCLMUL__" : 1 00:01:13.043 Fetching value of define "__RDRND__" : 1 00:01:13.043 Fetching value of define "__RDSEED__" : (undefined) 00:01:13.043 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:13.043 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:13.043 Message: lib/kvargs: Defining dependency "kvargs" 00:01:13.043 Message: lib/telemetry: Defining dependency "telemetry" 00:01:13.043 Checking for function "getentropy" : YES 00:01:13.043 Message: lib/eal: Defining dependency "eal" 00:01:13.043 Message: lib/ring: Defining dependency "ring" 00:01:13.043 Message: lib/rcu: Defining dependency "rcu" 00:01:13.043 Message: lib/mempool: Defining dependency "mempool" 00:01:13.043 Message: lib/mbuf: Defining dependency "mbuf" 00:01:13.043 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:13.043 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:13.043 Compiler for C supports arguments -mpclmul: YES 00:01:13.043 Compiler for C supports arguments -maes: YES 00:01:13.043 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:13.043 Compiler for C supports arguments -mavx512bw: YES 00:01:13.043 Compiler for C supports arguments -mavx512dq: YES 00:01:13.043 Compiler for C supports arguments -mavx512vl: YES 00:01:13.043 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:13.043 Compiler for C supports arguments -mavx2: YES 00:01:13.043 Compiler for C supports arguments -mavx: YES 00:01:13.043 Message: lib/net: Defining dependency "net" 00:01:13.043 Message: lib/meter: Defining dependency "meter" 00:01:13.043 Message: lib/ethdev: Defining dependency "ethdev" 00:01:13.043 Message: lib/pci: Defining dependency "pci" 00:01:13.043 Message: lib/cmdline: Defining dependency "cmdline" 00:01:13.043 Message: lib/metrics: Defining dependency "metrics" 00:01:13.043 Message: lib/hash: Defining dependency "hash" 00:01:13.043 Message: lib/timer: Defining dependency "timer" 00:01:13.043 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:13.043 Compiler for C supports arguments -mavx2: YES (cached) 00:01:13.043 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:13.043 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:13.043 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:13.043 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:13.043 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:13.043 Message: lib/acl: Defining dependency "acl" 00:01:13.043 Message: lib/bbdev: Defining dependency "bbdev" 00:01:13.043 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:13.043 Run-time dependency libelf found: YES 0.191 00:01:13.043 Message: lib/bpf: Defining dependency "bpf" 00:01:13.043 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:13.043 Message: lib/compressdev: Defining dependency "compressdev" 00:01:13.043 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:13.043 Message: lib/distributor: Defining dependency "distributor" 00:01:13.043 Message: lib/efd: Defining dependency "efd" 00:01:13.043 Message: lib/eventdev: Defining dependency "eventdev" 00:01:13.043 Message: lib/gpudev: Defining dependency "gpudev" 00:01:13.043 Message: lib/gro: Defining dependency "gro" 00:01:13.043 Message: lib/gso: Defining dependency "gso" 00:01:13.043 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:13.043 Message: lib/jobstats: Defining dependency "jobstats" 00:01:13.043 Message: lib/latencystats: Defining dependency "latencystats" 00:01:13.043 Message: lib/lpm: Defining dependency "lpm" 00:01:13.043 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:13.043 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:13.043 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:13.043 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:13.043 Message: lib/member: Defining dependency "member" 00:01:13.043 Message: lib/pcapng: Defining dependency "pcapng" 00:01:13.043 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:13.043 Message: lib/power: Defining dependency "power" 00:01:13.043 Message: lib/rawdev: Defining dependency "rawdev" 00:01:13.043 Message: lib/regexdev: Defining dependency "regexdev" 00:01:13.043 Message: lib/dmadev: Defining dependency "dmadev" 00:01:13.043 Message: lib/rib: Defining dependency "rib" 00:01:13.043 Message: lib/reorder: Defining dependency "reorder" 00:01:13.043 Message: lib/sched: Defining dependency "sched" 00:01:13.043 Message: lib/security: Defining dependency "security" 00:01:13.043 Message: lib/stack: Defining dependency "stack" 00:01:13.043 Has header "linux/userfaultfd.h" : YES 00:01:13.043 Message: lib/vhost: Defining dependency "vhost" 00:01:13.043 Message: lib/ipsec: Defining dependency "ipsec" 00:01:13.043 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:13.043 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:13.043 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:13.043 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:13.044 Message: lib/fib: Defining dependency "fib" 00:01:13.044 Message: lib/port: Defining dependency "port" 00:01:13.044 Message: lib/pdump: Defining dependency "pdump" 00:01:13.044 Message: lib/table: Defining dependency "table" 00:01:13.044 Message: lib/pipeline: Defining dependency "pipeline" 00:01:13.044 Message: lib/graph: Defining dependency "graph" 00:01:13.044 Message: lib/node: Defining dependency "node" 00:01:13.044 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:13.044 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:13.044 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:13.044 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:13.044 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:13.044 Compiler for C supports arguments -Wno-unused-value: YES 00:01:14.954 Compiler for C supports arguments -Wno-format: YES 00:01:14.954 Compiler for C supports arguments -Wno-format-security: YES 00:01:14.954 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:14.954 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:14.954 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:14.954 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:14.954 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:14.954 Compiler for C supports arguments -mavx2: YES (cached) 00:01:14.954 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:14.954 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:14.954 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:14.954 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:14.955 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:14.955 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:14.955 Configuring doxy-api.conf using configuration 00:01:14.955 Program sphinx-build found: NO 00:01:14.955 Configuring rte_build_config.h using configuration 00:01:14.955 Message: 00:01:14.955 ================= 00:01:14.955 Applications Enabled 00:01:14.955 ================= 00:01:14.955 00:01:14.955 apps: 00:01:14.955 dumpcap, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, test-crypto-perf, 00:01:14.955 test-eventdev, test-fib, test-flow-perf, test-gpudev, test-pipeline, test-pmd, test-regex, test-sad, 00:01:14.955 test-security-perf, 00:01:14.955 00:01:14.955 Message: 00:01:14.955 ================= 00:01:14.955 Libraries Enabled 00:01:14.955 ================= 00:01:14.955 00:01:14.955 libs: 00:01:14.955 kvargs, telemetry, eal, ring, rcu, mempool, mbuf, net, 00:01:14.955 meter, ethdev, pci, cmdline, metrics, hash, timer, acl, 00:01:14.955 bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, efd, 00:01:14.955 eventdev, gpudev, gro, gso, ip_frag, jobstats, latencystats, lpm, 00:01:14.955 member, pcapng, power, rawdev, regexdev, dmadev, rib, reorder, 00:01:14.955 sched, security, stack, vhost, ipsec, fib, port, pdump, 00:01:14.955 table, pipeline, graph, node, 00:01:14.955 00:01:14.955 Message: 00:01:14.955 =============== 00:01:14.955 Drivers Enabled 00:01:14.955 =============== 00:01:14.955 00:01:14.955 common: 00:01:14.955 00:01:14.955 bus: 00:01:14.955 pci, vdev, 00:01:14.955 mempool: 00:01:14.955 ring, 00:01:14.955 dma: 00:01:14.955 00:01:14.955 net: 00:01:14.955 i40e, 00:01:14.955 raw: 00:01:14.955 00:01:14.955 crypto: 00:01:14.955 00:01:14.955 compress: 00:01:14.955 00:01:14.955 regex: 00:01:14.955 00:01:14.955 vdpa: 00:01:14.955 00:01:14.955 event: 00:01:14.955 00:01:14.955 baseband: 00:01:14.955 00:01:14.955 gpu: 00:01:14.955 00:01:14.955 00:01:14.955 Message: 00:01:14.955 ================= 00:01:14.955 Content Skipped 00:01:14.955 ================= 00:01:14.955 00:01:14.955 apps: 00:01:14.955 00:01:14.955 libs: 00:01:14.955 kni: explicitly disabled via build config (deprecated lib) 00:01:14.955 flow_classify: explicitly disabled via build config (deprecated lib) 00:01:14.955 00:01:14.955 drivers: 00:01:14.955 common/cpt: not in enabled drivers build config 00:01:14.955 common/dpaax: not in enabled drivers build config 00:01:14.955 common/iavf: not in enabled drivers build config 00:01:14.955 common/idpf: not in enabled drivers build config 00:01:14.955 common/mvep: not in enabled drivers build config 00:01:14.955 common/octeontx: not in enabled drivers build config 00:01:14.955 bus/auxiliary: not in enabled drivers build config 00:01:14.955 bus/dpaa: not in enabled drivers build config 00:01:14.955 bus/fslmc: not in enabled drivers build config 00:01:14.955 bus/ifpga: not in enabled drivers build config 00:01:14.955 bus/vmbus: not in enabled drivers build config 00:01:14.955 common/cnxk: not in enabled drivers build config 00:01:14.955 common/mlx5: not in enabled drivers build config 00:01:14.955 common/qat: not in enabled drivers build config 00:01:14.955 common/sfc_efx: not in enabled drivers build config 00:01:14.955 mempool/bucket: not in enabled drivers build config 00:01:14.955 mempool/cnxk: not in enabled drivers build config 00:01:14.955 mempool/dpaa: not in enabled drivers build config 00:01:14.955 mempool/dpaa2: not in enabled drivers build config 00:01:14.955 mempool/octeontx: not in enabled drivers build config 00:01:14.955 mempool/stack: not in enabled drivers build config 00:01:14.955 dma/cnxk: not in enabled drivers build config 00:01:14.955 dma/dpaa: not in enabled drivers build config 00:01:14.955 dma/dpaa2: not in enabled drivers build config 00:01:14.955 dma/hisilicon: not in enabled drivers build config 00:01:14.955 dma/idxd: not in enabled drivers build config 00:01:14.955 dma/ioat: not in enabled drivers build config 00:01:14.955 dma/skeleton: not in enabled drivers build config 00:01:14.955 net/af_packet: not in enabled drivers build config 00:01:14.955 net/af_xdp: not in enabled drivers build config 00:01:14.955 net/ark: not in enabled drivers build config 00:01:14.955 net/atlantic: not in enabled drivers build config 00:01:14.955 net/avp: not in enabled drivers build config 00:01:14.955 net/axgbe: not in enabled drivers build config 00:01:14.955 net/bnx2x: not in enabled drivers build config 00:01:14.955 net/bnxt: not in enabled drivers build config 00:01:14.955 net/bonding: not in enabled drivers build config 00:01:14.955 net/cnxk: not in enabled drivers build config 00:01:14.955 net/cxgbe: not in enabled drivers build config 00:01:14.955 net/dpaa: not in enabled drivers build config 00:01:14.955 net/dpaa2: not in enabled drivers build config 00:01:14.955 net/e1000: not in enabled drivers build config 00:01:14.955 net/ena: not in enabled drivers build config 00:01:14.955 net/enetc: not in enabled drivers build config 00:01:14.955 net/enetfec: not in enabled drivers build config 00:01:14.955 net/enic: not in enabled drivers build config 00:01:14.955 net/failsafe: not in enabled drivers build config 00:01:14.955 net/fm10k: not in enabled drivers build config 00:01:14.955 net/gve: not in enabled drivers build config 00:01:14.955 net/hinic: not in enabled drivers build config 00:01:14.955 net/hns3: not in enabled drivers build config 00:01:14.955 net/iavf: not in enabled drivers build config 00:01:14.955 net/ice: not in enabled drivers build config 00:01:14.955 net/idpf: not in enabled drivers build config 00:01:14.955 net/igc: not in enabled drivers build config 00:01:14.955 net/ionic: not in enabled drivers build config 00:01:14.955 net/ipn3ke: not in enabled drivers build config 00:01:14.955 net/ixgbe: not in enabled drivers build config 00:01:14.955 net/kni: not in enabled drivers build config 00:01:14.955 net/liquidio: not in enabled drivers build config 00:01:14.955 net/mana: not in enabled drivers build config 00:01:14.955 net/memif: not in enabled drivers build config 00:01:14.955 net/mlx4: not in enabled drivers build config 00:01:14.955 net/mlx5: not in enabled drivers build config 00:01:14.955 net/mvneta: not in enabled drivers build config 00:01:14.955 net/mvpp2: not in enabled drivers build config 00:01:14.955 net/netvsc: not in enabled drivers build config 00:01:14.955 net/nfb: not in enabled drivers build config 00:01:14.955 net/nfp: not in enabled drivers build config 00:01:14.955 net/ngbe: not in enabled drivers build config 00:01:14.955 net/null: not in enabled drivers build config 00:01:14.955 net/octeontx: not in enabled drivers build config 00:01:14.955 net/octeon_ep: not in enabled drivers build config 00:01:14.955 net/pcap: not in enabled drivers build config 00:01:14.955 net/pfe: not in enabled drivers build config 00:01:14.955 net/qede: not in enabled drivers build config 00:01:14.955 net/ring: not in enabled drivers build config 00:01:14.955 net/sfc: not in enabled drivers build config 00:01:14.955 net/softnic: not in enabled drivers build config 00:01:14.955 net/tap: not in enabled drivers build config 00:01:14.955 net/thunderx: not in enabled drivers build config 00:01:14.955 net/txgbe: not in enabled drivers build config 00:01:14.955 net/vdev_netvsc: not in enabled drivers build config 00:01:14.955 net/vhost: not in enabled drivers build config 00:01:14.955 net/virtio: not in enabled drivers build config 00:01:14.955 net/vmxnet3: not in enabled drivers build config 00:01:14.955 raw/cnxk_bphy: not in enabled drivers build config 00:01:14.955 raw/cnxk_gpio: not in enabled drivers build config 00:01:14.955 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:14.955 raw/ifpga: not in enabled drivers build config 00:01:14.955 raw/ntb: not in enabled drivers build config 00:01:14.955 raw/skeleton: not in enabled drivers build config 00:01:14.955 crypto/armv8: not in enabled drivers build config 00:01:14.955 crypto/bcmfs: not in enabled drivers build config 00:01:14.955 crypto/caam_jr: not in enabled drivers build config 00:01:14.955 crypto/ccp: not in enabled drivers build config 00:01:14.955 crypto/cnxk: not in enabled drivers build config 00:01:14.955 crypto/dpaa_sec: not in enabled drivers build config 00:01:14.955 crypto/dpaa2_sec: not in enabled drivers build config 00:01:14.955 crypto/ipsec_mb: not in enabled drivers build config 00:01:14.955 crypto/mlx5: not in enabled drivers build config 00:01:14.955 crypto/mvsam: not in enabled drivers build config 00:01:14.955 crypto/nitrox: not in enabled drivers build config 00:01:14.955 crypto/null: not in enabled drivers build config 00:01:14.955 crypto/octeontx: not in enabled drivers build config 00:01:14.955 crypto/openssl: not in enabled drivers build config 00:01:14.955 crypto/scheduler: not in enabled drivers build config 00:01:14.955 crypto/uadk: not in enabled drivers build config 00:01:14.955 crypto/virtio: not in enabled drivers build config 00:01:14.955 compress/isal: not in enabled drivers build config 00:01:14.955 compress/mlx5: not in enabled drivers build config 00:01:14.955 compress/octeontx: not in enabled drivers build config 00:01:14.955 compress/zlib: not in enabled drivers build config 00:01:14.955 regex/mlx5: not in enabled drivers build config 00:01:14.955 regex/cn9k: not in enabled drivers build config 00:01:14.955 vdpa/ifc: not in enabled drivers build config 00:01:14.955 vdpa/mlx5: not in enabled drivers build config 00:01:14.955 vdpa/sfc: not in enabled drivers build config 00:01:14.955 event/cnxk: not in enabled drivers build config 00:01:14.955 event/dlb2: not in enabled drivers build config 00:01:14.955 event/dpaa: not in enabled drivers build config 00:01:14.955 event/dpaa2: not in enabled drivers build config 00:01:14.955 event/dsw: not in enabled drivers build config 00:01:14.955 event/opdl: not in enabled drivers build config 00:01:14.955 event/skeleton: not in enabled drivers build config 00:01:14.955 event/sw: not in enabled drivers build config 00:01:14.955 event/octeontx: not in enabled drivers build config 00:01:14.955 baseband/acc: not in enabled drivers build config 00:01:14.955 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:14.955 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:14.955 baseband/la12xx: not in enabled drivers build config 00:01:14.955 baseband/null: not in enabled drivers build config 00:01:14.956 baseband/turbo_sw: not in enabled drivers build config 00:01:14.956 gpu/cuda: not in enabled drivers build config 00:01:14.956 00:01:14.956 00:01:14.956 Build targets in project: 316 00:01:14.956 00:01:14.956 DPDK 22.11.4 00:01:14.956 00:01:14.956 User defined options 00:01:14.956 libdir : lib 00:01:14.956 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:14.956 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:14.956 c_link_args : 00:01:14.956 enable_docs : false 00:01:14.956 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:14.956 enable_kmods : false 00:01:14.956 machine : native 00:01:14.956 tests : false 00:01:14.956 00:01:14.956 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:14.956 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:14.956 04:12:53 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:14.956 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:14.956 [1/745] Generating lib/rte_kvargs_def with a custom command 00:01:14.956 [2/745] Generating lib/rte_telemetry_mingw with a custom command 00:01:14.956 [3/745] Generating lib/rte_kvargs_mingw with a custom command 00:01:14.956 [4/745] Generating lib/rte_telemetry_def with a custom command 00:01:14.956 [5/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:14.956 [6/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:14.956 [7/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:14.956 [8/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:14.956 [9/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:14.956 [10/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:14.956 [11/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:14.956 [12/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:14.956 [13/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:14.956 [14/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:14.956 [15/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:14.956 [16/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:14.956 [17/745] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:14.956 [18/745] Linking static target lib/librte_kvargs.a 00:01:14.956 [19/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:14.956 [20/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:14.956 [21/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:14.956 [22/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:14.956 [23/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:14.956 [24/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:14.956 [25/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:14.956 [26/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:14.956 [27/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:14.956 [28/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:14.956 [29/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:14.956 [30/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:14.956 [31/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_log.c.o 00:01:14.956 [32/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:14.956 [33/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:14.956 [34/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:15.223 [35/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:15.223 [36/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:15.223 [37/745] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:15.223 [38/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:15.223 [39/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:15.223 [40/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:15.223 [41/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:15.223 [42/745] Generating lib/rte_eal_def with a custom command 00:01:15.223 [43/745] Generating lib/rte_eal_mingw with a custom command 00:01:15.223 [44/745] Generating lib/rte_ring_def with a custom command 00:01:15.223 [45/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:15.223 [46/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:15.223 [47/745] Generating lib/rte_ring_mingw with a custom command 00:01:15.223 [48/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:15.223 [49/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:15.223 [50/745] Generating lib/rte_rcu_def with a custom command 00:01:15.223 [51/745] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:15.223 [52/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:15.223 [53/745] Generating lib/rte_rcu_mingw with a custom command 00:01:15.223 [54/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:15.223 [55/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:15.223 [56/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:15.223 [57/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:15.223 [58/745] Generating lib/rte_mempool_def with a custom command 00:01:15.223 [59/745] Generating lib/rte_mempool_mingw with a custom command 00:01:15.223 [60/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:15.223 [61/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_log.c.o 00:01:15.223 [62/745] Generating lib/rte_mbuf_def with a custom command 00:01:15.223 [63/745] Generating lib/rte_mbuf_mingw with a custom command 00:01:15.223 [64/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:15.223 [65/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:15.223 [66/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:15.223 [67/745] Generating lib/rte_net_def with a custom command 00:01:15.223 [68/745] Generating lib/rte_net_mingw with a custom command 00:01:15.223 [69/745] Generating lib/rte_meter_def with a custom command 00:01:15.223 [70/745] Generating lib/rte_meter_mingw with a custom command 00:01:15.223 [71/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:15.223 [72/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:15.223 [73/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:15.223 [74/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:15.223 [75/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:15.223 [76/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:15.223 [77/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:15.483 [78/745] Generating lib/rte_ethdev_def with a custom command 00:01:15.483 [79/745] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:15.483 [80/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:15.483 [81/745] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:15.483 [82/745] Linking static target lib/librte_ring.a 00:01:15.483 [83/745] Generating lib/rte_ethdev_mingw with a custom command 00:01:15.483 [84/745] Linking target lib/librte_kvargs.so.23.0 00:01:15.483 [85/745] Generating lib/rte_pci_def with a custom command 00:01:15.483 [86/745] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:15.483 [87/745] Linking static target lib/librte_meter.a 00:01:15.483 [88/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:15.483 [89/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:15.483 [90/745] Generating lib/rte_pci_mingw with a custom command 00:01:15.483 [91/745] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:15.483 [92/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:15.483 [93/745] Linking static target lib/librte_pci.a 00:01:15.745 [94/745] Generating symbol file lib/librte_kvargs.so.23.0.p/librte_kvargs.so.23.0.symbols 00:01:15.745 [95/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:15.745 [96/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:15.745 [97/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:15.745 [98/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:15.745 [99/745] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:15.745 [100/745] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:15.745 [101/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:15.745 [102/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:16.007 [103/745] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.007 [104/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:16.007 [105/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:16.007 [106/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:16.007 [107/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:16.007 [108/745] Generating lib/rte_cmdline_def with a custom command 00:01:16.007 [109/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:16.007 [110/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:16.007 [111/745] Linking static target lib/librte_telemetry.a 00:01:16.007 [112/745] Generating lib/rte_cmdline_mingw with a custom command 00:01:16.007 [113/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:16.007 [114/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:16.007 [115/745] Generating lib/rte_metrics_def with a custom command 00:01:16.007 [116/745] Generating lib/rte_metrics_mingw with a custom command 00:01:16.007 [117/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:16.007 [118/745] Generating lib/rte_hash_def with a custom command 00:01:16.007 [119/745] Generating lib/rte_timer_def with a custom command 00:01:16.007 [120/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:16.007 [121/745] Generating lib/rte_hash_mingw with a custom command 00:01:16.007 [122/745] Generating lib/rte_timer_mingw with a custom command 00:01:16.272 [123/745] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:16.272 [124/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:16.272 [125/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:16.272 [126/745] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:16.272 [127/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:16.272 [128/745] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:16.272 [129/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:16.272 [130/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:16.536 [131/745] Generating lib/rte_acl_def with a custom command 00:01:16.536 [132/745] Generating lib/rte_acl_mingw with a custom command 00:01:16.536 [133/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:16.536 [134/745] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:16.536 [135/745] Generating lib/rte_bbdev_def with a custom command 00:01:16.536 [136/745] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.536 [137/745] Generating lib/rte_bbdev_mingw with a custom command 00:01:16.536 [138/745] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:16.536 [139/745] Generating lib/rte_bitratestats_def with a custom command 00:01:16.536 [140/745] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:16.536 [141/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:16.536 [142/745] Generating lib/rte_bitratestats_mingw with a custom command 00:01:16.536 [143/745] Linking target lib/librte_telemetry.so.23.0 00:01:16.536 [144/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:16.536 [145/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:16.536 [146/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:16.536 [147/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:16.536 [148/745] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:16.536 [149/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:16.536 [150/745] Generating lib/rte_bpf_def with a custom command 00:01:16.536 [151/745] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:16.536 [152/745] Generating lib/rte_bpf_mingw with a custom command 00:01:16.802 [153/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:16.802 [154/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:16.802 [155/745] Generating lib/rte_cfgfile_def with a custom command 00:01:16.802 [156/745] Generating lib/rte_cfgfile_mingw with a custom command 00:01:16.802 [157/745] Generating symbol file lib/librte_telemetry.so.23.0.p/librte_telemetry.so.23.0.symbols 00:01:16.802 [158/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:16.802 [159/745] Generating lib/rte_compressdev_mingw with a custom command 00:01:16.802 [160/745] Generating lib/rte_compressdev_def with a custom command 00:01:16.802 [161/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:16.802 [162/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:16.802 [163/745] Generating lib/rte_cryptodev_def with a custom command 00:01:16.802 [164/745] Generating lib/rte_cryptodev_mingw with a custom command 00:01:16.802 [165/745] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:16.802 [166/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:16.802 [167/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:16.802 [168/745] Linking static target lib/librte_rcu.a 00:01:16.802 [169/745] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:16.802 [170/745] Linking static target lib/librte_timer.a 00:01:16.802 [171/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:16.802 [172/745] Generating lib/rte_distributor_def with a custom command 00:01:16.802 [173/745] Generating lib/rte_distributor_mingw with a custom command 00:01:17.064 [174/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:17.064 [175/745] Linking static target lib/librte_cmdline.a 00:01:17.064 [176/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:17.064 [177/745] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:17.064 [178/745] Generating lib/rte_efd_def with a custom command 00:01:17.064 [179/745] Linking static target lib/librte_net.a 00:01:17.064 [180/745] Generating lib/rte_efd_mingw with a custom command 00:01:17.064 [181/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:17.064 [182/745] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:17.064 [183/745] Linking static target lib/librte_cfgfile.a 00:01:17.064 [184/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:17.331 [185/745] Linking static target lib/librte_metrics.a 00:01:17.332 [186/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:17.332 [187/745] Linking static target lib/librte_mempool.a 00:01:17.332 [188/745] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.332 [189/745] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.332 [190/745] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:17.332 [191/745] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.593 [192/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:17.593 [193/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:17.593 [194/745] Linking static target lib/librte_eal.a 00:01:17.593 [195/745] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:17.593 [196/745] Generating lib/rte_eventdev_def with a custom command 00:01:17.593 [197/745] Generating lib/rte_eventdev_mingw with a custom command 00:01:17.593 [198/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:17.593 [199/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:17.593 [200/745] Generating lib/rte_gpudev_mingw with a custom command 00:01:17.593 [201/745] Generating lib/rte_gpudev_def with a custom command 00:01:17.593 [202/745] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.593 [203/745] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:17.593 [204/745] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:17.856 [205/745] Linking static target lib/librte_bitratestats.a 00:01:17.856 [206/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:17.856 [207/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:17.856 [208/745] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.856 [209/745] Generating lib/rte_gro_def with a custom command 00:01:17.856 [210/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:17.856 [211/745] Generating lib/rte_gro_mingw with a custom command 00:01:17.856 [212/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:17.856 [213/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:18.118 [214/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:18.118 [215/745] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.118 [216/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:18.118 [217/745] Generating lib/rte_gso_def with a custom command 00:01:18.118 [218/745] Generating lib/rte_gso_mingw with a custom command 00:01:18.118 [219/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:18.118 [220/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:18.118 [221/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:18.379 [222/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:18.379 [223/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:18.379 [224/745] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.379 [225/745] Generating lib/rte_ip_frag_def with a custom command 00:01:18.379 [226/745] Generating lib/rte_ip_frag_mingw with a custom command 00:01:18.379 [227/745] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:18.379 [228/745] Linking static target lib/librte_bbdev.a 00:01:18.379 [229/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:18.379 [230/745] Generating lib/rte_jobstats_mingw with a custom command 00:01:18.379 [231/745] Generating lib/rte_jobstats_def with a custom command 00:01:18.379 [232/745] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.379 [233/745] Generating lib/rte_latencystats_def with a custom command 00:01:18.379 [234/745] Generating lib/rte_latencystats_mingw with a custom command 00:01:18.379 [235/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:18.379 [236/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:18.379 [237/745] Linking static target lib/librte_compressdev.a 00:01:18.379 [238/745] Generating lib/rte_lpm_def with a custom command 00:01:18.646 [239/745] Generating lib/rte_lpm_mingw with a custom command 00:01:18.646 [240/745] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:18.646 [241/745] Linking static target lib/librte_jobstats.a 00:01:18.646 [242/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:18.646 [243/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:18.909 [244/745] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:18.909 [245/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:18.909 [246/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:18.909 [247/745] Linking static target lib/librte_distributor.a 00:01:18.909 [248/745] Generating lib/rte_member_def with a custom command 00:01:18.909 [249/745] Generating lib/rte_member_mingw with a custom command 00:01:18.909 [250/745] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.170 [251/745] Generating lib/rte_pcapng_def with a custom command 00:01:19.170 [252/745] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:19.170 [253/745] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:19.170 [254/745] Generating lib/rte_pcapng_mingw with a custom command 00:01:19.170 [255/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:19.170 [256/745] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.170 [257/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:19.170 [258/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:19.170 [259/745] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:19.170 [260/745] Linking static target lib/librte_bpf.a 00:01:19.170 [261/745] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:19.170 [262/745] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:19.436 [263/745] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:19.436 [264/745] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.436 [265/745] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:19.436 [266/745] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:19.436 [267/745] Generating lib/rte_power_def with a custom command 00:01:19.436 [268/745] Generating lib/rte_power_mingw with a custom command 00:01:19.436 [269/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:19.436 [270/745] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:19.436 [271/745] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:19.436 [272/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:19.436 [273/745] Generating lib/rte_rawdev_def with a custom command 00:01:19.436 [274/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:19.436 [275/745] Linking static target lib/librte_gpudev.a 00:01:19.436 [276/745] Generating lib/rte_rawdev_mingw with a custom command 00:01:19.436 [277/745] Linking static target lib/librte_gro.a 00:01:19.436 [278/745] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:19.436 [279/745] Generating lib/rte_regexdev_mingw with a custom command 00:01:19.436 [280/745] Generating lib/rte_dmadev_def with a custom command 00:01:19.436 [281/745] Generating lib/rte_regexdev_def with a custom command 00:01:19.436 [282/745] Generating lib/rte_dmadev_mingw with a custom command 00:01:19.436 [283/745] Generating lib/rte_rib_def with a custom command 00:01:19.702 [284/745] Generating lib/rte_rib_mingw with a custom command 00:01:19.702 [285/745] Generating lib/rte_reorder_def with a custom command 00:01:19.702 [286/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:19.702 [287/745] Compiling C object lib/librte_power.a.p/power_rte_power_empty_poll.c.o 00:01:19.702 [288/745] Generating lib/rte_reorder_mingw with a custom command 00:01:19.702 [289/745] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.702 [290/745] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.702 [291/745] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.967 [292/745] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:19.967 [293/745] Generating lib/rte_sched_mingw with a custom command 00:01:19.967 [294/745] Generating lib/rte_sched_def with a custom command 00:01:19.967 [295/745] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:19.967 [296/745] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:19.967 [297/745] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:19.967 [298/745] Linking static target lib/librte_latencystats.a 00:01:19.967 [299/745] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:19.967 [300/745] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:19.967 [301/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:19.967 [302/745] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:19.967 [303/745] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:19.967 [304/745] Generating lib/rte_security_mingw with a custom command 00:01:19.967 [305/745] Generating lib/rte_security_def with a custom command 00:01:19.967 [306/745] Generating lib/rte_stack_def with a custom command 00:01:19.967 [307/745] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:19.967 [308/745] Generating lib/rte_stack_mingw with a custom command 00:01:19.967 [309/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:20.230 [310/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:20.230 [311/745] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:20.230 [312/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:20.230 [313/745] Linking static target lib/librte_rawdev.a 00:01:20.230 [314/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:20.230 [315/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:20.230 [316/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:20.230 [317/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:20.230 [318/745] Linking static target lib/librte_stack.a 00:01:20.230 [319/745] Generating lib/rte_vhost_def with a custom command 00:01:20.230 [320/745] Generating lib/rte_vhost_mingw with a custom command 00:01:20.230 [321/745] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:20.230 [322/745] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:20.230 [323/745] Linking static target lib/librte_dmadev.a 00:01:20.230 [324/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:20.230 [325/745] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.230 [326/745] Linking static target lib/librte_ip_frag.a 00:01:20.230 [327/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:20.230 [328/745] Generating lib/rte_ipsec_def with a custom command 00:01:20.495 [329/745] Generating lib/rte_ipsec_mingw with a custom command 00:01:20.495 [330/745] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.495 [331/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:20.495 [332/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:20.757 [333/745] Compiling C object lib/librte_power.a.p/power_rte_power_intel_uncore.c.o 00:01:20.757 [334/745] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.757 [335/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:20.757 [336/745] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.757 [337/745] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.757 [338/745] Generating lib/rte_fib_mingw with a custom command 00:01:20.757 [339/745] Generating lib/rte_fib_def with a custom command 00:01:21.022 [340/745] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:21.022 [341/745] Linking static target lib/librte_gso.a 00:01:21.022 [342/745] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:21.022 [343/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:21.022 [344/745] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:21.022 [345/745] Linking static target lib/librte_regexdev.a 00:01:21.022 [346/745] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.288 [347/745] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:21.288 [348/745] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.288 [349/745] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:21.288 [350/745] Linking static target lib/librte_efd.a 00:01:21.288 [351/745] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:21.288 [352/745] Linking static target lib/librte_pcapng.a 00:01:21.288 [353/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:21.288 [354/745] Linking static target lib/librte_lpm.a 00:01:21.556 [355/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:21.556 [356/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:21.556 [357/745] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:21.556 [358/745] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:21.556 [359/745] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:21.556 [360/745] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:21.556 [361/745] Linking static target lib/librte_reorder.a 00:01:21.556 [362/745] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.556 [363/745] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:21.556 [364/745] Linking static target lib/acl/libavx2_tmp.a 00:01:21.556 [365/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:21.556 [366/745] Generating lib/rte_port_def with a custom command 00:01:21.817 [367/745] Generating lib/rte_port_mingw with a custom command 00:01:21.817 [368/745] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:21.817 [369/745] Generating lib/rte_pdump_def with a custom command 00:01:21.817 [370/745] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:21.817 [371/745] Generating lib/rte_pdump_mingw with a custom command 00:01:21.817 [372/745] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:21.817 [373/745] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:21.817 [374/745] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.817 [375/745] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:21.817 [376/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:21.817 [377/745] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:21.817 [378/745] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:21.817 [379/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:21.817 [380/745] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:21.817 [381/745] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.817 [382/745] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.817 [383/745] Linking static target lib/librte_security.a 00:01:22.081 [384/745] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:22.081 [385/745] Linking static target lib/librte_power.a 00:01:22.081 [386/745] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:22.081 [387/745] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.081 [388/745] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:22.081 [389/745] Linking static target lib/librte_hash.a 00:01:22.344 [390/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:22.344 [391/745] Linking static target lib/librte_rib.a 00:01:22.344 [392/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:22.344 [393/745] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:22.344 [394/745] Linking static target lib/acl/libavx512_tmp.a 00:01:22.344 [395/745] Linking static target lib/librte_acl.a 00:01:22.344 [396/745] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:22.344 [397/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:22.605 [398/745] Generating lib/rte_table_def with a custom command 00:01:22.605 [399/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:22.605 [400/745] Generating lib/rte_table_mingw with a custom command 00:01:22.605 [401/745] Linking static target lib/librte_ethdev.a 00:01:22.605 [402/745] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.605 [403/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:22.867 [404/745] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.867 [405/745] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.867 [406/745] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:23.131 [407/745] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:23.131 [408/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:23.131 [409/745] Linking static target lib/librte_mbuf.a 00:01:23.131 [410/745] Generating lib/rte_pipeline_def with a custom command 00:01:23.131 [411/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:23.131 [412/745] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:23.131 [413/745] Generating lib/rte_pipeline_mingw with a custom command 00:01:23.131 [414/745] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:23.131 [415/745] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.131 [416/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:23.131 [417/745] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:23.131 [418/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:23.131 [419/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:23.131 [420/745] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:23.131 [421/745] Generating lib/rte_graph_def with a custom command 00:01:23.131 [422/745] Generating lib/rte_graph_mingw with a custom command 00:01:23.398 [423/745] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:23.398 [424/745] Linking static target lib/librte_fib.a 00:01:23.398 [425/745] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:23.398 [426/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:23.398 [427/745] Linking static target lib/librte_member.a 00:01:23.398 [428/745] Linking static target lib/librte_eventdev.a 00:01:23.398 [429/745] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.398 [430/745] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:23.398 [431/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:23.659 [432/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:23.659 [433/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:23.659 [434/745] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:23.659 [435/745] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:23.659 [436/745] Generating lib/rte_node_def with a custom command 00:01:23.659 [437/745] Generating lib/rte_node_mingw with a custom command 00:01:23.659 [438/745] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:23.659 [439/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:23.659 [440/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:23.928 [441/745] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.928 [442/745] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:23.928 [443/745] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.928 [444/745] Generating drivers/rte_bus_pci_def with a custom command 00:01:23.928 [445/745] Generating drivers/rte_bus_pci_mingw with a custom command 00:01:23.928 [446/745] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.928 [447/745] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:23.928 [448/745] Linking static target lib/librte_sched.a 00:01:23.928 [449/745] Generating drivers/rte_bus_vdev_def with a custom command 00:01:23.928 [450/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:23.928 [451/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:23.928 [452/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:23.928 [453/745] Generating drivers/rte_bus_vdev_mingw with a custom command 00:01:23.928 [454/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:23.928 [455/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:23.928 [456/745] Generating drivers/rte_mempool_ring_mingw with a custom command 00:01:23.928 [457/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:24.192 [458/745] Generating drivers/rte_mempool_ring_def with a custom command 00:01:24.192 [459/745] Linking static target lib/librte_cryptodev.a 00:01:24.192 [460/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:24.192 [461/745] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:24.192 [462/745] Linking static target lib/librte_pdump.a 00:01:24.192 [463/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:24.192 [464/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:24.458 [465/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:24.458 [466/745] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:24.458 [467/745] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:24.458 [468/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:24.458 [469/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:24.458 [470/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:24.458 [471/745] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:24.458 [472/745] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:24.458 [473/745] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:24.458 [474/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:24.723 [475/745] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:24.723 [476/745] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.723 [477/745] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:24.723 [478/745] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:24.723 [479/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:24.723 [480/745] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.723 [481/745] Generating drivers/rte_net_i40e_def with a custom command 00:01:24.723 [482/745] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:24.723 [483/745] Generating drivers/rte_net_i40e_mingw with a custom command 00:01:24.723 [484/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:24.723 [485/745] Linking static target lib/librte_table.a 00:01:24.723 [486/745] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:24.723 [487/745] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:24.991 [488/745] Linking static target drivers/librte_bus_vdev.a 00:01:24.991 [489/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:24.991 [490/745] Compiling C object drivers/librte_bus_vdev.so.23.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:24.991 [491/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:24.991 [492/745] Linking static target lib/librte_ipsec.a 00:01:25.253 [493/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:25.253 [494/745] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:25.253 [495/745] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.253 [496/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:25.253 [497/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:25.253 [498/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:25.515 [499/745] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:25.515 [500/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:25.515 [501/745] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:25.515 [502/745] Linking static target lib/librte_graph.a 00:01:25.515 [503/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:25.515 [504/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:25.515 [505/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:25.515 [506/745] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:25.515 [507/745] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:25.515 [508/745] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:25.515 [509/745] Compiling C object drivers/librte_bus_pci.so.23.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:25.515 [510/745] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.515 [511/745] Linking static target drivers/librte_bus_pci.a 00:01:25.779 [512/745] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.779 [513/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:26.045 [514/745] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:26.312 [515/745] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.312 [516/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:26.312 [517/745] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.312 [518/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:26.312 [519/745] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:26.312 [520/745] Linking static target lib/librte_port.a 00:01:26.578 [521/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:26.578 [522/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:26.578 [523/745] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:26.578 [524/745] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:26.578 [525/745] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:26.886 [526/745] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:26.886 [527/745] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.194 [528/745] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:27.195 [529/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:27.195 [530/745] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:27.195 [531/745] Linking static target drivers/librte_mempool_ring.a 00:01:27.195 [532/745] Compiling C object drivers/librte_mempool_ring.so.23.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:27.195 [533/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:27.195 [534/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:27.195 [535/745] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:27.195 [536/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:27.195 [537/745] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:27.195 [538/745] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.463 [539/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:27.463 [540/745] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.463 [541/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:27.733 [542/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:27.733 [543/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:27.999 [544/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:27.999 [545/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:27.999 [546/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:27.999 [547/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:27.999 [548/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:28.262 [549/745] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:28.262 [550/745] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:28.262 [551/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:28.262 [552/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:28.524 [553/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:28.786 [554/745] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:28.786 [555/745] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:28.786 [556/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:28.786 [557/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:28.786 [558/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:29.048 [559/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:29.310 [560/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:29.310 [561/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:29.310 [562/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:29.310 [563/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:29.310 [564/745] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:29.572 [565/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:29.572 [566/745] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:29.572 [567/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:29.572 [568/745] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.572 [569/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:29.572 [570/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:29.836 [571/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:29.836 [572/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:29.836 [573/745] Linking target lib/librte_eal.so.23.0 00:01:29.836 [574/745] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:29.836 [575/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:29.836 [576/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:29.836 [577/745] Generating symbol file lib/librte_eal.so.23.0.p/librte_eal.so.23.0.symbols 00:01:30.097 [578/745] Linking target lib/librte_ring.so.23.0 00:01:30.097 [579/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:30.097 [580/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:30.097 [581/745] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.097 [582/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:30.097 [583/745] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:30.097 [584/745] Linking target lib/librte_meter.so.23.0 00:01:30.097 [585/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:30.097 [586/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:30.097 [587/745] Linking target lib/librte_pci.so.23.0 00:01:30.097 [588/745] Linking target lib/librte_timer.so.23.0 00:01:30.097 [589/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:30.097 [590/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:30.097 [591/745] Linking target lib/librte_acl.so.23.0 00:01:30.097 [592/745] Linking target lib/librte_cfgfile.so.23.0 00:01:30.098 [593/745] Linking target lib/librte_jobstats.so.23.0 00:01:30.098 [594/745] Linking target lib/librte_rawdev.so.23.0 00:01:30.363 [595/745] Linking target lib/librte_stack.so.23.0 00:01:30.363 [596/745] Linking target lib/librte_dmadev.so.23.0 00:01:30.363 [597/745] Generating symbol file lib/librte_ring.so.23.0.p/librte_ring.so.23.0.symbols 00:01:30.363 [598/745] Linking target lib/librte_graph.so.23.0 00:01:30.363 [599/745] Linking target drivers/librte_bus_vdev.so.23.0 00:01:30.363 [600/745] Linking target lib/librte_rcu.so.23.0 00:01:30.363 [601/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:30.363 [602/745] Linking target lib/librte_mempool.so.23.0 00:01:30.363 [603/745] Generating symbol file lib/librte_meter.so.23.0.p/librte_meter.so.23.0.symbols 00:01:30.363 [604/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:30.363 [605/745] Generating symbol file lib/librte_pci.so.23.0.p/librte_pci.so.23.0.symbols 00:01:30.363 [606/745] Generating symbol file lib/librte_timer.so.23.0.p/librte_timer.so.23.0.symbols 00:01:30.363 [607/745] Generating symbol file lib/librte_acl.so.23.0.p/librte_acl.so.23.0.symbols 00:01:30.363 [608/745] Linking target drivers/librte_bus_pci.so.23.0 00:01:30.363 [609/745] Generating symbol file lib/librte_dmadev.so.23.0.p/librte_dmadev.so.23.0.symbols 00:01:30.625 [610/745] Generating symbol file lib/librte_graph.so.23.0.p/librte_graph.so.23.0.symbols 00:01:30.625 [611/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:30.625 [612/745] Generating symbol file lib/librte_rcu.so.23.0.p/librte_rcu.so.23.0.symbols 00:01:30.625 [613/745] Generating symbol file lib/librte_mempool.so.23.0.p/librte_mempool.so.23.0.symbols 00:01:30.625 [614/745] Generating symbol file drivers/librte_bus_vdev.so.23.0.p/librte_bus_vdev.so.23.0.symbols 00:01:30.625 [615/745] Linking target lib/librte_mbuf.so.23.0 00:01:30.625 [616/745] Linking target lib/librte_rib.so.23.0 00:01:30.625 [617/745] Generating symbol file drivers/librte_bus_pci.so.23.0.p/librte_bus_pci.so.23.0.symbols 00:01:30.885 [618/745] Linking target drivers/librte_mempool_ring.so.23.0 00:01:30.885 [619/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:30.885 [620/745] Generating symbol file lib/librte_mbuf.so.23.0.p/librte_mbuf.so.23.0.symbols 00:01:30.885 [621/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:30.885 [622/745] Generating symbol file lib/librte_rib.so.23.0.p/librte_rib.so.23.0.symbols 00:01:30.885 [623/745] Linking target lib/librte_net.so.23.0 00:01:31.152 [624/745] Linking target lib/librte_bbdev.so.23.0 00:01:31.152 [625/745] Linking target lib/librte_compressdev.so.23.0 00:01:31.152 [626/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:31.152 [627/745] Linking target lib/librte_cryptodev.so.23.0 00:01:31.152 [628/745] Linking target lib/librte_distributor.so.23.0 00:01:31.152 [629/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:31.152 [630/745] Linking target lib/librte_gpudev.so.23.0 00:01:31.152 [631/745] Linking target lib/librte_regexdev.so.23.0 00:01:31.152 [632/745] Generating symbol file lib/librte_net.so.23.0.p/librte_net.so.23.0.symbols 00:01:31.152 [633/745] Linking target lib/librte_reorder.so.23.0 00:01:31.152 [634/745] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:31.152 [635/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:31.152 [636/745] Linking target lib/librte_sched.so.23.0 00:01:31.152 [637/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:31.411 [638/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:31.411 [639/745] Linking target lib/librte_fib.so.23.0 00:01:31.411 [640/745] Linking target lib/librte_ethdev.so.23.0 00:01:31.411 [641/745] Linking target lib/librte_cmdline.so.23.0 00:01:31.411 [642/745] Linking target lib/librte_hash.so.23.0 00:01:31.411 [643/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:31.411 [644/745] Generating symbol file lib/librte_cryptodev.so.23.0.p/librte_cryptodev.so.23.0.symbols 00:01:31.411 [645/745] Linking target lib/librte_security.so.23.0 00:01:31.411 [646/745] Generating symbol file lib/librte_sched.so.23.0.p/librte_sched.so.23.0.symbols 00:01:31.411 [647/745] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:31.671 [648/745] Generating symbol file lib/librte_hash.so.23.0.p/librte_hash.so.23.0.symbols 00:01:31.671 [649/745] Generating symbol file lib/librte_ethdev.so.23.0.p/librte_ethdev.so.23.0.symbols 00:01:31.671 [650/745] Generating symbol file lib/librte_security.so.23.0.p/librte_security.so.23.0.symbols 00:01:31.671 [651/745] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:31.671 [652/745] Linking target lib/librte_efd.so.23.0 00:01:31.671 [653/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:31.671 [654/745] Linking target lib/librte_pcapng.so.23.0 00:01:31.671 [655/745] Linking target lib/librte_member.so.23.0 00:01:31.671 [656/745] Linking target lib/librte_gro.so.23.0 00:01:31.671 [657/745] Linking target lib/librte_gso.so.23.0 00:01:31.671 [658/745] Linking target lib/librte_ip_frag.so.23.0 00:01:31.671 [659/745] Linking target lib/librte_lpm.so.23.0 00:01:31.671 [660/745] Linking target lib/librte_bpf.so.23.0 00:01:31.671 [661/745] Linking target lib/librte_metrics.so.23.0 00:01:31.671 [662/745] Linking target lib/librte_eventdev.so.23.0 00:01:31.671 [663/745] Linking target lib/librte_power.so.23.0 00:01:31.671 [664/745] Linking target lib/librte_ipsec.so.23.0 00:01:31.671 [665/745] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:31.671 [666/745] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:31.671 [667/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:31.930 [668/745] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:31.930 [669/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:31.930 [670/745] Generating symbol file lib/librte_ip_frag.so.23.0.p/librte_ip_frag.so.23.0.symbols 00:01:31.930 [671/745] Generating symbol file lib/librte_bpf.so.23.0.p/librte_bpf.so.23.0.symbols 00:01:31.930 [672/745] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:31.930 [673/745] Generating symbol file lib/librte_metrics.so.23.0.p/librte_metrics.so.23.0.symbols 00:01:31.930 [674/745] Generating symbol file lib/librte_lpm.so.23.0.p/librte_lpm.so.23.0.symbols 00:01:31.930 [675/745] Generating symbol file lib/librte_pcapng.so.23.0.p/librte_pcapng.so.23.0.symbols 00:01:31.930 [676/745] Generating symbol file lib/librte_eventdev.so.23.0.p/librte_eventdev.so.23.0.symbols 00:01:31.930 [677/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:31.930 [678/745] Linking target lib/librte_pdump.so.23.0 00:01:31.930 [679/745] Linking target lib/librte_latencystats.so.23.0 00:01:31.930 [680/745] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:31.930 [681/745] Linking target lib/librte_bitratestats.so.23.0 00:01:31.930 [682/745] Linking target lib/librte_port.so.23.0 00:01:32.189 [683/745] Generating symbol file lib/librte_port.so.23.0.p/librte_port.so.23.0.symbols 00:01:32.189 [684/745] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:32.189 [685/745] Linking target lib/librte_table.so.23.0 00:01:32.189 [686/745] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:32.189 [687/745] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:32.189 [688/745] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:32.189 [689/745] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:32.189 [690/745] Generating symbol file lib/librte_table.so.23.0.p/librte_table.so.23.0.symbols 00:01:32.189 [691/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:32.447 [692/745] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:32.447 [693/745] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:32.705 [694/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:32.705 [695/745] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:32.705 [696/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:32.963 [697/745] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:32.963 [698/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:33.221 [699/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:33.479 [700/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:01:33.479 [701/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:33.479 [702/745] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:33.737 [703/745] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:01:33.737 [704/745] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:01:33.995 [705/745] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:33.995 [706/745] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:33.995 [707/745] Compiling C object drivers/librte_net_i40e.so.23.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:33.995 [708/745] Linking static target drivers/librte_net_i40e.a 00:01:34.253 [709/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:01:34.253 [710/745] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:01:34.510 [711/745] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.767 [712/745] Linking target drivers/librte_net_i40e.so.23.0 00:01:35.333 [713/745] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:01:35.333 [714/745] Linking static target lib/librte_node.a 00:01:35.591 [715/745] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.592 [716/745] Linking target lib/librte_node.so.23.0 00:01:35.592 [717/745] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:01:36.524 [718/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:01:37.090 [719/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:01:45.201 [720/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:11.734 [721/745] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:11.734 [722/745] Linking static target lib/librte_vhost.a 00:02:12.301 [723/745] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:12.301 [724/745] Linking target lib/librte_vhost.so.23.0 00:02:27.176 [725/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:27.176 [726/745] Linking static target lib/librte_pipeline.a 00:02:27.176 [727/745] Linking target app/dpdk-dumpcap 00:02:27.176 [728/745] Linking target app/dpdk-test-regex 00:02:27.176 [729/745] Linking target app/dpdk-test-fib 00:02:27.176 [730/745] Linking target app/dpdk-test-gpudev 00:02:27.176 [731/745] Linking target app/dpdk-test-security-perf 00:02:27.176 [732/745] Linking target app/dpdk-test-bbdev 00:02:27.176 [733/745] Linking target app/dpdk-test-cmdline 00:02:27.176 [734/745] Linking target app/dpdk-test-compress-perf 00:02:27.176 [735/745] Linking target app/dpdk-test-pipeline 00:02:27.176 [736/745] Linking target app/dpdk-test-sad 00:02:27.176 [737/745] Linking target app/dpdk-test-acl 00:02:27.176 [738/745] Linking target app/dpdk-test-flow-perf 00:02:27.176 [739/745] Linking target app/dpdk-test-eventdev 00:02:27.176 [740/745] Linking target app/dpdk-pdump 00:02:27.176 [741/745] Linking target app/dpdk-proc-info 00:02:27.176 [742/745] Linking target app/dpdk-test-crypto-perf 00:02:27.176 [743/745] Linking target app/dpdk-testpmd 00:02:27.741 [744/745] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:27.741 [745/745] Linking target lib/librte_pipeline.so.23.0 00:02:27.741 04:14:06 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:27.741 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:27.999 [0/1] Installing files. 00:02:28.263 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.263 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/flow_classify.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/ipv4_rules_file.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:28.264 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:28.265 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:28.266 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.267 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/kni.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:28.268 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.269 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:28.270 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:28.270 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.270 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.271 Installing lib/librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing lib/librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing lib/librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing lib/librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing lib/librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing drivers/librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:28.841 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing drivers/librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:28.841 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing drivers/librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:28.841 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:28.841 Installing drivers/librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:28.841 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.841 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.842 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.843 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_empty_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_intel_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.844 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:28.845 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:28.845 Installing symlink pointing to librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.23 00:02:28.845 Installing symlink pointing to librte_kvargs.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:28.845 Installing symlink pointing to librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.23 00:02:28.845 Installing symlink pointing to librte_telemetry.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:28.845 Installing symlink pointing to librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.23 00:02:28.845 Installing symlink pointing to librte_eal.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:28.845 Installing symlink pointing to librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.23 00:02:28.845 Installing symlink pointing to librte_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:28.845 Installing symlink pointing to librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.23 00:02:28.845 Installing symlink pointing to librte_rcu.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:28.845 Installing symlink pointing to librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.23 00:02:28.845 Installing symlink pointing to librte_mempool.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:28.845 Installing symlink pointing to librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.23 00:02:28.845 Installing symlink pointing to librte_mbuf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:28.845 Installing symlink pointing to librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.23 00:02:28.845 Installing symlink pointing to librte_net.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:28.845 Installing symlink pointing to librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.23 00:02:28.845 Installing symlink pointing to librte_meter.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:28.845 Installing symlink pointing to librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.23 00:02:28.845 Installing symlink pointing to librte_ethdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:28.845 Installing symlink pointing to librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.23 00:02:28.845 Installing symlink pointing to librte_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:28.845 Installing symlink pointing to librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.23 00:02:28.845 Installing symlink pointing to librte_cmdline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:28.845 Installing symlink pointing to librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.23 00:02:28.845 Installing symlink pointing to librte_metrics.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:28.845 Installing symlink pointing to librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.23 00:02:28.845 Installing symlink pointing to librte_hash.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:28.845 Installing symlink pointing to librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.23 00:02:28.845 Installing symlink pointing to librte_timer.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:28.845 Installing symlink pointing to librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.23 00:02:28.845 Installing symlink pointing to librte_acl.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:28.845 Installing symlink pointing to librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.23 00:02:28.845 Installing symlink pointing to librte_bbdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:28.845 Installing symlink pointing to librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.23 00:02:28.845 Installing symlink pointing to librte_bitratestats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:28.845 Installing symlink pointing to librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.23 00:02:28.845 Installing symlink pointing to librte_bpf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:28.845 Installing symlink pointing to librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.23 00:02:28.846 Installing symlink pointing to librte_cfgfile.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:28.846 Installing symlink pointing to librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.23 00:02:28.846 Installing symlink pointing to librte_compressdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:28.846 Installing symlink pointing to librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.23 00:02:28.846 Installing symlink pointing to librte_cryptodev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:28.846 Installing symlink pointing to librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.23 00:02:28.846 Installing symlink pointing to librte_distributor.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:28.846 Installing symlink pointing to librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.23 00:02:28.846 Installing symlink pointing to librte_efd.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:28.846 Installing symlink pointing to librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.23 00:02:28.846 Installing symlink pointing to librte_eventdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:28.846 Installing symlink pointing to librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.23 00:02:28.846 Installing symlink pointing to librte_gpudev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:28.846 Installing symlink pointing to librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.23 00:02:28.846 Installing symlink pointing to librte_gro.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:28.846 Installing symlink pointing to librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.23 00:02:28.846 Installing symlink pointing to librte_gso.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:28.846 Installing symlink pointing to librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.23 00:02:28.846 Installing symlink pointing to librte_ip_frag.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:28.846 Installing symlink pointing to librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.23 00:02:28.846 Installing symlink pointing to librte_jobstats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:28.846 Installing symlink pointing to librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.23 00:02:28.846 Installing symlink pointing to librte_latencystats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:28.846 Installing symlink pointing to librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.23 00:02:28.846 Installing symlink pointing to librte_lpm.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:28.846 Installing symlink pointing to librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.23 00:02:28.846 Installing symlink pointing to librte_member.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:28.846 Installing symlink pointing to librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.23 00:02:28.846 Installing symlink pointing to librte_pcapng.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:28.846 Installing symlink pointing to librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.23 00:02:28.846 Installing symlink pointing to librte_power.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:28.846 Installing symlink pointing to librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.23 00:02:28.846 Installing symlink pointing to librte_rawdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:28.846 Installing symlink pointing to librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.23 00:02:28.846 Installing symlink pointing to librte_regexdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:28.846 Installing symlink pointing to librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.23 00:02:28.846 Installing symlink pointing to librte_dmadev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:28.846 Installing symlink pointing to librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.23 00:02:28.846 Installing symlink pointing to librte_rib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:28.846 Installing symlink pointing to librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.23 00:02:28.846 Installing symlink pointing to librte_reorder.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:28.846 Installing symlink pointing to librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.23 00:02:28.846 Installing symlink pointing to librte_sched.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:28.846 Installing symlink pointing to librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.23 00:02:28.846 Installing symlink pointing to librte_security.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:28.846 Installing symlink pointing to librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.23 00:02:28.846 Installing symlink pointing to librte_stack.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:28.846 Installing symlink pointing to librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.23 00:02:28.846 Installing symlink pointing to librte_vhost.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:28.846 Installing symlink pointing to librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.23 00:02:28.846 Installing symlink pointing to librte_ipsec.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:28.846 Installing symlink pointing to librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.23 00:02:28.846 Installing symlink pointing to librte_fib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:28.846 Installing symlink pointing to librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.23 00:02:28.846 Installing symlink pointing to librte_port.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:28.846 Installing symlink pointing to librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.23 00:02:28.846 Installing symlink pointing to librte_pdump.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:28.846 Installing symlink pointing to librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.23 00:02:28.846 Installing symlink pointing to librte_table.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:28.846 Installing symlink pointing to librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.23 00:02:28.846 Installing symlink pointing to librte_pipeline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:28.846 Installing symlink pointing to librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.23 00:02:28.846 Installing symlink pointing to librte_graph.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:28.846 Installing symlink pointing to librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.23 00:02:28.846 Installing symlink pointing to librte_node.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:28.846 Installing symlink pointing to librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23 00:02:28.846 Installing symlink pointing to librte_bus_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:02:28.846 Installing symlink pointing to librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23 00:02:28.846 Installing symlink pointing to librte_bus_vdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:02:28.846 './librte_bus_pci.so' -> 'dpdk/pmds-23.0/librte_bus_pci.so' 00:02:28.846 './librte_bus_pci.so.23' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23' 00:02:28.846 './librte_bus_pci.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23.0' 00:02:28.846 './librte_bus_vdev.so' -> 'dpdk/pmds-23.0/librte_bus_vdev.so' 00:02:28.846 './librte_bus_vdev.so.23' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23' 00:02:28.846 './librte_bus_vdev.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23.0' 00:02:28.846 './librte_mempool_ring.so' -> 'dpdk/pmds-23.0/librte_mempool_ring.so' 00:02:28.846 './librte_mempool_ring.so.23' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23' 00:02:28.847 './librte_mempool_ring.so.23.0' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23.0' 00:02:28.847 './librte_net_i40e.so' -> 'dpdk/pmds-23.0/librte_net_i40e.so' 00:02:28.847 './librte_net_i40e.so.23' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23' 00:02:28.847 './librte_net_i40e.so.23.0' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23.0' 00:02:28.847 Installing symlink pointing to librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23 00:02:28.847 Installing symlink pointing to librte_mempool_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:02:28.847 Installing symlink pointing to librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23 00:02:28.847 Installing symlink pointing to librte_net_i40e.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:02:28.847 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-23.0' 00:02:28.847 04:14:07 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:28.847 04:14:08 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:28.847 04:14:08 -- common/autobuild_common.sh@203 -- $ cat 00:02:28.847 04:14:08 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:28.847 00:02:28.847 real 1m20.121s 00:02:28.847 user 14m20.539s 00:02:28.847 sys 1m50.122s 00:02:28.847 04:14:08 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:28.847 04:14:08 -- common/autotest_common.sh@10 -- $ set +x 00:02:28.847 ************************************ 00:02:28.847 END TEST build_native_dpdk 00:02:28.847 ************************************ 00:02:28.847 04:14:08 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:28.847 04:14:08 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:28.847 04:14:08 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:28.847 04:14:08 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:28.847 04:14:08 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:28.847 04:14:08 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:28.847 04:14:08 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:28.847 04:14:08 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:29.104 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:29.104 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:29.104 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:29.104 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:29.362 Using 'verbs' RDMA provider 00:02:39.958 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:02:48.070 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:02:48.328 Creating mk/config.mk...done. 00:02:48.328 Creating mk/cc.flags.mk...done. 00:02:48.328 Type 'make' to build. 00:02:48.328 04:14:27 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:02:48.328 04:14:27 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:02:48.328 04:14:27 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:02:48.328 04:14:27 -- common/autotest_common.sh@10 -- $ set +x 00:02:48.328 ************************************ 00:02:48.328 START TEST make 00:02:48.328 ************************************ 00:02:48.328 04:14:27 -- common/autotest_common.sh@1114 -- $ make -j48 00:02:48.587 make[1]: Nothing to be done for 'all'. 00:02:50.507 The Meson build system 00:02:50.507 Version: 1.5.0 00:02:50.507 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:02:50.507 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:50.507 Build type: native build 00:02:50.507 Project name: libvfio-user 00:02:50.507 Project version: 0.0.1 00:02:50.507 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:02:50.507 C linker for the host machine: gcc ld.bfd 2.40-14 00:02:50.507 Host machine cpu family: x86_64 00:02:50.507 Host machine cpu: x86_64 00:02:50.507 Run-time dependency threads found: YES 00:02:50.507 Library dl found: YES 00:02:50.507 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:02:50.507 Run-time dependency json-c found: YES 0.17 00:02:50.507 Run-time dependency cmocka found: YES 1.1.7 00:02:50.507 Program pytest-3 found: NO 00:02:50.507 Program flake8 found: NO 00:02:50.507 Program misspell-fixer found: NO 00:02:50.508 Program restructuredtext-lint found: NO 00:02:50.508 Program valgrind found: YES (/usr/bin/valgrind) 00:02:50.508 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:02:50.508 Compiler for C supports arguments -Wmissing-declarations: YES 00:02:50.508 Compiler for C supports arguments -Wwrite-strings: YES 00:02:50.508 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:02:50.508 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:02:50.508 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:02:50.508 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:02:50.508 Build targets in project: 8 00:02:50.508 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:02:50.508 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:02:50.508 00:02:50.508 libvfio-user 0.0.1 00:02:50.508 00:02:50.508 User defined options 00:02:50.508 buildtype : debug 00:02:50.508 default_library: shared 00:02:50.508 libdir : /usr/local/lib 00:02:50.508 00:02:50.508 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:02:51.087 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:02:51.087 [1/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:02:51.087 [2/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:02:51.087 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:02:51.345 [4/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:02:51.345 [5/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:02:51.345 [6/37] Compiling C object samples/null.p/null.c.o 00:02:51.345 [7/37] Compiling C object samples/lspci.p/lspci.c.o 00:02:51.345 [8/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:02:51.345 [9/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:02:51.345 [10/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:02:51.345 [11/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:02:51.345 [12/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:02:51.345 [13/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:02:51.345 [14/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:02:51.345 [15/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:02:51.345 [16/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:02:51.345 [17/37] Compiling C object samples/server.p/server.c.o 00:02:51.345 [18/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:02:51.345 [19/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:02:51.345 [20/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:02:51.345 [21/37] Compiling C object test/unit_tests.p/mocks.c.o 00:02:51.345 [22/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:02:51.345 [23/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:02:51.345 [24/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:02:51.345 [25/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:02:51.345 [26/37] Compiling C object samples/client.p/client.c.o 00:02:51.345 [27/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:02:51.613 [28/37] Linking target samples/client 00:02:51.613 [29/37] Linking target lib/libvfio-user.so.0.0.1 00:02:51.613 [30/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:02:51.613 [31/37] Linking target test/unit_tests 00:02:51.613 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:02:51.876 [33/37] Linking target samples/server 00:02:51.876 [34/37] Linking target samples/lspci 00:02:51.876 [35/37] Linking target samples/null 00:02:51.876 [36/37] Linking target samples/shadow_ioeventfd_server 00:02:51.876 [37/37] Linking target samples/gpio-pci-idio-16 00:02:51.876 INFO: autodetecting backend as ninja 00:02:51.876 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:51.876 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:52.819 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:02:52.819 ninja: no work to do. 00:03:05.021 CC lib/log/log.o 00:03:05.021 CC lib/log/log_flags.o 00:03:05.021 CC lib/log/log_deprecated.o 00:03:05.021 CC lib/ut_mock/mock.o 00:03:05.021 CC lib/ut/ut.o 00:03:05.021 LIB libspdk_ut_mock.a 00:03:05.021 SO libspdk_ut_mock.so.5.0 00:03:05.021 LIB libspdk_ut.a 00:03:05.021 LIB libspdk_log.a 00:03:05.021 SO libspdk_ut.so.1.0 00:03:05.021 SO libspdk_log.so.6.1 00:03:05.021 SYMLINK libspdk_ut_mock.so 00:03:05.021 SYMLINK libspdk_ut.so 00:03:05.021 SYMLINK libspdk_log.so 00:03:05.021 CXX lib/trace_parser/trace.o 00:03:05.021 CC lib/util/base64.o 00:03:05.021 CC lib/util/bit_array.o 00:03:05.021 CC lib/util/cpuset.o 00:03:05.021 CC lib/dma/dma.o 00:03:05.021 CC lib/util/crc16.o 00:03:05.021 CC lib/ioat/ioat.o 00:03:05.021 CC lib/util/crc32.o 00:03:05.021 CC lib/util/crc32c.o 00:03:05.021 CC lib/util/crc32_ieee.o 00:03:05.021 CC lib/util/crc64.o 00:03:05.021 CC lib/util/dif.o 00:03:05.021 CC lib/util/fd.o 00:03:05.021 CC lib/util/file.o 00:03:05.021 CC lib/util/hexlify.o 00:03:05.021 CC lib/util/iov.o 00:03:05.021 CC lib/util/math.o 00:03:05.021 CC lib/util/pipe.o 00:03:05.021 CC lib/util/strerror_tls.o 00:03:05.021 CC lib/util/uuid.o 00:03:05.021 CC lib/util/string.o 00:03:05.021 CC lib/util/fd_group.o 00:03:05.021 CC lib/util/xor.o 00:03:05.021 CC lib/util/zipf.o 00:03:05.021 CC lib/vfio_user/host/vfio_user_pci.o 00:03:05.021 CC lib/vfio_user/host/vfio_user.o 00:03:05.021 LIB libspdk_dma.a 00:03:05.021 SO libspdk_dma.so.3.0 00:03:05.021 SYMLINK libspdk_dma.so 00:03:05.021 LIB libspdk_ioat.a 00:03:05.021 SO libspdk_ioat.so.6.0 00:03:05.021 LIB libspdk_vfio_user.a 00:03:05.021 SO libspdk_vfio_user.so.4.0 00:03:05.021 SYMLINK libspdk_ioat.so 00:03:05.021 SYMLINK libspdk_vfio_user.so 00:03:05.021 LIB libspdk_util.a 00:03:05.021 SO libspdk_util.so.8.0 00:03:05.021 SYMLINK libspdk_util.so 00:03:05.021 CC lib/env_dpdk/env.o 00:03:05.021 CC lib/rdma/common.o 00:03:05.021 CC lib/vmd/vmd.o 00:03:05.021 CC lib/conf/conf.o 00:03:05.021 CC lib/env_dpdk/memory.o 00:03:05.021 CC lib/rdma/rdma_verbs.o 00:03:05.021 CC lib/json/json_parse.o 00:03:05.021 CC lib/idxd/idxd.o 00:03:05.021 CC lib/json/json_util.o 00:03:05.021 CC lib/vmd/led.o 00:03:05.021 CC lib/env_dpdk/pci.o 00:03:05.021 CC lib/idxd/idxd_user.o 00:03:05.021 CC lib/json/json_write.o 00:03:05.021 CC lib/env_dpdk/init.o 00:03:05.021 CC lib/env_dpdk/threads.o 00:03:05.021 CC lib/idxd/idxd_kernel.o 00:03:05.021 CC lib/env_dpdk/pci_ioat.o 00:03:05.021 CC lib/env_dpdk/pci_virtio.o 00:03:05.021 CC lib/env_dpdk/pci_vmd.o 00:03:05.021 CC lib/env_dpdk/pci_idxd.o 00:03:05.021 CC lib/env_dpdk/pci_event.o 00:03:05.021 CC lib/env_dpdk/sigbus_handler.o 00:03:05.021 CC lib/env_dpdk/pci_dpdk.o 00:03:05.021 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:05.021 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:05.021 LIB libspdk_trace_parser.a 00:03:05.021 SO libspdk_trace_parser.so.4.0 00:03:05.021 LIB libspdk_conf.a 00:03:05.021 SYMLINK libspdk_trace_parser.so 00:03:05.021 SO libspdk_conf.so.5.0 00:03:05.021 LIB libspdk_rdma.a 00:03:05.021 SYMLINK libspdk_conf.so 00:03:05.021 LIB libspdk_json.a 00:03:05.021 SO libspdk_rdma.so.5.0 00:03:05.021 SO libspdk_json.so.5.1 00:03:05.021 SYMLINK libspdk_rdma.so 00:03:05.021 SYMLINK libspdk_json.so 00:03:05.021 CC lib/jsonrpc/jsonrpc_server.o 00:03:05.021 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:05.021 CC lib/jsonrpc/jsonrpc_client.o 00:03:05.021 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:05.021 LIB libspdk_idxd.a 00:03:05.021 SO libspdk_idxd.so.11.0 00:03:05.280 SYMLINK libspdk_idxd.so 00:03:05.280 LIB libspdk_vmd.a 00:03:05.280 LIB libspdk_jsonrpc.a 00:03:05.280 SO libspdk_vmd.so.5.0 00:03:05.280 SO libspdk_jsonrpc.so.5.1 00:03:05.280 SYMLINK libspdk_vmd.so 00:03:05.280 SYMLINK libspdk_jsonrpc.so 00:03:05.539 CC lib/rpc/rpc.o 00:03:05.797 LIB libspdk_rpc.a 00:03:05.797 SO libspdk_rpc.so.5.0 00:03:05.797 SYMLINK libspdk_rpc.so 00:03:05.797 CC lib/sock/sock.o 00:03:05.797 CC lib/sock/sock_rpc.o 00:03:05.797 CC lib/notify/notify.o 00:03:05.797 CC lib/trace/trace.o 00:03:05.797 CC lib/notify/notify_rpc.o 00:03:05.797 CC lib/trace/trace_flags.o 00:03:05.797 CC lib/trace/trace_rpc.o 00:03:06.060 LIB libspdk_notify.a 00:03:06.061 SO libspdk_notify.so.5.0 00:03:06.061 SYMLINK libspdk_notify.so 00:03:06.061 LIB libspdk_trace.a 00:03:06.061 SO libspdk_trace.so.9.0 00:03:06.061 SYMLINK libspdk_trace.so 00:03:06.320 LIB libspdk_sock.a 00:03:06.320 SO libspdk_sock.so.8.0 00:03:06.320 CC lib/thread/thread.o 00:03:06.320 CC lib/thread/iobuf.o 00:03:06.320 SYMLINK libspdk_sock.so 00:03:06.320 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:06.320 CC lib/nvme/nvme_ctrlr.o 00:03:06.320 CC lib/nvme/nvme_fabric.o 00:03:06.320 CC lib/nvme/nvme_ns_cmd.o 00:03:06.320 CC lib/nvme/nvme_ns.o 00:03:06.320 CC lib/nvme/nvme_pcie_common.o 00:03:06.320 CC lib/nvme/nvme_pcie.o 00:03:06.320 CC lib/nvme/nvme_qpair.o 00:03:06.320 CC lib/nvme/nvme.o 00:03:06.320 CC lib/nvme/nvme_quirks.o 00:03:06.320 CC lib/nvme/nvme_transport.o 00:03:06.320 CC lib/nvme/nvme_discovery.o 00:03:06.320 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:06.320 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:06.320 CC lib/nvme/nvme_tcp.o 00:03:06.320 CC lib/nvme/nvme_opal.o 00:03:06.320 CC lib/nvme/nvme_io_msg.o 00:03:06.320 CC lib/nvme/nvme_poll_group.o 00:03:06.320 CC lib/nvme/nvme_zns.o 00:03:06.320 CC lib/nvme/nvme_cuse.o 00:03:06.320 CC lib/nvme/nvme_vfio_user.o 00:03:06.320 CC lib/nvme/nvme_rdma.o 00:03:06.578 LIB libspdk_env_dpdk.a 00:03:06.578 SO libspdk_env_dpdk.so.13.0 00:03:06.837 SYMLINK libspdk_env_dpdk.so 00:03:08.213 LIB libspdk_thread.a 00:03:08.213 SO libspdk_thread.so.9.0 00:03:08.213 SYMLINK libspdk_thread.so 00:03:08.213 CC lib/virtio/virtio.o 00:03:08.213 CC lib/init/json_config.o 00:03:08.213 CC lib/blob/blobstore.o 00:03:08.213 CC lib/virtio/virtio_vhost_user.o 00:03:08.213 CC lib/init/subsystem.o 00:03:08.213 CC lib/blob/request.o 00:03:08.213 CC lib/accel/accel.o 00:03:08.213 CC lib/virtio/virtio_vfio_user.o 00:03:08.213 CC lib/init/subsystem_rpc.o 00:03:08.213 CC lib/blob/zeroes.o 00:03:08.213 CC lib/virtio/virtio_pci.o 00:03:08.213 CC lib/accel/accel_rpc.o 00:03:08.213 CC lib/blob/blob_bs_dev.o 00:03:08.213 CC lib/init/rpc.o 00:03:08.213 CC lib/accel/accel_sw.o 00:03:08.213 CC lib/vfu_tgt/tgt_endpoint.o 00:03:08.213 CC lib/vfu_tgt/tgt_rpc.o 00:03:08.472 LIB libspdk_init.a 00:03:08.472 SO libspdk_init.so.4.0 00:03:08.472 SYMLINK libspdk_init.so 00:03:08.472 LIB libspdk_virtio.a 00:03:08.472 LIB libspdk_vfu_tgt.a 00:03:08.472 SO libspdk_virtio.so.6.0 00:03:08.472 SO libspdk_vfu_tgt.so.2.0 00:03:08.472 SYMLINK libspdk_vfu_tgt.so 00:03:08.472 SYMLINK libspdk_virtio.so 00:03:08.472 CC lib/event/app.o 00:03:08.472 CC lib/event/reactor.o 00:03:08.472 CC lib/event/log_rpc.o 00:03:08.472 CC lib/event/app_rpc.o 00:03:08.472 CC lib/event/scheduler_static.o 00:03:08.731 LIB libspdk_nvme.a 00:03:08.991 SO libspdk_nvme.so.12.0 00:03:08.991 LIB libspdk_event.a 00:03:08.991 SO libspdk_event.so.12.0 00:03:08.991 SYMLINK libspdk_event.so 00:03:08.991 SYMLINK libspdk_nvme.so 00:03:09.249 LIB libspdk_accel.a 00:03:09.249 SO libspdk_accel.so.14.0 00:03:09.249 SYMLINK libspdk_accel.so 00:03:09.249 CC lib/bdev/bdev.o 00:03:09.249 CC lib/bdev/bdev_rpc.o 00:03:09.249 CC lib/bdev/bdev_zone.o 00:03:09.249 CC lib/bdev/part.o 00:03:09.249 CC lib/bdev/scsi_nvme.o 00:03:11.163 LIB libspdk_blob.a 00:03:11.163 SO libspdk_blob.so.10.1 00:03:11.163 SYMLINK libspdk_blob.so 00:03:11.163 CC lib/blobfs/blobfs.o 00:03:11.163 CC lib/blobfs/tree.o 00:03:11.163 CC lib/lvol/lvol.o 00:03:11.730 LIB libspdk_bdev.a 00:03:11.994 LIB libspdk_blobfs.a 00:03:11.994 SO libspdk_bdev.so.14.0 00:03:11.994 SO libspdk_blobfs.so.9.0 00:03:11.994 SYMLINK libspdk_blobfs.so 00:03:11.994 SYMLINK libspdk_bdev.so 00:03:11.994 LIB libspdk_lvol.a 00:03:11.994 SO libspdk_lvol.so.9.1 00:03:11.994 SYMLINK libspdk_lvol.so 00:03:11.994 CC lib/nvmf/ctrlr.o 00:03:11.994 CC lib/scsi/dev.o 00:03:11.994 CC lib/ublk/ublk.o 00:03:11.994 CC lib/nbd/nbd.o 00:03:11.994 CC lib/scsi/lun.o 00:03:11.994 CC lib/nvmf/ctrlr_discovery.o 00:03:11.994 CC lib/ublk/ublk_rpc.o 00:03:11.994 CC lib/nbd/nbd_rpc.o 00:03:11.994 CC lib/nvmf/ctrlr_bdev.o 00:03:11.994 CC lib/scsi/port.o 00:03:11.994 CC lib/nvmf/subsystem.o 00:03:11.994 CC lib/ftl/ftl_core.o 00:03:11.994 CC lib/scsi/scsi.o 00:03:11.994 CC lib/ftl/ftl_init.o 00:03:11.994 CC lib/scsi/scsi_bdev.o 00:03:11.994 CC lib/nvmf/nvmf.o 00:03:11.994 CC lib/ftl/ftl_layout.o 00:03:11.994 CC lib/scsi/scsi_pr.o 00:03:11.994 CC lib/nvmf/nvmf_rpc.o 00:03:11.994 CC lib/scsi/scsi_rpc.o 00:03:11.994 CC lib/nvmf/transport.o 00:03:11.994 CC lib/ftl/ftl_debug.o 00:03:11.994 CC lib/ftl/ftl_io.o 00:03:11.994 CC lib/scsi/task.o 00:03:11.994 CC lib/nvmf/tcp.o 00:03:11.994 CC lib/nvmf/vfio_user.o 00:03:11.994 CC lib/nvmf/rdma.o 00:03:11.994 CC lib/ftl/ftl_l2p.o 00:03:11.994 CC lib/ftl/ftl_sb.o 00:03:11.994 CC lib/ftl/ftl_l2p_flat.o 00:03:11.994 CC lib/ftl/ftl_nv_cache.o 00:03:11.994 CC lib/ftl/ftl_band.o 00:03:11.994 CC lib/ftl/ftl_band_ops.o 00:03:11.994 CC lib/ftl/ftl_rq.o 00:03:11.994 CC lib/ftl/ftl_writer.o 00:03:11.994 CC lib/ftl/ftl_reloc.o 00:03:11.994 CC lib/ftl/ftl_l2p_cache.o 00:03:11.994 CC lib/ftl/ftl_p2l.o 00:03:11.994 CC lib/ftl/mngt/ftl_mngt.o 00:03:11.994 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:11.994 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:11.994 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:11.994 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:11.994 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:11.994 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:11.994 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:11.994 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:11.994 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:12.570 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:12.570 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:12.570 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:12.570 CC lib/ftl/utils/ftl_conf.o 00:03:12.570 CC lib/ftl/utils/ftl_md.o 00:03:12.570 CC lib/ftl/utils/ftl_mempool.o 00:03:12.570 CC lib/ftl/utils/ftl_bitmap.o 00:03:12.570 CC lib/ftl/utils/ftl_property.o 00:03:12.570 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:12.570 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:12.570 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:12.570 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:12.570 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:12.570 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:12.570 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:12.570 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:12.570 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:12.570 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:12.570 CC lib/ftl/base/ftl_base_dev.o 00:03:12.570 CC lib/ftl/base/ftl_base_bdev.o 00:03:12.570 CC lib/ftl/ftl_trace.o 00:03:12.830 LIB libspdk_nbd.a 00:03:12.830 SO libspdk_nbd.so.6.0 00:03:12.830 LIB libspdk_scsi.a 00:03:12.830 SYMLINK libspdk_nbd.so 00:03:13.089 SO libspdk_scsi.so.8.0 00:03:13.089 SYMLINK libspdk_scsi.so 00:03:13.089 LIB libspdk_ublk.a 00:03:13.089 SO libspdk_ublk.so.2.0 00:03:13.089 SYMLINK libspdk_ublk.so 00:03:13.089 CC lib/vhost/vhost.o 00:03:13.089 CC lib/iscsi/conn.o 00:03:13.089 CC lib/vhost/vhost_rpc.o 00:03:13.089 CC lib/iscsi/init_grp.o 00:03:13.089 CC lib/iscsi/iscsi.o 00:03:13.089 CC lib/vhost/vhost_scsi.o 00:03:13.089 CC lib/iscsi/md5.o 00:03:13.089 CC lib/vhost/vhost_blk.o 00:03:13.089 CC lib/iscsi/param.o 00:03:13.089 CC lib/vhost/rte_vhost_user.o 00:03:13.089 CC lib/iscsi/portal_grp.o 00:03:13.089 CC lib/iscsi/tgt_node.o 00:03:13.089 CC lib/iscsi/iscsi_rpc.o 00:03:13.089 CC lib/iscsi/iscsi_subsystem.o 00:03:13.089 CC lib/iscsi/task.o 00:03:13.347 LIB libspdk_ftl.a 00:03:13.606 SO libspdk_ftl.so.8.0 00:03:13.864 SYMLINK libspdk_ftl.so 00:03:14.431 LIB libspdk_vhost.a 00:03:14.431 SO libspdk_vhost.so.7.1 00:03:14.431 SYMLINK libspdk_vhost.so 00:03:14.690 LIB libspdk_nvmf.a 00:03:14.690 LIB libspdk_iscsi.a 00:03:14.690 SO libspdk_nvmf.so.17.0 00:03:14.690 SO libspdk_iscsi.so.7.0 00:03:14.690 SYMLINK libspdk_iscsi.so 00:03:14.948 SYMLINK libspdk_nvmf.so 00:03:14.948 CC module/vfu_device/vfu_virtio.o 00:03:14.948 CC module/vfu_device/vfu_virtio_blk.o 00:03:14.948 CC module/vfu_device/vfu_virtio_scsi.o 00:03:14.948 CC module/env_dpdk/env_dpdk_rpc.o 00:03:14.948 CC module/vfu_device/vfu_virtio_rpc.o 00:03:14.948 CC module/blob/bdev/blob_bdev.o 00:03:14.948 CC module/sock/posix/posix.o 00:03:14.948 CC module/accel/error/accel_error.o 00:03:14.948 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:14.948 CC module/accel/iaa/accel_iaa.o 00:03:14.948 CC module/accel/dsa/accel_dsa.o 00:03:14.948 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:14.948 CC module/scheduler/gscheduler/gscheduler.o 00:03:14.948 CC module/accel/iaa/accel_iaa_rpc.o 00:03:14.948 CC module/accel/dsa/accel_dsa_rpc.o 00:03:14.948 CC module/accel/error/accel_error_rpc.o 00:03:14.948 CC module/accel/ioat/accel_ioat.o 00:03:14.948 CC module/accel/ioat/accel_ioat_rpc.o 00:03:15.206 LIB libspdk_env_dpdk_rpc.a 00:03:15.206 SO libspdk_env_dpdk_rpc.so.5.0 00:03:15.206 SYMLINK libspdk_env_dpdk_rpc.so 00:03:15.206 LIB libspdk_scheduler_gscheduler.a 00:03:15.206 LIB libspdk_scheduler_dpdk_governor.a 00:03:15.206 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:15.206 SO libspdk_scheduler_gscheduler.so.3.0 00:03:15.206 LIB libspdk_accel_error.a 00:03:15.206 LIB libspdk_accel_ioat.a 00:03:15.206 LIB libspdk_scheduler_dynamic.a 00:03:15.206 LIB libspdk_accel_iaa.a 00:03:15.206 SO libspdk_accel_error.so.1.0 00:03:15.206 SO libspdk_accel_ioat.so.5.0 00:03:15.206 SYMLINK libspdk_scheduler_gscheduler.so 00:03:15.206 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:15.206 SO libspdk_scheduler_dynamic.so.3.0 00:03:15.206 SO libspdk_accel_iaa.so.2.0 00:03:15.206 LIB libspdk_accel_dsa.a 00:03:15.465 SYMLINK libspdk_accel_error.so 00:03:15.465 SYMLINK libspdk_accel_ioat.so 00:03:15.465 SYMLINK libspdk_scheduler_dynamic.so 00:03:15.465 SO libspdk_accel_dsa.so.4.0 00:03:15.465 LIB libspdk_blob_bdev.a 00:03:15.465 SYMLINK libspdk_accel_iaa.so 00:03:15.465 SO libspdk_blob_bdev.so.10.1 00:03:15.465 SYMLINK libspdk_accel_dsa.so 00:03:15.465 SYMLINK libspdk_blob_bdev.so 00:03:15.465 CC module/bdev/nvme/bdev_nvme.o 00:03:15.465 CC module/bdev/error/vbdev_error.o 00:03:15.465 CC module/bdev/raid/bdev_raid.o 00:03:15.465 CC module/bdev/delay/vbdev_delay.o 00:03:15.465 CC module/bdev/gpt/gpt.o 00:03:15.465 CC module/bdev/null/bdev_null.o 00:03:15.465 CC module/bdev/error/vbdev_error_rpc.o 00:03:15.465 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:15.465 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:15.465 CC module/bdev/raid/bdev_raid_sb.o 00:03:15.465 CC module/bdev/raid/bdev_raid_rpc.o 00:03:15.465 CC module/blobfs/bdev/blobfs_bdev.o 00:03:15.465 CC module/bdev/nvme/nvme_rpc.o 00:03:15.465 CC module/bdev/null/bdev_null_rpc.o 00:03:15.465 CC module/bdev/gpt/vbdev_gpt.o 00:03:15.465 CC module/bdev/malloc/bdev_malloc.o 00:03:15.465 CC module/bdev/raid/raid0.o 00:03:15.465 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:15.465 CC module/bdev/nvme/bdev_mdns_client.o 00:03:15.724 CC module/bdev/nvme/vbdev_opal.o 00:03:15.724 CC module/bdev/raid/raid1.o 00:03:15.724 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:15.724 CC module/bdev/raid/concat.o 00:03:15.724 CC module/bdev/iscsi/bdev_iscsi.o 00:03:15.724 CC module/bdev/lvol/vbdev_lvol.o 00:03:15.724 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:15.724 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:15.724 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:15.724 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:15.724 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:15.724 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:15.724 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:15.724 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:15.724 CC module/bdev/split/vbdev_split.o 00:03:15.724 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:15.724 CC module/bdev/passthru/vbdev_passthru.o 00:03:15.724 CC module/bdev/split/vbdev_split_rpc.o 00:03:15.724 CC module/bdev/ftl/bdev_ftl.o 00:03:15.724 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:15.724 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:15.724 CC module/bdev/aio/bdev_aio.o 00:03:15.724 CC module/bdev/aio/bdev_aio_rpc.o 00:03:15.724 LIB libspdk_vfu_device.a 00:03:15.724 SO libspdk_vfu_device.so.2.0 00:03:15.983 SYMLINK libspdk_vfu_device.so 00:03:15.983 LIB libspdk_bdev_error.a 00:03:15.983 SO libspdk_bdev_error.so.5.0 00:03:15.983 LIB libspdk_blobfs_bdev.a 00:03:15.983 LIB libspdk_sock_posix.a 00:03:15.983 SO libspdk_blobfs_bdev.so.5.0 00:03:15.983 SO libspdk_sock_posix.so.5.0 00:03:15.983 LIB libspdk_bdev_split.a 00:03:15.983 SYMLINK libspdk_bdev_error.so 00:03:15.983 SO libspdk_bdev_split.so.5.0 00:03:15.983 LIB libspdk_bdev_zone_block.a 00:03:15.983 SYMLINK libspdk_blobfs_bdev.so 00:03:15.983 LIB libspdk_bdev_ftl.a 00:03:15.983 LIB libspdk_bdev_null.a 00:03:15.983 SYMLINK libspdk_sock_posix.so 00:03:15.983 LIB libspdk_bdev_passthru.a 00:03:15.983 SO libspdk_bdev_zone_block.so.5.0 00:03:15.983 SO libspdk_bdev_null.so.5.0 00:03:15.983 SO libspdk_bdev_ftl.so.5.0 00:03:15.983 SYMLINK libspdk_bdev_split.so 00:03:16.241 SO libspdk_bdev_passthru.so.5.0 00:03:16.241 LIB libspdk_bdev_gpt.a 00:03:16.241 LIB libspdk_bdev_aio.a 00:03:16.241 SO libspdk_bdev_gpt.so.5.0 00:03:16.241 SO libspdk_bdev_aio.so.5.0 00:03:16.241 SYMLINK libspdk_bdev_zone_block.so 00:03:16.241 SYMLINK libspdk_bdev_null.so 00:03:16.241 SYMLINK libspdk_bdev_ftl.so 00:03:16.241 LIB libspdk_bdev_delay.a 00:03:16.241 SYMLINK libspdk_bdev_passthru.so 00:03:16.241 SO libspdk_bdev_delay.so.5.0 00:03:16.241 SYMLINK libspdk_bdev_aio.so 00:03:16.241 SYMLINK libspdk_bdev_gpt.so 00:03:16.241 LIB libspdk_bdev_iscsi.a 00:03:16.241 LIB libspdk_bdev_malloc.a 00:03:16.241 LIB libspdk_bdev_virtio.a 00:03:16.241 SO libspdk_bdev_iscsi.so.5.0 00:03:16.241 SYMLINK libspdk_bdev_delay.so 00:03:16.241 SO libspdk_bdev_malloc.so.5.0 00:03:16.241 SO libspdk_bdev_virtio.so.5.0 00:03:16.241 SYMLINK libspdk_bdev_iscsi.so 00:03:16.241 SYMLINK libspdk_bdev_malloc.so 00:03:16.241 SYMLINK libspdk_bdev_virtio.so 00:03:16.241 LIB libspdk_bdev_lvol.a 00:03:16.241 SO libspdk_bdev_lvol.so.5.0 00:03:16.500 SYMLINK libspdk_bdev_lvol.so 00:03:16.758 LIB libspdk_bdev_raid.a 00:03:16.758 SO libspdk_bdev_raid.so.5.0 00:03:16.758 SYMLINK libspdk_bdev_raid.so 00:03:18.130 LIB libspdk_bdev_nvme.a 00:03:18.130 SO libspdk_bdev_nvme.so.6.0 00:03:18.130 SYMLINK libspdk_bdev_nvme.so 00:03:18.388 CC module/event/subsystems/sock/sock.o 00:03:18.388 CC module/event/subsystems/iobuf/iobuf.o 00:03:18.388 CC module/event/subsystems/scheduler/scheduler.o 00:03:18.388 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:18.388 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:18.388 CC module/event/subsystems/vmd/vmd.o 00:03:18.388 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:18.388 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:18.388 LIB libspdk_event_sock.a 00:03:18.388 LIB libspdk_event_vhost_blk.a 00:03:18.388 LIB libspdk_event_scheduler.a 00:03:18.388 LIB libspdk_event_vfu_tgt.a 00:03:18.388 LIB libspdk_event_vmd.a 00:03:18.388 SO libspdk_event_sock.so.4.0 00:03:18.388 SO libspdk_event_vhost_blk.so.2.0 00:03:18.388 LIB libspdk_event_iobuf.a 00:03:18.388 SO libspdk_event_scheduler.so.3.0 00:03:18.388 SO libspdk_event_vfu_tgt.so.2.0 00:03:18.388 SO libspdk_event_vmd.so.5.0 00:03:18.388 SO libspdk_event_iobuf.so.2.0 00:03:18.647 SYMLINK libspdk_event_sock.so 00:03:18.647 SYMLINK libspdk_event_vhost_blk.so 00:03:18.647 SYMLINK libspdk_event_scheduler.so 00:03:18.647 SYMLINK libspdk_event_vfu_tgt.so 00:03:18.647 SYMLINK libspdk_event_vmd.so 00:03:18.647 SYMLINK libspdk_event_iobuf.so 00:03:18.647 CC module/event/subsystems/accel/accel.o 00:03:18.906 LIB libspdk_event_accel.a 00:03:18.906 SO libspdk_event_accel.so.5.0 00:03:18.906 SYMLINK libspdk_event_accel.so 00:03:18.906 CC module/event/subsystems/bdev/bdev.o 00:03:19.164 LIB libspdk_event_bdev.a 00:03:19.164 SO libspdk_event_bdev.so.5.0 00:03:19.164 SYMLINK libspdk_event_bdev.so 00:03:19.422 CC module/event/subsystems/nbd/nbd.o 00:03:19.422 CC module/event/subsystems/scsi/scsi.o 00:03:19.422 CC module/event/subsystems/ublk/ublk.o 00:03:19.422 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:19.422 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:19.422 LIB libspdk_event_ublk.a 00:03:19.422 LIB libspdk_event_scsi.a 00:03:19.422 LIB libspdk_event_nbd.a 00:03:19.422 SO libspdk_event_ublk.so.2.0 00:03:19.422 SO libspdk_event_scsi.so.5.0 00:03:19.422 SO libspdk_event_nbd.so.5.0 00:03:19.680 SYMLINK libspdk_event_ublk.so 00:03:19.680 SYMLINK libspdk_event_nbd.so 00:03:19.680 SYMLINK libspdk_event_scsi.so 00:03:19.680 LIB libspdk_event_nvmf.a 00:03:19.680 SO libspdk_event_nvmf.so.5.0 00:03:19.680 SYMLINK libspdk_event_nvmf.so 00:03:19.680 CC module/event/subsystems/iscsi/iscsi.o 00:03:19.680 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:19.938 LIB libspdk_event_vhost_scsi.a 00:03:19.938 LIB libspdk_event_iscsi.a 00:03:19.938 SO libspdk_event_vhost_scsi.so.2.0 00:03:19.938 SO libspdk_event_iscsi.so.5.0 00:03:19.938 SYMLINK libspdk_event_vhost_scsi.so 00:03:19.938 SYMLINK libspdk_event_iscsi.so 00:03:19.938 SO libspdk.so.5.0 00:03:19.938 SYMLINK libspdk.so 00:03:20.201 CC app/trace_record/trace_record.o 00:03:20.201 CC app/spdk_nvme_identify/identify.o 00:03:20.201 CXX app/trace/trace.o 00:03:20.201 CC app/spdk_lspci/spdk_lspci.o 00:03:20.201 CC app/spdk_nvme_perf/perf.o 00:03:20.201 CC test/rpc_client/rpc_client_test.o 00:03:20.201 CC app/spdk_top/spdk_top.o 00:03:20.201 CC app/spdk_nvme_discover/discovery_aer.o 00:03:20.201 TEST_HEADER include/spdk/accel.h 00:03:20.201 TEST_HEADER include/spdk/accel_module.h 00:03:20.201 TEST_HEADER include/spdk/assert.h 00:03:20.201 TEST_HEADER include/spdk/barrier.h 00:03:20.201 TEST_HEADER include/spdk/base64.h 00:03:20.201 TEST_HEADER include/spdk/bdev.h 00:03:20.201 TEST_HEADER include/spdk/bdev_module.h 00:03:20.201 TEST_HEADER include/spdk/bdev_zone.h 00:03:20.201 TEST_HEADER include/spdk/bit_array.h 00:03:20.201 TEST_HEADER include/spdk/bit_pool.h 00:03:20.201 TEST_HEADER include/spdk/blob_bdev.h 00:03:20.201 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:20.201 TEST_HEADER include/spdk/blobfs.h 00:03:20.201 TEST_HEADER include/spdk/blob.h 00:03:20.201 TEST_HEADER include/spdk/conf.h 00:03:20.201 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:20.201 CC app/spdk_dd/spdk_dd.o 00:03:20.201 TEST_HEADER include/spdk/config.h 00:03:20.201 TEST_HEADER include/spdk/cpuset.h 00:03:20.201 TEST_HEADER include/spdk/crc16.h 00:03:20.201 CC app/nvmf_tgt/nvmf_main.o 00:03:20.201 TEST_HEADER include/spdk/crc32.h 00:03:20.201 CC app/iscsi_tgt/iscsi_tgt.o 00:03:20.201 TEST_HEADER include/spdk/crc64.h 00:03:20.201 TEST_HEADER include/spdk/dif.h 00:03:20.201 TEST_HEADER include/spdk/dma.h 00:03:20.201 CC examples/idxd/perf/perf.o 00:03:20.201 CC app/vhost/vhost.o 00:03:20.202 CC examples/sock/hello_world/hello_sock.o 00:03:20.202 TEST_HEADER include/spdk/endian.h 00:03:20.202 CC test/app/histogram_perf/histogram_perf.o 00:03:20.202 CC examples/nvme/arbitration/arbitration.o 00:03:20.202 CC examples/nvme/hello_world/hello_world.o 00:03:20.202 TEST_HEADER include/spdk/env_dpdk.h 00:03:20.202 CC examples/ioat/verify/verify.o 00:03:20.202 CC examples/nvme/reconnect/reconnect.o 00:03:20.202 TEST_HEADER include/spdk/env.h 00:03:20.202 TEST_HEADER include/spdk/event.h 00:03:20.202 CC test/event/event_perf/event_perf.o 00:03:20.202 CC examples/util/zipf/zipf.o 00:03:20.202 CC test/thread/poller_perf/poller_perf.o 00:03:20.202 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:20.202 TEST_HEADER include/spdk/fd_group.h 00:03:20.202 CC examples/ioat/perf/perf.o 00:03:20.202 CC examples/vmd/led/led.o 00:03:20.202 CC examples/accel/perf/accel_perf.o 00:03:20.202 CC app/fio/nvme/fio_plugin.o 00:03:20.202 CC examples/vmd/lsvmd/lsvmd.o 00:03:20.202 CC examples/nvme/hotplug/hotplug.o 00:03:20.202 TEST_HEADER include/spdk/fd.h 00:03:20.202 CC test/nvme/aer/aer.o 00:03:20.202 TEST_HEADER include/spdk/file.h 00:03:20.202 TEST_HEADER include/spdk/ftl.h 00:03:20.202 TEST_HEADER include/spdk/gpt_spec.h 00:03:20.202 TEST_HEADER include/spdk/hexlify.h 00:03:20.202 TEST_HEADER include/spdk/histogram_data.h 00:03:20.202 CC app/spdk_tgt/spdk_tgt.o 00:03:20.202 TEST_HEADER include/spdk/idxd.h 00:03:20.202 TEST_HEADER include/spdk/idxd_spec.h 00:03:20.202 TEST_HEADER include/spdk/init.h 00:03:20.202 TEST_HEADER include/spdk/ioat.h 00:03:20.202 TEST_HEADER include/spdk/ioat_spec.h 00:03:20.202 TEST_HEADER include/spdk/iscsi_spec.h 00:03:20.202 TEST_HEADER include/spdk/json.h 00:03:20.202 TEST_HEADER include/spdk/jsonrpc.h 00:03:20.202 CC examples/blob/cli/blobcli.o 00:03:20.202 TEST_HEADER include/spdk/likely.h 00:03:20.465 TEST_HEADER include/spdk/log.h 00:03:20.465 CC examples/bdev/hello_world/hello_bdev.o 00:03:20.465 TEST_HEADER include/spdk/lvol.h 00:03:20.465 CC examples/blob/hello_world/hello_blob.o 00:03:20.465 CC examples/bdev/bdevperf/bdevperf.o 00:03:20.465 CC examples/thread/thread/thread_ex.o 00:03:20.465 CC test/blobfs/mkfs/mkfs.o 00:03:20.465 CC examples/nvmf/nvmf/nvmf.o 00:03:20.465 TEST_HEADER include/spdk/memory.h 00:03:20.465 CC app/fio/bdev/fio_plugin.o 00:03:20.465 CC test/app/bdev_svc/bdev_svc.o 00:03:20.465 CC test/bdev/bdevio/bdevio.o 00:03:20.465 CC test/dma/test_dma/test_dma.o 00:03:20.465 TEST_HEADER include/spdk/mmio.h 00:03:20.465 TEST_HEADER include/spdk/nbd.h 00:03:20.465 TEST_HEADER include/spdk/notify.h 00:03:20.465 CC test/accel/dif/dif.o 00:03:20.465 TEST_HEADER include/spdk/nvme.h 00:03:20.465 CC test/env/mem_callbacks/mem_callbacks.o 00:03:20.465 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:20.465 TEST_HEADER include/spdk/nvme_intel.h 00:03:20.465 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:20.465 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:20.465 TEST_HEADER include/spdk/nvme_spec.h 00:03:20.465 TEST_HEADER include/spdk/nvme_zns.h 00:03:20.465 CC test/lvol/esnap/esnap.o 00:03:20.465 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:20.465 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:20.465 TEST_HEADER include/spdk/nvmf.h 00:03:20.465 TEST_HEADER include/spdk/nvmf_spec.h 00:03:20.465 TEST_HEADER include/spdk/nvmf_transport.h 00:03:20.465 TEST_HEADER include/spdk/opal.h 00:03:20.465 TEST_HEADER include/spdk/opal_spec.h 00:03:20.465 TEST_HEADER include/spdk/pci_ids.h 00:03:20.465 TEST_HEADER include/spdk/pipe.h 00:03:20.465 TEST_HEADER include/spdk/queue.h 00:03:20.465 TEST_HEADER include/spdk/reduce.h 00:03:20.465 TEST_HEADER include/spdk/rpc.h 00:03:20.465 TEST_HEADER include/spdk/scheduler.h 00:03:20.465 TEST_HEADER include/spdk/scsi.h 00:03:20.465 TEST_HEADER include/spdk/scsi_spec.h 00:03:20.465 LINK spdk_lspci 00:03:20.465 TEST_HEADER include/spdk/sock.h 00:03:20.465 TEST_HEADER include/spdk/stdinc.h 00:03:20.465 TEST_HEADER include/spdk/string.h 00:03:20.465 TEST_HEADER include/spdk/thread.h 00:03:20.465 TEST_HEADER include/spdk/trace.h 00:03:20.465 TEST_HEADER include/spdk/trace_parser.h 00:03:20.465 TEST_HEADER include/spdk/tree.h 00:03:20.465 TEST_HEADER include/spdk/ublk.h 00:03:20.465 TEST_HEADER include/spdk/util.h 00:03:20.465 TEST_HEADER include/spdk/uuid.h 00:03:20.465 TEST_HEADER include/spdk/version.h 00:03:20.465 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:20.465 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:20.465 TEST_HEADER include/spdk/vhost.h 00:03:20.465 TEST_HEADER include/spdk/vmd.h 00:03:20.465 TEST_HEADER include/spdk/xor.h 00:03:20.465 TEST_HEADER include/spdk/zipf.h 00:03:20.465 CXX test/cpp_headers/accel.o 00:03:20.465 LINK rpc_client_test 00:03:20.465 LINK lsvmd 00:03:20.465 LINK histogram_perf 00:03:20.465 LINK event_perf 00:03:20.465 LINK led 00:03:20.465 LINK poller_perf 00:03:20.465 LINK spdk_nvme_discover 00:03:20.465 LINK zipf 00:03:20.730 LINK interrupt_tgt 00:03:20.730 LINK nvmf_tgt 00:03:20.730 LINK vhost 00:03:20.730 LINK spdk_trace_record 00:03:20.730 LINK iscsi_tgt 00:03:20.730 LINK verify 00:03:20.730 LINK bdev_svc 00:03:20.730 LINK ioat_perf 00:03:20.730 LINK hello_world 00:03:20.730 LINK spdk_tgt 00:03:20.730 LINK mkfs 00:03:20.730 LINK hello_sock 00:03:20.730 LINK hotplug 00:03:20.730 LINK mem_callbacks 00:03:20.730 LINK hello_blob 00:03:20.730 LINK hello_bdev 00:03:20.730 LINK aer 00:03:20.730 LINK thread 00:03:20.730 CXX test/cpp_headers/accel_module.o 00:03:20.995 CC test/env/vtophys/vtophys.o 00:03:20.995 LINK arbitration 00:03:20.995 LINK nvmf 00:03:20.995 LINK idxd_perf 00:03:20.995 LINK reconnect 00:03:20.995 LINK spdk_dd 00:03:20.995 CXX test/cpp_headers/assert.o 00:03:20.995 CC test/event/reactor/reactor.o 00:03:20.995 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:20.995 LINK spdk_trace 00:03:20.995 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:20.995 CC test/nvme/reset/reset.o 00:03:20.995 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:20.995 CC examples/nvme/abort/abort.o 00:03:20.995 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:20.995 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:20.995 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:20.995 CXX test/cpp_headers/barrier.o 00:03:20.995 LINK test_dma 00:03:20.995 LINK dif 00:03:20.995 LINK bdevio 00:03:21.260 CC test/app/jsoncat/jsoncat.o 00:03:21.260 CC test/event/reactor_perf/reactor_perf.o 00:03:21.260 CC test/nvme/sgl/sgl.o 00:03:21.260 CC test/env/memory/memory_ut.o 00:03:21.260 CXX test/cpp_headers/base64.o 00:03:21.260 CC test/env/pci/pci_ut.o 00:03:21.260 LINK accel_perf 00:03:21.260 CC test/nvme/e2edp/nvme_dp.o 00:03:21.260 LINK nvme_fuzz 00:03:21.260 LINK vtophys 00:03:21.260 CC test/event/app_repeat/app_repeat.o 00:03:21.260 CXX test/cpp_headers/bdev.o 00:03:21.260 CXX test/cpp_headers/bdev_module.o 00:03:21.260 LINK nvme_manage 00:03:21.260 CC test/app/stub/stub.o 00:03:21.260 CC test/nvme/overhead/overhead.o 00:03:21.260 CXX test/cpp_headers/bdev_zone.o 00:03:21.260 CC test/nvme/err_injection/err_injection.o 00:03:21.260 CXX test/cpp_headers/bit_array.o 00:03:21.260 CXX test/cpp_headers/bit_pool.o 00:03:21.260 LINK reactor 00:03:21.260 CC test/event/scheduler/scheduler.o 00:03:21.260 LINK spdk_bdev 00:03:21.260 CXX test/cpp_headers/blob_bdev.o 00:03:21.260 LINK env_dpdk_post_init 00:03:21.260 LINK blobcli 00:03:21.260 LINK spdk_nvme 00:03:21.260 CC test/nvme/startup/startup.o 00:03:21.260 CXX test/cpp_headers/blobfs_bdev.o 00:03:21.260 LINK cmb_copy 00:03:21.260 CC test/nvme/reserve/reserve.o 00:03:21.526 LINK pmr_persistence 00:03:21.526 LINK reactor_perf 00:03:21.526 CC test/nvme/connect_stress/connect_stress.o 00:03:21.526 LINK jsoncat 00:03:21.526 CC test/nvme/simple_copy/simple_copy.o 00:03:21.526 CC test/nvme/boot_partition/boot_partition.o 00:03:21.526 CXX test/cpp_headers/blobfs.o 00:03:21.526 CXX test/cpp_headers/blob.o 00:03:21.526 CC test/nvme/compliance/nvme_compliance.o 00:03:21.526 LINK app_repeat 00:03:21.526 CXX test/cpp_headers/conf.o 00:03:21.526 CXX test/cpp_headers/config.o 00:03:21.526 CXX test/cpp_headers/cpuset.o 00:03:21.526 CXX test/cpp_headers/crc16.o 00:03:21.526 LINK reset 00:03:21.526 CXX test/cpp_headers/crc32.o 00:03:21.526 CXX test/cpp_headers/crc64.o 00:03:21.526 CC test/nvme/fused_ordering/fused_ordering.o 00:03:21.526 LINK stub 00:03:21.526 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:21.526 CXX test/cpp_headers/dif.o 00:03:21.526 CXX test/cpp_headers/dma.o 00:03:21.526 CC test/nvme/fdp/fdp.o 00:03:21.526 CC test/nvme/cuse/cuse.o 00:03:21.526 CXX test/cpp_headers/endian.o 00:03:21.526 LINK err_injection 00:03:21.526 CXX test/cpp_headers/env_dpdk.o 00:03:21.788 CXX test/cpp_headers/env.o 00:03:21.788 LINK sgl 00:03:21.788 CXX test/cpp_headers/fd_group.o 00:03:21.788 CXX test/cpp_headers/event.o 00:03:21.788 CXX test/cpp_headers/fd.o 00:03:21.788 LINK startup 00:03:21.788 CXX test/cpp_headers/file.o 00:03:21.788 CXX test/cpp_headers/ftl.o 00:03:21.788 LINK nvme_dp 00:03:21.788 CXX test/cpp_headers/gpt_spec.o 00:03:21.788 CXX test/cpp_headers/hexlify.o 00:03:21.788 LINK scheduler 00:03:21.788 LINK spdk_nvme_perf 00:03:21.788 LINK spdk_nvme_identify 00:03:21.789 CXX test/cpp_headers/histogram_data.o 00:03:21.789 LINK abort 00:03:21.789 LINK reserve 00:03:21.789 LINK bdevperf 00:03:21.789 LINK connect_stress 00:03:21.789 LINK boot_partition 00:03:21.789 LINK overhead 00:03:21.789 LINK vhost_fuzz 00:03:21.789 CXX test/cpp_headers/idxd.o 00:03:21.789 LINK spdk_top 00:03:21.789 CXX test/cpp_headers/idxd_spec.o 00:03:21.789 CXX test/cpp_headers/init.o 00:03:21.789 CXX test/cpp_headers/ioat.o 00:03:21.789 LINK pci_ut 00:03:21.789 CXX test/cpp_headers/ioat_spec.o 00:03:21.789 CXX test/cpp_headers/iscsi_spec.o 00:03:21.789 CXX test/cpp_headers/json.o 00:03:22.049 CXX test/cpp_headers/jsonrpc.o 00:03:22.049 LINK simple_copy 00:03:22.049 CXX test/cpp_headers/likely.o 00:03:22.049 CXX test/cpp_headers/log.o 00:03:22.049 CXX test/cpp_headers/lvol.o 00:03:22.049 CXX test/cpp_headers/memory.o 00:03:22.049 LINK doorbell_aers 00:03:22.049 LINK fused_ordering 00:03:22.049 CXX test/cpp_headers/mmio.o 00:03:22.049 CXX test/cpp_headers/nbd.o 00:03:22.049 CXX test/cpp_headers/notify.o 00:03:22.049 CXX test/cpp_headers/nvme.o 00:03:22.049 CXX test/cpp_headers/nvme_intel.o 00:03:22.049 CXX test/cpp_headers/nvme_ocssd.o 00:03:22.049 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:22.049 CXX test/cpp_headers/nvme_spec.o 00:03:22.049 CXX test/cpp_headers/nvme_zns.o 00:03:22.049 CXX test/cpp_headers/nvmf_cmd.o 00:03:22.049 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:22.049 CXX test/cpp_headers/nvmf.o 00:03:22.049 CXX test/cpp_headers/nvmf_spec.o 00:03:22.049 CXX test/cpp_headers/nvmf_transport.o 00:03:22.049 CXX test/cpp_headers/opal.o 00:03:22.049 CXX test/cpp_headers/opal_spec.o 00:03:22.049 CXX test/cpp_headers/pci_ids.o 00:03:22.049 CXX test/cpp_headers/pipe.o 00:03:22.049 CXX test/cpp_headers/queue.o 00:03:22.049 LINK memory_ut 00:03:22.049 CXX test/cpp_headers/reduce.o 00:03:22.049 CXX test/cpp_headers/rpc.o 00:03:22.049 CXX test/cpp_headers/scheduler.o 00:03:22.049 CXX test/cpp_headers/scsi.o 00:03:22.049 CXX test/cpp_headers/scsi_spec.o 00:03:22.049 LINK nvme_compliance 00:03:22.311 CXX test/cpp_headers/sock.o 00:03:22.311 CXX test/cpp_headers/stdinc.o 00:03:22.311 CXX test/cpp_headers/string.o 00:03:22.311 CXX test/cpp_headers/thread.o 00:03:22.311 CXX test/cpp_headers/trace.o 00:03:22.311 CXX test/cpp_headers/trace_parser.o 00:03:22.311 LINK fdp 00:03:22.311 CXX test/cpp_headers/tree.o 00:03:22.311 CXX test/cpp_headers/ublk.o 00:03:22.311 CXX test/cpp_headers/util.o 00:03:22.311 CXX test/cpp_headers/uuid.o 00:03:22.311 CXX test/cpp_headers/version.o 00:03:22.311 CXX test/cpp_headers/vfio_user_pci.o 00:03:22.311 CXX test/cpp_headers/vfio_user_spec.o 00:03:22.311 CXX test/cpp_headers/vhost.o 00:03:22.311 CXX test/cpp_headers/vmd.o 00:03:22.311 CXX test/cpp_headers/xor.o 00:03:22.311 CXX test/cpp_headers/zipf.o 00:03:23.246 LINK cuse 00:03:23.504 LINK iscsi_fuzz 00:03:26.056 LINK esnap 00:03:26.056 00:03:26.056 real 0m37.825s 00:03:26.056 user 7m15.759s 00:03:26.056 sys 1m37.495s 00:03:26.056 04:15:05 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:26.056 04:15:05 -- common/autotest_common.sh@10 -- $ set +x 00:03:26.056 ************************************ 00:03:26.056 END TEST make 00:03:26.056 ************************************ 00:03:26.056 04:15:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:26.056 04:15:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:26.056 04:15:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:26.315 04:15:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:26.315 04:15:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:26.315 04:15:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:26.315 04:15:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:26.315 04:15:05 -- scripts/common.sh@335 -- # IFS=.-: 00:03:26.315 04:15:05 -- scripts/common.sh@335 -- # read -ra ver1 00:03:26.315 04:15:05 -- scripts/common.sh@336 -- # IFS=.-: 00:03:26.315 04:15:05 -- scripts/common.sh@336 -- # read -ra ver2 00:03:26.315 04:15:05 -- scripts/common.sh@337 -- # local 'op=<' 00:03:26.315 04:15:05 -- scripts/common.sh@339 -- # ver1_l=2 00:03:26.315 04:15:05 -- scripts/common.sh@340 -- # ver2_l=1 00:03:26.315 04:15:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:26.315 04:15:05 -- scripts/common.sh@343 -- # case "$op" in 00:03:26.315 04:15:05 -- scripts/common.sh@344 -- # : 1 00:03:26.315 04:15:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:26.315 04:15:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:26.315 04:15:05 -- scripts/common.sh@364 -- # decimal 1 00:03:26.315 04:15:05 -- scripts/common.sh@352 -- # local d=1 00:03:26.315 04:15:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:26.315 04:15:05 -- scripts/common.sh@354 -- # echo 1 00:03:26.315 04:15:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:26.315 04:15:05 -- scripts/common.sh@365 -- # decimal 2 00:03:26.315 04:15:05 -- scripts/common.sh@352 -- # local d=2 00:03:26.315 04:15:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:26.315 04:15:05 -- scripts/common.sh@354 -- # echo 2 00:03:26.315 04:15:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:26.315 04:15:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:26.315 04:15:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:26.315 04:15:05 -- scripts/common.sh@367 -- # return 0 00:03:26.315 04:15:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:26.315 04:15:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:26.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:26.315 --rc genhtml_branch_coverage=1 00:03:26.315 --rc genhtml_function_coverage=1 00:03:26.315 --rc genhtml_legend=1 00:03:26.316 --rc geninfo_all_blocks=1 00:03:26.316 --rc geninfo_unexecuted_blocks=1 00:03:26.316 00:03:26.316 ' 00:03:26.316 04:15:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:26.316 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:26.316 --rc genhtml_branch_coverage=1 00:03:26.316 --rc genhtml_function_coverage=1 00:03:26.316 --rc genhtml_legend=1 00:03:26.316 --rc geninfo_all_blocks=1 00:03:26.316 --rc geninfo_unexecuted_blocks=1 00:03:26.316 00:03:26.316 ' 00:03:26.316 04:15:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:26.316 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:26.316 --rc genhtml_branch_coverage=1 00:03:26.316 --rc genhtml_function_coverage=1 00:03:26.316 --rc genhtml_legend=1 00:03:26.316 --rc geninfo_all_blocks=1 00:03:26.316 --rc geninfo_unexecuted_blocks=1 00:03:26.316 00:03:26.316 ' 00:03:26.316 04:15:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:26.316 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:26.316 --rc genhtml_branch_coverage=1 00:03:26.316 --rc genhtml_function_coverage=1 00:03:26.316 --rc genhtml_legend=1 00:03:26.316 --rc geninfo_all_blocks=1 00:03:26.316 --rc geninfo_unexecuted_blocks=1 00:03:26.316 00:03:26.316 ' 00:03:26.316 04:15:05 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:26.316 04:15:05 -- nvmf/common.sh@7 -- # uname -s 00:03:26.316 04:15:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:26.316 04:15:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:26.316 04:15:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:26.316 04:15:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:26.316 04:15:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:26.316 04:15:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:26.316 04:15:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:26.316 04:15:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:26.316 04:15:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:26.316 04:15:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:26.316 04:15:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:26.316 04:15:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:26.316 04:15:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:26.316 04:15:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:26.316 04:15:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:26.316 04:15:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:26.316 04:15:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:26.316 04:15:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:26.316 04:15:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:26.316 04:15:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:26.316 04:15:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:26.316 04:15:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:26.316 04:15:05 -- paths/export.sh@5 -- # export PATH 00:03:26.316 04:15:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:26.316 04:15:05 -- nvmf/common.sh@46 -- # : 0 00:03:26.316 04:15:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:26.316 04:15:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:26.316 04:15:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:26.316 04:15:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:26.316 04:15:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:26.316 04:15:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:26.316 04:15:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:26.316 04:15:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:26.316 04:15:05 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:26.316 04:15:05 -- spdk/autotest.sh@32 -- # uname -s 00:03:26.316 04:15:05 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:26.316 04:15:05 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:26.316 04:15:05 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:26.316 04:15:05 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:26.316 04:15:05 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:26.316 04:15:05 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:26.316 04:15:05 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:26.316 04:15:05 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:26.316 04:15:05 -- spdk/autotest.sh@48 -- # udevadm_pid=2757519 00:03:26.316 04:15:05 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:26.316 04:15:05 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:26.316 04:15:05 -- spdk/autotest.sh@54 -- # echo 2757521 00:03:26.316 04:15:05 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:26.316 04:15:05 -- spdk/autotest.sh@56 -- # echo 2757522 00:03:26.316 04:15:05 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:26.316 04:15:05 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:26.316 04:15:05 -- spdk/autotest.sh@60 -- # echo 2757523 00:03:26.316 04:15:05 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:26.316 04:15:05 -- spdk/autotest.sh@62 -- # echo 2757524 00:03:26.316 04:15:05 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:26.316 04:15:05 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:26.316 04:15:05 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:26.316 04:15:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:26.316 04:15:05 -- common/autotest_common.sh@10 -- # set +x 00:03:26.316 04:15:05 -- spdk/autotest.sh@70 -- # create_test_list 00:03:26.316 04:15:05 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:26.316 04:15:05 -- common/autotest_common.sh@10 -- # set +x 00:03:26.316 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:26.316 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:26.316 04:15:05 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:26.316 04:15:05 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:26.316 04:15:05 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:26.316 04:15:05 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:26.316 04:15:05 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:26.316 04:15:05 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:26.316 04:15:05 -- common/autotest_common.sh@1450 -- # uname 00:03:26.316 04:15:05 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:26.316 04:15:05 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:26.316 04:15:05 -- common/autotest_common.sh@1470 -- # uname 00:03:26.316 04:15:05 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:26.316 04:15:05 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:26.316 04:15:05 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:26.316 lcov: LCOV version 1.15 00:03:26.316 04:15:05 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:44.399 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:44.399 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:44.399 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:44.399 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:44.399 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:44.399 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:02.482 04:15:39 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:02.482 04:15:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:02.482 04:15:39 -- common/autotest_common.sh@10 -- # set +x 00:04:02.482 04:15:39 -- spdk/autotest.sh@89 -- # rm -f 00:04:02.482 04:15:39 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:02.482 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:02.482 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:02.482 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:02.482 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:02.482 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:02.482 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:02.482 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:02.482 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:02.482 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:02.482 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:02.482 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:02.482 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:02.482 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:02.482 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:02.482 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:02.482 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:02.482 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:02.482 04:15:40 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:02.482 04:15:40 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:02.482 04:15:40 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:02.482 04:15:40 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:02.482 04:15:40 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:02.482 04:15:40 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:02.482 04:15:40 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:02.482 04:15:40 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:02.482 04:15:40 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:02.482 04:15:40 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:02.482 04:15:40 -- spdk/autotest.sh@108 -- # grep -v p 00:04:02.482 04:15:40 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:02.482 04:15:40 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:02.482 04:15:40 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:02.482 04:15:40 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:02.482 04:15:40 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:02.482 04:15:40 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:02.482 No valid GPT data, bailing 00:04:02.482 04:15:40 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:02.482 04:15:40 -- scripts/common.sh@393 -- # pt= 00:04:02.482 04:15:40 -- scripts/common.sh@394 -- # return 1 00:04:02.482 04:15:40 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:02.482 1+0 records in 00:04:02.482 1+0 records out 00:04:02.482 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00214423 s, 489 MB/s 00:04:02.482 04:15:40 -- spdk/autotest.sh@116 -- # sync 00:04:02.482 04:15:40 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:02.482 04:15:40 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:02.482 04:15:40 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:03.416 04:15:42 -- spdk/autotest.sh@122 -- # uname -s 00:04:03.416 04:15:42 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:03.416 04:15:42 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:03.416 04:15:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.417 04:15:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.417 04:15:42 -- common/autotest_common.sh@10 -- # set +x 00:04:03.417 ************************************ 00:04:03.417 START TEST setup.sh 00:04:03.417 ************************************ 00:04:03.417 04:15:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:03.675 * Looking for test storage... 00:04:03.675 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:03.675 04:15:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:03.675 04:15:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:03.675 04:15:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:03.675 04:15:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:03.675 04:15:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:03.675 04:15:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:03.675 04:15:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:03.675 04:15:42 -- scripts/common.sh@335 -- # IFS=.-: 00:04:03.675 04:15:42 -- scripts/common.sh@335 -- # read -ra ver1 00:04:03.675 04:15:42 -- scripts/common.sh@336 -- # IFS=.-: 00:04:03.675 04:15:42 -- scripts/common.sh@336 -- # read -ra ver2 00:04:03.675 04:15:42 -- scripts/common.sh@337 -- # local 'op=<' 00:04:03.675 04:15:42 -- scripts/common.sh@339 -- # ver1_l=2 00:04:03.675 04:15:42 -- scripts/common.sh@340 -- # ver2_l=1 00:04:03.675 04:15:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:03.675 04:15:42 -- scripts/common.sh@343 -- # case "$op" in 00:04:03.675 04:15:42 -- scripts/common.sh@344 -- # : 1 00:04:03.675 04:15:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:03.675 04:15:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:03.675 04:15:42 -- scripts/common.sh@364 -- # decimal 1 00:04:03.675 04:15:42 -- scripts/common.sh@352 -- # local d=1 00:04:03.675 04:15:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:03.675 04:15:42 -- scripts/common.sh@354 -- # echo 1 00:04:03.675 04:15:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:03.676 04:15:42 -- scripts/common.sh@365 -- # decimal 2 00:04:03.676 04:15:42 -- scripts/common.sh@352 -- # local d=2 00:04:03.676 04:15:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:03.676 04:15:42 -- scripts/common.sh@354 -- # echo 2 00:04:03.676 04:15:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:03.676 04:15:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:03.676 04:15:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:03.676 04:15:42 -- scripts/common.sh@367 -- # return 0 00:04:03.676 04:15:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:03.676 04:15:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:03.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.676 --rc genhtml_branch_coverage=1 00:04:03.676 --rc genhtml_function_coverage=1 00:04:03.676 --rc genhtml_legend=1 00:04:03.676 --rc geninfo_all_blocks=1 00:04:03.676 --rc geninfo_unexecuted_blocks=1 00:04:03.676 00:04:03.676 ' 00:04:03.676 04:15:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:03.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.676 --rc genhtml_branch_coverage=1 00:04:03.676 --rc genhtml_function_coverage=1 00:04:03.676 --rc genhtml_legend=1 00:04:03.676 --rc geninfo_all_blocks=1 00:04:03.676 --rc geninfo_unexecuted_blocks=1 00:04:03.676 00:04:03.676 ' 00:04:03.676 04:15:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:03.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.676 --rc genhtml_branch_coverage=1 00:04:03.676 --rc genhtml_function_coverage=1 00:04:03.676 --rc genhtml_legend=1 00:04:03.676 --rc geninfo_all_blocks=1 00:04:03.676 --rc geninfo_unexecuted_blocks=1 00:04:03.676 00:04:03.676 ' 00:04:03.676 04:15:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:03.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.676 --rc genhtml_branch_coverage=1 00:04:03.676 --rc genhtml_function_coverage=1 00:04:03.676 --rc genhtml_legend=1 00:04:03.676 --rc geninfo_all_blocks=1 00:04:03.676 --rc geninfo_unexecuted_blocks=1 00:04:03.676 00:04:03.676 ' 00:04:03.676 04:15:42 -- setup/test-setup.sh@10 -- # uname -s 00:04:03.676 04:15:42 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:03.676 04:15:42 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:03.676 04:15:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.676 04:15:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.676 04:15:42 -- common/autotest_common.sh@10 -- # set +x 00:04:03.676 ************************************ 00:04:03.676 START TEST acl 00:04:03.676 ************************************ 00:04:03.676 04:15:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:03.676 * Looking for test storage... 00:04:03.676 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:03.676 04:15:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:03.676 04:15:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:03.676 04:15:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:03.676 04:15:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:03.676 04:15:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:03.676 04:15:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:03.676 04:15:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:03.676 04:15:42 -- scripts/common.sh@335 -- # IFS=.-: 00:04:03.676 04:15:42 -- scripts/common.sh@335 -- # read -ra ver1 00:04:03.935 04:15:42 -- scripts/common.sh@336 -- # IFS=.-: 00:04:03.935 04:15:42 -- scripts/common.sh@336 -- # read -ra ver2 00:04:03.935 04:15:42 -- scripts/common.sh@337 -- # local 'op=<' 00:04:03.935 04:15:42 -- scripts/common.sh@339 -- # ver1_l=2 00:04:03.935 04:15:42 -- scripts/common.sh@340 -- # ver2_l=1 00:04:03.935 04:15:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:03.935 04:15:42 -- scripts/common.sh@343 -- # case "$op" in 00:04:03.935 04:15:42 -- scripts/common.sh@344 -- # : 1 00:04:03.935 04:15:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:03.935 04:15:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:03.935 04:15:42 -- scripts/common.sh@364 -- # decimal 1 00:04:03.935 04:15:42 -- scripts/common.sh@352 -- # local d=1 00:04:03.935 04:15:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:03.935 04:15:42 -- scripts/common.sh@354 -- # echo 1 00:04:03.935 04:15:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:03.935 04:15:42 -- scripts/common.sh@365 -- # decimal 2 00:04:03.935 04:15:42 -- scripts/common.sh@352 -- # local d=2 00:04:03.935 04:15:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:03.935 04:15:42 -- scripts/common.sh@354 -- # echo 2 00:04:03.935 04:15:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:03.935 04:15:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:03.935 04:15:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:03.935 04:15:42 -- scripts/common.sh@367 -- # return 0 00:04:03.935 04:15:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:03.935 04:15:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:03.935 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.935 --rc genhtml_branch_coverage=1 00:04:03.935 --rc genhtml_function_coverage=1 00:04:03.935 --rc genhtml_legend=1 00:04:03.935 --rc geninfo_all_blocks=1 00:04:03.935 --rc geninfo_unexecuted_blocks=1 00:04:03.935 00:04:03.935 ' 00:04:03.935 04:15:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:03.935 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.935 --rc genhtml_branch_coverage=1 00:04:03.935 --rc genhtml_function_coverage=1 00:04:03.935 --rc genhtml_legend=1 00:04:03.935 --rc geninfo_all_blocks=1 00:04:03.935 --rc geninfo_unexecuted_blocks=1 00:04:03.935 00:04:03.935 ' 00:04:03.935 04:15:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:03.935 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.935 --rc genhtml_branch_coverage=1 00:04:03.935 --rc genhtml_function_coverage=1 00:04:03.935 --rc genhtml_legend=1 00:04:03.935 --rc geninfo_all_blocks=1 00:04:03.935 --rc geninfo_unexecuted_blocks=1 00:04:03.935 00:04:03.935 ' 00:04:03.935 04:15:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:03.935 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.935 --rc genhtml_branch_coverage=1 00:04:03.935 --rc genhtml_function_coverage=1 00:04:03.935 --rc genhtml_legend=1 00:04:03.935 --rc geninfo_all_blocks=1 00:04:03.935 --rc geninfo_unexecuted_blocks=1 00:04:03.935 00:04:03.935 ' 00:04:03.935 04:15:42 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:03.935 04:15:42 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:03.935 04:15:42 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:03.935 04:15:42 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:03.935 04:15:42 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:03.935 04:15:42 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:03.935 04:15:42 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:03.935 04:15:42 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:03.935 04:15:42 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:03.935 04:15:42 -- setup/acl.sh@12 -- # devs=() 00:04:03.935 04:15:42 -- setup/acl.sh@12 -- # declare -a devs 00:04:03.935 04:15:42 -- setup/acl.sh@13 -- # drivers=() 00:04:03.935 04:15:42 -- setup/acl.sh@13 -- # declare -A drivers 00:04:03.935 04:15:42 -- setup/acl.sh@51 -- # setup reset 00:04:03.935 04:15:42 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:03.935 04:15:42 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:05.312 04:15:44 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:05.312 04:15:44 -- setup/acl.sh@16 -- # local dev driver 00:04:05.312 04:15:44 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:05.312 04:15:44 -- setup/acl.sh@15 -- # setup output status 00:04:05.312 04:15:44 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:05.312 04:15:44 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:06.246 Hugepages 00:04:06.246 node hugesize free / total 00:04:06.246 04:15:45 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:06.246 04:15:45 -- setup/acl.sh@19 -- # continue 00:04:06.246 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 00:04:06.247 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.247 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.247 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.247 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.505 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.505 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.505 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.505 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.505 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.505 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.505 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.505 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.505 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.505 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.505 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # continue 00:04:06.505 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.505 04:15:45 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:06.505 04:15:45 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:06.505 04:15:45 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:06.505 04:15:45 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:06.505 04:15:45 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:06.505 04:15:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:06.505 04:15:45 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:06.505 04:15:45 -- setup/acl.sh@54 -- # run_test denied denied 00:04:06.505 04:15:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.505 04:15:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.505 04:15:45 -- common/autotest_common.sh@10 -- # set +x 00:04:06.505 ************************************ 00:04:06.505 START TEST denied 00:04:06.505 ************************************ 00:04:06.505 04:15:45 -- common/autotest_common.sh@1114 -- # denied 00:04:06.505 04:15:45 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:06.505 04:15:45 -- setup/acl.sh@38 -- # setup output config 00:04:06.505 04:15:45 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:06.505 04:15:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:06.505 04:15:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:08.406 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:08.406 04:15:47 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:08.406 04:15:47 -- setup/acl.sh@28 -- # local dev driver 00:04:08.406 04:15:47 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:08.406 04:15:47 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:08.406 04:15:47 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:08.406 04:15:47 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:08.406 04:15:47 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:08.406 04:15:47 -- setup/acl.sh@41 -- # setup reset 00:04:08.406 04:15:47 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:08.406 04:15:47 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:10.306 00:04:10.306 real 0m3.848s 00:04:10.306 user 0m1.144s 00:04:10.306 sys 0m1.836s 00:04:10.306 04:15:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.306 04:15:49 -- common/autotest_common.sh@10 -- # set +x 00:04:10.306 ************************************ 00:04:10.306 END TEST denied 00:04:10.306 ************************************ 00:04:10.306 04:15:49 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:10.306 04:15:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.306 04:15:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.306 04:15:49 -- common/autotest_common.sh@10 -- # set +x 00:04:10.306 ************************************ 00:04:10.306 START TEST allowed 00:04:10.306 ************************************ 00:04:10.306 04:15:49 -- common/autotest_common.sh@1114 -- # allowed 00:04:10.306 04:15:49 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:10.306 04:15:49 -- setup/acl.sh@45 -- # setup output config 00:04:10.306 04:15:49 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:10.306 04:15:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:10.306 04:15:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:12.841 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:12.841 04:15:51 -- setup/acl.sh@47 -- # verify 00:04:12.841 04:15:51 -- setup/acl.sh@28 -- # local dev driver 00:04:12.841 04:15:51 -- setup/acl.sh@48 -- # setup reset 00:04:12.841 04:15:51 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:12.841 04:15:51 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:14.219 00:04:14.219 real 0m3.909s 00:04:14.219 user 0m1.089s 00:04:14.219 sys 0m1.699s 00:04:14.219 04:15:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:14.219 04:15:53 -- common/autotest_common.sh@10 -- # set +x 00:04:14.219 ************************************ 00:04:14.219 END TEST allowed 00:04:14.219 ************************************ 00:04:14.219 00:04:14.219 real 0m10.574s 00:04:14.219 user 0m3.342s 00:04:14.219 sys 0m5.333s 00:04:14.219 04:15:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:14.219 04:15:53 -- common/autotest_common.sh@10 -- # set +x 00:04:14.219 ************************************ 00:04:14.219 END TEST acl 00:04:14.219 ************************************ 00:04:14.220 04:15:53 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:14.220 04:15:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.220 04:15:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.220 04:15:53 -- common/autotest_common.sh@10 -- # set +x 00:04:14.220 ************************************ 00:04:14.220 START TEST hugepages 00:04:14.220 ************************************ 00:04:14.220 04:15:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:14.220 * Looking for test storage... 00:04:14.220 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:14.220 04:15:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:14.220 04:15:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:14.220 04:15:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:14.479 04:15:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:14.479 04:15:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:14.479 04:15:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:14.479 04:15:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:14.479 04:15:53 -- scripts/common.sh@335 -- # IFS=.-: 00:04:14.479 04:15:53 -- scripts/common.sh@335 -- # read -ra ver1 00:04:14.479 04:15:53 -- scripts/common.sh@336 -- # IFS=.-: 00:04:14.479 04:15:53 -- scripts/common.sh@336 -- # read -ra ver2 00:04:14.479 04:15:53 -- scripts/common.sh@337 -- # local 'op=<' 00:04:14.479 04:15:53 -- scripts/common.sh@339 -- # ver1_l=2 00:04:14.479 04:15:53 -- scripts/common.sh@340 -- # ver2_l=1 00:04:14.479 04:15:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:14.479 04:15:53 -- scripts/common.sh@343 -- # case "$op" in 00:04:14.479 04:15:53 -- scripts/common.sh@344 -- # : 1 00:04:14.479 04:15:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:14.479 04:15:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:14.479 04:15:53 -- scripts/common.sh@364 -- # decimal 1 00:04:14.479 04:15:53 -- scripts/common.sh@352 -- # local d=1 00:04:14.479 04:15:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:14.479 04:15:53 -- scripts/common.sh@354 -- # echo 1 00:04:14.479 04:15:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:14.479 04:15:53 -- scripts/common.sh@365 -- # decimal 2 00:04:14.479 04:15:53 -- scripts/common.sh@352 -- # local d=2 00:04:14.479 04:15:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:14.479 04:15:53 -- scripts/common.sh@354 -- # echo 2 00:04:14.479 04:15:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:14.479 04:15:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:14.479 04:15:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:14.479 04:15:53 -- scripts/common.sh@367 -- # return 0 00:04:14.479 04:15:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:14.479 04:15:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:14.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:14.479 --rc genhtml_branch_coverage=1 00:04:14.479 --rc genhtml_function_coverage=1 00:04:14.479 --rc genhtml_legend=1 00:04:14.479 --rc geninfo_all_blocks=1 00:04:14.479 --rc geninfo_unexecuted_blocks=1 00:04:14.479 00:04:14.479 ' 00:04:14.479 04:15:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:14.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:14.479 --rc genhtml_branch_coverage=1 00:04:14.479 --rc genhtml_function_coverage=1 00:04:14.479 --rc genhtml_legend=1 00:04:14.479 --rc geninfo_all_blocks=1 00:04:14.479 --rc geninfo_unexecuted_blocks=1 00:04:14.479 00:04:14.479 ' 00:04:14.479 04:15:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:14.479 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:14.479 --rc genhtml_branch_coverage=1 00:04:14.479 --rc genhtml_function_coverage=1 00:04:14.480 --rc genhtml_legend=1 00:04:14.480 --rc geninfo_all_blocks=1 00:04:14.480 --rc geninfo_unexecuted_blocks=1 00:04:14.480 00:04:14.480 ' 00:04:14.480 04:15:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:14.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:14.480 --rc genhtml_branch_coverage=1 00:04:14.480 --rc genhtml_function_coverage=1 00:04:14.480 --rc genhtml_legend=1 00:04:14.480 --rc geninfo_all_blocks=1 00:04:14.480 --rc geninfo_unexecuted_blocks=1 00:04:14.480 00:04:14.480 ' 00:04:14.480 04:15:53 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:14.480 04:15:53 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:14.480 04:15:53 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:14.480 04:15:53 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:14.480 04:15:53 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:14.480 04:15:53 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:14.480 04:15:53 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:14.480 04:15:53 -- setup/common.sh@18 -- # local node= 00:04:14.480 04:15:53 -- setup/common.sh@19 -- # local var val 00:04:14.480 04:15:53 -- setup/common.sh@20 -- # local mem_f mem 00:04:14.480 04:15:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:14.480 04:15:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:14.480 04:15:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:14.480 04:15:53 -- setup/common.sh@28 -- # mapfile -t mem 00:04:14.480 04:15:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 41004796 kB' 'MemAvailable: 44783884 kB' 'Buffers: 2708 kB' 'Cached: 12763156 kB' 'SwapCached: 0 kB' 'Active: 9496212 kB' 'Inactive: 3766524 kB' 'Active(anon): 9094440 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500700 kB' 'Mapped: 213224 kB' 'Shmem: 8597568 kB' 'KReclaimable: 209228 kB' 'Slab: 777520 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 568292 kB' 'KernelStack: 12880 kB' 'PageTables: 8584 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559280 kB' 'Committed_AS: 10163312 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.480 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.480 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # continue 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:14.481 04:15:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:14.481 04:15:53 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:14.481 04:15:53 -- setup/common.sh@33 -- # echo 2048 00:04:14.481 04:15:53 -- setup/common.sh@33 -- # return 0 00:04:14.481 04:15:53 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:14.481 04:15:53 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:14.481 04:15:53 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:14.481 04:15:53 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:14.481 04:15:53 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:14.481 04:15:53 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:14.481 04:15:53 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:14.481 04:15:53 -- setup/hugepages.sh@207 -- # get_nodes 00:04:14.481 04:15:53 -- setup/hugepages.sh@27 -- # local node 00:04:14.481 04:15:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:14.481 04:15:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:14.481 04:15:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:14.481 04:15:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:14.481 04:15:53 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:14.481 04:15:53 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:14.481 04:15:53 -- setup/hugepages.sh@208 -- # clear_hp 00:04:14.481 04:15:53 -- setup/hugepages.sh@37 -- # local node hp 00:04:14.481 04:15:53 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:14.481 04:15:53 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:14.481 04:15:53 -- setup/hugepages.sh@41 -- # echo 0 00:04:14.481 04:15:53 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:14.481 04:15:53 -- setup/hugepages.sh@41 -- # echo 0 00:04:14.481 04:15:53 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:14.481 04:15:53 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:14.481 04:15:53 -- setup/hugepages.sh@41 -- # echo 0 00:04:14.481 04:15:53 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:14.481 04:15:53 -- setup/hugepages.sh@41 -- # echo 0 00:04:14.481 04:15:53 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:14.481 04:15:53 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:14.481 04:15:53 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:14.481 04:15:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.481 04:15:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.481 04:15:53 -- common/autotest_common.sh@10 -- # set +x 00:04:14.481 ************************************ 00:04:14.481 START TEST default_setup 00:04:14.481 ************************************ 00:04:14.481 04:15:53 -- common/autotest_common.sh@1114 -- # default_setup 00:04:14.481 04:15:53 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:14.481 04:15:53 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:14.481 04:15:53 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:14.481 04:15:53 -- setup/hugepages.sh@51 -- # shift 00:04:14.481 04:15:53 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:14.481 04:15:53 -- setup/hugepages.sh@52 -- # local node_ids 00:04:14.481 04:15:53 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:14.481 04:15:53 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:14.481 04:15:53 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:14.481 04:15:53 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:14.481 04:15:53 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:14.481 04:15:53 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:14.481 04:15:53 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:14.481 04:15:53 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:14.481 04:15:53 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:14.481 04:15:53 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:14.481 04:15:53 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:14.481 04:15:53 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:14.481 04:15:53 -- setup/hugepages.sh@73 -- # return 0 00:04:14.481 04:15:53 -- setup/hugepages.sh@137 -- # setup output 00:04:14.481 04:15:53 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:14.481 04:15:53 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:15.858 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:15.859 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:15.859 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:15.859 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:15.859 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:15.859 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:15.859 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:15.859 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:15.859 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:15.859 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:15.859 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:15.859 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:15.859 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:15.859 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:15.859 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:15.859 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:16.800 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:16.800 04:15:55 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:16.800 04:15:55 -- setup/hugepages.sh@89 -- # local node 00:04:16.800 04:15:55 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:16.800 04:15:55 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:16.800 04:15:55 -- setup/hugepages.sh@92 -- # local surp 00:04:16.800 04:15:55 -- setup/hugepages.sh@93 -- # local resv 00:04:16.800 04:15:55 -- setup/hugepages.sh@94 -- # local anon 00:04:16.800 04:15:55 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:16.800 04:15:55 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:16.800 04:15:55 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:16.800 04:15:55 -- setup/common.sh@18 -- # local node= 00:04:16.800 04:15:55 -- setup/common.sh@19 -- # local var val 00:04:16.800 04:15:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:16.800 04:15:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:16.800 04:15:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:16.800 04:15:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:16.800 04:15:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:16.800 04:15:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43118868 kB' 'MemAvailable: 46897956 kB' 'Buffers: 2708 kB' 'Cached: 12763256 kB' 'SwapCached: 0 kB' 'Active: 9501532 kB' 'Inactive: 3766524 kB' 'Active(anon): 9099760 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505604 kB' 'Mapped: 213224 kB' 'Shmem: 8597668 kB' 'KReclaimable: 209228 kB' 'Slab: 777148 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 567920 kB' 'KernelStack: 12880 kB' 'PageTables: 8548 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10174036 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198892 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.800 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.800 04:15:55 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.801 04:15:55 -- setup/common.sh@33 -- # echo 0 00:04:16.801 04:15:55 -- setup/common.sh@33 -- # return 0 00:04:16.801 04:15:55 -- setup/hugepages.sh@97 -- # anon=0 00:04:16.801 04:15:55 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:16.801 04:15:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:16.801 04:15:55 -- setup/common.sh@18 -- # local node= 00:04:16.801 04:15:55 -- setup/common.sh@19 -- # local var val 00:04:16.801 04:15:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:16.801 04:15:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:16.801 04:15:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:16.801 04:15:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:16.801 04:15:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:16.801 04:15:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43119356 kB' 'MemAvailable: 46898444 kB' 'Buffers: 2708 kB' 'Cached: 12763256 kB' 'SwapCached: 0 kB' 'Active: 9503932 kB' 'Inactive: 3766524 kB' 'Active(anon): 9102160 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 507764 kB' 'Mapped: 213212 kB' 'Shmem: 8597668 kB' 'KReclaimable: 209228 kB' 'Slab: 777164 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 567936 kB' 'KernelStack: 12848 kB' 'PageTables: 8160 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10176172 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198864 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.801 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.801 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:55 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.802 04:15:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.802 04:15:56 -- setup/common.sh@33 -- # echo 0 00:04:16.802 04:15:56 -- setup/common.sh@33 -- # return 0 00:04:16.802 04:15:56 -- setup/hugepages.sh@99 -- # surp=0 00:04:16.802 04:15:56 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:16.802 04:15:56 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:16.802 04:15:56 -- setup/common.sh@18 -- # local node= 00:04:16.802 04:15:56 -- setup/common.sh@19 -- # local var val 00:04:16.802 04:15:56 -- setup/common.sh@20 -- # local mem_f mem 00:04:16.802 04:15:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:16.802 04:15:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:16.802 04:15:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:16.802 04:15:56 -- setup/common.sh@28 -- # mapfile -t mem 00:04:16.802 04:15:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.802 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43126184 kB' 'MemAvailable: 46905272 kB' 'Buffers: 2708 kB' 'Cached: 12763272 kB' 'SwapCached: 0 kB' 'Active: 9498608 kB' 'Inactive: 3766524 kB' 'Active(anon): 9096836 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502376 kB' 'Mapped: 213572 kB' 'Shmem: 8597684 kB' 'KReclaimable: 209228 kB' 'Slab: 777164 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 567936 kB' 'KernelStack: 12768 kB' 'PageTables: 8260 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10171688 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198844 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.803 04:15:56 -- setup/common.sh@32 -- # continue 00:04:16.803 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.063 04:15:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.063 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.063 04:15:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.063 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.063 04:15:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.063 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.063 04:15:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.063 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.063 04:15:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.063 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.063 04:15:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.063 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.063 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.064 04:15:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:17.064 04:15:56 -- setup/common.sh@33 -- # echo 0 00:04:17.064 04:15:56 -- setup/common.sh@33 -- # return 0 00:04:17.064 04:15:56 -- setup/hugepages.sh@100 -- # resv=0 00:04:17.064 04:15:56 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:17.064 nr_hugepages=1024 00:04:17.064 04:15:56 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:17.064 resv_hugepages=0 00:04:17.064 04:15:56 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:17.064 surplus_hugepages=0 00:04:17.064 04:15:56 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:17.064 anon_hugepages=0 00:04:17.064 04:15:56 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:17.064 04:15:56 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:17.064 04:15:56 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:17.064 04:15:56 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:17.064 04:15:56 -- setup/common.sh@18 -- # local node= 00:04:17.064 04:15:56 -- setup/common.sh@19 -- # local var val 00:04:17.064 04:15:56 -- setup/common.sh@20 -- # local mem_f mem 00:04:17.064 04:15:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:17.064 04:15:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:17.064 04:15:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:17.064 04:15:56 -- setup/common.sh@28 -- # mapfile -t mem 00:04:17.064 04:15:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.064 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43126576 kB' 'MemAvailable: 46905664 kB' 'Buffers: 2708 kB' 'Cached: 12763280 kB' 'SwapCached: 0 kB' 'Active: 9502196 kB' 'Inactive: 3766524 kB' 'Active(anon): 9100424 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505940 kB' 'Mapped: 213496 kB' 'Shmem: 8597692 kB' 'KReclaimable: 209228 kB' 'Slab: 777164 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 567936 kB' 'KernelStack: 12768 kB' 'PageTables: 8200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10175004 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.065 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.065 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:17.066 04:15:56 -- setup/common.sh@33 -- # echo 1024 00:04:17.066 04:15:56 -- setup/common.sh@33 -- # return 0 00:04:17.066 04:15:56 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:17.066 04:15:56 -- setup/hugepages.sh@112 -- # get_nodes 00:04:17.066 04:15:56 -- setup/hugepages.sh@27 -- # local node 00:04:17.066 04:15:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:17.066 04:15:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:17.066 04:15:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:17.066 04:15:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:17.066 04:15:56 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:17.066 04:15:56 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:17.066 04:15:56 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:17.066 04:15:56 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:17.066 04:15:56 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:17.066 04:15:56 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:17.066 04:15:56 -- setup/common.sh@18 -- # local node=0 00:04:17.066 04:15:56 -- setup/common.sh@19 -- # local var val 00:04:17.066 04:15:56 -- setup/common.sh@20 -- # local mem_f mem 00:04:17.066 04:15:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:17.066 04:15:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:17.066 04:15:56 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:17.066 04:15:56 -- setup/common.sh@28 -- # mapfile -t mem 00:04:17.066 04:15:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27105044 kB' 'MemUsed: 5769880 kB' 'SwapCached: 0 kB' 'Active: 2189644 kB' 'Inactive: 227956 kB' 'Active(anon): 2016420 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 227956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2308428 kB' 'Mapped: 67548 kB' 'AnonPages: 112352 kB' 'Shmem: 1907248 kB' 'KernelStack: 6888 kB' 'PageTables: 3784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 85804 kB' 'Slab: 393584 kB' 'SReclaimable: 85804 kB' 'SUnreclaim: 307780 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.066 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.066 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # continue 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # IFS=': ' 00:04:17.067 04:15:56 -- setup/common.sh@31 -- # read -r var val _ 00:04:17.067 04:15:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:17.067 04:15:56 -- setup/common.sh@33 -- # echo 0 00:04:17.067 04:15:56 -- setup/common.sh@33 -- # return 0 00:04:17.067 04:15:56 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:17.067 04:15:56 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:17.067 04:15:56 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:17.067 04:15:56 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:17.067 04:15:56 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:17.067 node0=1024 expecting 1024 00:04:17.067 04:15:56 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:17.067 00:04:17.067 real 0m2.529s 00:04:17.067 user 0m0.643s 00:04:17.067 sys 0m1.003s 00:04:17.067 04:15:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.067 04:15:56 -- common/autotest_common.sh@10 -- # set +x 00:04:17.067 ************************************ 00:04:17.067 END TEST default_setup 00:04:17.067 ************************************ 00:04:17.067 04:15:56 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:17.067 04:15:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.067 04:15:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.067 04:15:56 -- common/autotest_common.sh@10 -- # set +x 00:04:17.067 ************************************ 00:04:17.067 START TEST per_node_1G_alloc 00:04:17.067 ************************************ 00:04:17.067 04:15:56 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:17.067 04:15:56 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:17.067 04:15:56 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:17.067 04:15:56 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:17.067 04:15:56 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:17.067 04:15:56 -- setup/hugepages.sh@51 -- # shift 00:04:17.067 04:15:56 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:17.067 04:15:56 -- setup/hugepages.sh@52 -- # local node_ids 00:04:17.067 04:15:56 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:17.067 04:15:56 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:17.067 04:15:56 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:17.067 04:15:56 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:17.067 04:15:56 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:17.067 04:15:56 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:17.067 04:15:56 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:17.067 04:15:56 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:17.067 04:15:56 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:17.067 04:15:56 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:17.067 04:15:56 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:17.067 04:15:56 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:17.067 04:15:56 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:17.067 04:15:56 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:17.067 04:15:56 -- setup/hugepages.sh@73 -- # return 0 00:04:17.067 04:15:56 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:17.067 04:15:56 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:17.067 04:15:56 -- setup/hugepages.sh@146 -- # setup output 00:04:17.067 04:15:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:17.067 04:15:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:18.046 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:18.046 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:18.046 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:18.046 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:18.046 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:18.046 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:18.046 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:18.046 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:18.046 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:18.046 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:18.046 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:18.046 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:18.046 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:18.046 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:18.046 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:18.046 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:18.046 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:18.318 04:15:57 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:18.318 04:15:57 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:18.318 04:15:57 -- setup/hugepages.sh@89 -- # local node 00:04:18.318 04:15:57 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:18.318 04:15:57 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:18.318 04:15:57 -- setup/hugepages.sh@92 -- # local surp 00:04:18.318 04:15:57 -- setup/hugepages.sh@93 -- # local resv 00:04:18.318 04:15:57 -- setup/hugepages.sh@94 -- # local anon 00:04:18.318 04:15:57 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:18.318 04:15:57 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:18.318 04:15:57 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:18.318 04:15:57 -- setup/common.sh@18 -- # local node= 00:04:18.318 04:15:57 -- setup/common.sh@19 -- # local var val 00:04:18.318 04:15:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.318 04:15:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.318 04:15:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.318 04:15:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.318 04:15:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.318 04:15:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43130300 kB' 'MemAvailable: 46909388 kB' 'Buffers: 2708 kB' 'Cached: 12763340 kB' 'SwapCached: 0 kB' 'Active: 9498276 kB' 'Inactive: 3766524 kB' 'Active(anon): 9096504 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502064 kB' 'Mapped: 212840 kB' 'Shmem: 8597752 kB' 'KReclaimable: 209228 kB' 'Slab: 777628 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 568400 kB' 'KernelStack: 12816 kB' 'PageTables: 8420 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10170124 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.318 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.318 04:15:57 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.319 04:15:57 -- setup/common.sh@33 -- # echo 0 00:04:18.319 04:15:57 -- setup/common.sh@33 -- # return 0 00:04:18.319 04:15:57 -- setup/hugepages.sh@97 -- # anon=0 00:04:18.319 04:15:57 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:18.319 04:15:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:18.319 04:15:57 -- setup/common.sh@18 -- # local node= 00:04:18.319 04:15:57 -- setup/common.sh@19 -- # local var val 00:04:18.319 04:15:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.319 04:15:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.319 04:15:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.319 04:15:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.319 04:15:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.319 04:15:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43130924 kB' 'MemAvailable: 46910012 kB' 'Buffers: 2708 kB' 'Cached: 12763340 kB' 'SwapCached: 0 kB' 'Active: 9499160 kB' 'Inactive: 3766524 kB' 'Active(anon): 9097388 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502948 kB' 'Mapped: 212840 kB' 'Shmem: 8597752 kB' 'KReclaimable: 209228 kB' 'Slab: 777628 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 568400 kB' 'KernelStack: 12864 kB' 'PageTables: 8568 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10170136 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198796 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.319 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.319 04:15:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.320 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.320 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.321 04:15:57 -- setup/common.sh@33 -- # echo 0 00:04:18.321 04:15:57 -- setup/common.sh@33 -- # return 0 00:04:18.321 04:15:57 -- setup/hugepages.sh@99 -- # surp=0 00:04:18.321 04:15:57 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:18.321 04:15:57 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:18.321 04:15:57 -- setup/common.sh@18 -- # local node= 00:04:18.321 04:15:57 -- setup/common.sh@19 -- # local var val 00:04:18.321 04:15:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.321 04:15:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.321 04:15:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.321 04:15:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.321 04:15:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.321 04:15:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43132792 kB' 'MemAvailable: 46911880 kB' 'Buffers: 2708 kB' 'Cached: 12763340 kB' 'SwapCached: 0 kB' 'Active: 9497552 kB' 'Inactive: 3766524 kB' 'Active(anon): 9095780 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501296 kB' 'Mapped: 212748 kB' 'Shmem: 8597752 kB' 'KReclaimable: 209228 kB' 'Slab: 777604 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 568376 kB' 'KernelStack: 12816 kB' 'PageTables: 8392 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10170152 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198796 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.321 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.321 04:15:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.322 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.322 04:15:57 -- setup/common.sh@33 -- # echo 0 00:04:18.322 04:15:57 -- setup/common.sh@33 -- # return 0 00:04:18.322 04:15:57 -- setup/hugepages.sh@100 -- # resv=0 00:04:18.322 04:15:57 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:18.322 nr_hugepages=1024 00:04:18.322 04:15:57 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:18.322 resv_hugepages=0 00:04:18.322 04:15:57 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:18.322 surplus_hugepages=0 00:04:18.322 04:15:57 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:18.322 anon_hugepages=0 00:04:18.322 04:15:57 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:18.322 04:15:57 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:18.322 04:15:57 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:18.322 04:15:57 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:18.322 04:15:57 -- setup/common.sh@18 -- # local node= 00:04:18.322 04:15:57 -- setup/common.sh@19 -- # local var val 00:04:18.322 04:15:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.322 04:15:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.322 04:15:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.322 04:15:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.322 04:15:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.322 04:15:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.322 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43132792 kB' 'MemAvailable: 46911880 kB' 'Buffers: 2708 kB' 'Cached: 12763368 kB' 'SwapCached: 0 kB' 'Active: 9497880 kB' 'Inactive: 3766524 kB' 'Active(anon): 9096108 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501648 kB' 'Mapped: 212748 kB' 'Shmem: 8597780 kB' 'KReclaimable: 209228 kB' 'Slab: 777592 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 568364 kB' 'KernelStack: 12832 kB' 'PageTables: 8420 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10170164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198796 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.323 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.323 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.324 04:15:57 -- setup/common.sh@33 -- # echo 1024 00:04:18.324 04:15:57 -- setup/common.sh@33 -- # return 0 00:04:18.324 04:15:57 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:18.324 04:15:57 -- setup/hugepages.sh@112 -- # get_nodes 00:04:18.324 04:15:57 -- setup/hugepages.sh@27 -- # local node 00:04:18.324 04:15:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:18.324 04:15:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:18.324 04:15:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:18.324 04:15:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:18.324 04:15:57 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:18.324 04:15:57 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:18.324 04:15:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:18.324 04:15:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:18.324 04:15:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:18.324 04:15:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:18.324 04:15:57 -- setup/common.sh@18 -- # local node=0 00:04:18.324 04:15:57 -- setup/common.sh@19 -- # local var val 00:04:18.324 04:15:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.324 04:15:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.324 04:15:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:18.324 04:15:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:18.324 04:15:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.324 04:15:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28155812 kB' 'MemUsed: 4719112 kB' 'SwapCached: 0 kB' 'Active: 2189456 kB' 'Inactive: 227956 kB' 'Active(anon): 2016232 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 227956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2308524 kB' 'Mapped: 67400 kB' 'AnonPages: 112072 kB' 'Shmem: 1907344 kB' 'KernelStack: 6824 kB' 'PageTables: 3920 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 85804 kB' 'Slab: 394032 kB' 'SReclaimable: 85804 kB' 'SUnreclaim: 308228 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.324 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.324 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@33 -- # echo 0 00:04:18.325 04:15:57 -- setup/common.sh@33 -- # return 0 00:04:18.325 04:15:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:18.325 04:15:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:18.325 04:15:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:18.325 04:15:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:18.325 04:15:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:18.325 04:15:57 -- setup/common.sh@18 -- # local node=1 00:04:18.325 04:15:57 -- setup/common.sh@19 -- # local var val 00:04:18.325 04:15:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.325 04:15:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.325 04:15:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:18.325 04:15:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:18.325 04:15:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.325 04:15:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 14977232 kB' 'MemUsed: 12683504 kB' 'SwapCached: 0 kB' 'Active: 7308412 kB' 'Inactive: 3538568 kB' 'Active(anon): 7079864 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3538568 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10457568 kB' 'Mapped: 145348 kB' 'AnonPages: 389536 kB' 'Shmem: 6690452 kB' 'KernelStack: 5992 kB' 'PageTables: 4452 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123424 kB' 'Slab: 383560 kB' 'SReclaimable: 123424 kB' 'SUnreclaim: 260136 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.325 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.325 04:15:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # continue 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.326 04:15:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.326 04:15:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.326 04:15:57 -- setup/common.sh@33 -- # echo 0 00:04:18.326 04:15:57 -- setup/common.sh@33 -- # return 0 00:04:18.326 04:15:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:18.326 04:15:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:18.326 04:15:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:18.326 04:15:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:18.326 04:15:57 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:18.326 node0=512 expecting 512 00:04:18.326 04:15:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:18.326 04:15:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:18.326 04:15:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:18.326 04:15:57 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:18.326 node1=512 expecting 512 00:04:18.326 04:15:57 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:18.326 00:04:18.326 real 0m1.393s 00:04:18.326 user 0m0.578s 00:04:18.326 sys 0m0.779s 00:04:18.326 04:15:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:18.326 04:15:57 -- common/autotest_common.sh@10 -- # set +x 00:04:18.326 ************************************ 00:04:18.326 END TEST per_node_1G_alloc 00:04:18.327 ************************************ 00:04:18.327 04:15:57 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:18.327 04:15:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:18.327 04:15:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:18.327 04:15:57 -- common/autotest_common.sh@10 -- # set +x 00:04:18.327 ************************************ 00:04:18.327 START TEST even_2G_alloc 00:04:18.327 ************************************ 00:04:18.327 04:15:57 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:18.327 04:15:57 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:18.327 04:15:57 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:18.327 04:15:57 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:18.327 04:15:57 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:18.327 04:15:57 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:18.327 04:15:57 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:18.327 04:15:57 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:18.327 04:15:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:18.327 04:15:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:18.327 04:15:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:18.327 04:15:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:18.327 04:15:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:18.327 04:15:57 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:18.327 04:15:57 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:18.327 04:15:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:18.327 04:15:57 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:18.327 04:15:57 -- setup/hugepages.sh@83 -- # : 512 00:04:18.327 04:15:57 -- setup/hugepages.sh@84 -- # : 1 00:04:18.327 04:15:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:18.327 04:15:57 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:18.327 04:15:57 -- setup/hugepages.sh@83 -- # : 0 00:04:18.327 04:15:57 -- setup/hugepages.sh@84 -- # : 0 00:04:18.327 04:15:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:18.327 04:15:57 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:18.327 04:15:57 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:18.327 04:15:57 -- setup/hugepages.sh@153 -- # setup output 00:04:18.327 04:15:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:18.327 04:15:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:19.704 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:19.705 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:19.705 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:19.705 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:19.705 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:19.705 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:19.705 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:19.705 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:19.705 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:19.705 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:19.705 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:19.705 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:19.705 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:19.705 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:19.705 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:19.705 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:19.705 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:19.705 04:15:58 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:19.705 04:15:58 -- setup/hugepages.sh@89 -- # local node 00:04:19.705 04:15:58 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:19.705 04:15:58 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:19.705 04:15:58 -- setup/hugepages.sh@92 -- # local surp 00:04:19.705 04:15:58 -- setup/hugepages.sh@93 -- # local resv 00:04:19.705 04:15:58 -- setup/hugepages.sh@94 -- # local anon 00:04:19.705 04:15:58 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:19.705 04:15:58 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:19.705 04:15:58 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:19.705 04:15:58 -- setup/common.sh@18 -- # local node= 00:04:19.705 04:15:58 -- setup/common.sh@19 -- # local var val 00:04:19.705 04:15:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.705 04:15:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.705 04:15:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:19.705 04:15:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:19.705 04:15:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.705 04:15:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43104960 kB' 'MemAvailable: 46884048 kB' 'Buffers: 2708 kB' 'Cached: 12763428 kB' 'SwapCached: 0 kB' 'Active: 9499032 kB' 'Inactive: 3766524 kB' 'Active(anon): 9097260 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502608 kB' 'Mapped: 212780 kB' 'Shmem: 8597840 kB' 'KReclaimable: 209228 kB' 'Slab: 777392 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 568164 kB' 'KernelStack: 12848 kB' 'PageTables: 8372 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10170344 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198988 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.705 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.705 04:15:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.706 04:15:58 -- setup/common.sh@33 -- # echo 0 00:04:19.706 04:15:58 -- setup/common.sh@33 -- # return 0 00:04:19.706 04:15:58 -- setup/hugepages.sh@97 -- # anon=0 00:04:19.706 04:15:58 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:19.706 04:15:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:19.706 04:15:58 -- setup/common.sh@18 -- # local node= 00:04:19.706 04:15:58 -- setup/common.sh@19 -- # local var val 00:04:19.706 04:15:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.706 04:15:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.706 04:15:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:19.706 04:15:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:19.706 04:15:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.706 04:15:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43110292 kB' 'MemAvailable: 46889380 kB' 'Buffers: 2708 kB' 'Cached: 12763432 kB' 'SwapCached: 0 kB' 'Active: 9499300 kB' 'Inactive: 3766524 kB' 'Active(anon): 9097528 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502936 kB' 'Mapped: 212780 kB' 'Shmem: 8597844 kB' 'KReclaimable: 209228 kB' 'Slab: 777472 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 568244 kB' 'KernelStack: 12832 kB' 'PageTables: 8324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10170356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198940 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.706 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.706 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.707 04:15:58 -- setup/common.sh@33 -- # echo 0 00:04:19.707 04:15:58 -- setup/common.sh@33 -- # return 0 00:04:19.707 04:15:58 -- setup/hugepages.sh@99 -- # surp=0 00:04:19.707 04:15:58 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:19.707 04:15:58 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:19.707 04:15:58 -- setup/common.sh@18 -- # local node= 00:04:19.707 04:15:58 -- setup/common.sh@19 -- # local var val 00:04:19.707 04:15:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.707 04:15:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.707 04:15:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:19.707 04:15:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:19.707 04:15:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.707 04:15:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.707 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.707 04:15:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43110040 kB' 'MemAvailable: 46889128 kB' 'Buffers: 2708 kB' 'Cached: 12763436 kB' 'SwapCached: 0 kB' 'Active: 9498400 kB' 'Inactive: 3766524 kB' 'Active(anon): 9096628 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501992 kB' 'Mapped: 212772 kB' 'Shmem: 8597848 kB' 'KReclaimable: 209228 kB' 'Slab: 777472 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 568244 kB' 'KernelStack: 12848 kB' 'PageTables: 8328 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10170372 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198924 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.708 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.708 04:15:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.709 04:15:58 -- setup/common.sh@33 -- # echo 0 00:04:19.709 04:15:58 -- setup/common.sh@33 -- # return 0 00:04:19.709 04:15:58 -- setup/hugepages.sh@100 -- # resv=0 00:04:19.709 04:15:58 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:19.709 nr_hugepages=1024 00:04:19.709 04:15:58 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:19.709 resv_hugepages=0 00:04:19.709 04:15:58 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:19.709 surplus_hugepages=0 00:04:19.709 04:15:58 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:19.709 anon_hugepages=0 00:04:19.709 04:15:58 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:19.709 04:15:58 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:19.709 04:15:58 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:19.709 04:15:58 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:19.709 04:15:58 -- setup/common.sh@18 -- # local node= 00:04:19.709 04:15:58 -- setup/common.sh@19 -- # local var val 00:04:19.709 04:15:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.709 04:15:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.709 04:15:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:19.709 04:15:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:19.709 04:15:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.709 04:15:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43109968 kB' 'MemAvailable: 46889056 kB' 'Buffers: 2708 kB' 'Cached: 12763456 kB' 'SwapCached: 0 kB' 'Active: 9498836 kB' 'Inactive: 3766524 kB' 'Active(anon): 9097064 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 502416 kB' 'Mapped: 212772 kB' 'Shmem: 8597868 kB' 'KReclaimable: 209228 kB' 'Slab: 777472 kB' 'SReclaimable: 209228 kB' 'SUnreclaim: 568244 kB' 'KernelStack: 12880 kB' 'PageTables: 8416 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10170384 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198924 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.709 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.709 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.710 04:15:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.710 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.710 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.710 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.970 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.970 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.970 04:15:58 -- setup/common.sh@33 -- # echo 1024 00:04:19.970 04:15:58 -- setup/common.sh@33 -- # return 0 00:04:19.971 04:15:58 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:19.971 04:15:58 -- setup/hugepages.sh@112 -- # get_nodes 00:04:19.971 04:15:58 -- setup/hugepages.sh@27 -- # local node 00:04:19.971 04:15:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:19.971 04:15:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:19.971 04:15:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:19.971 04:15:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:19.971 04:15:58 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:19.971 04:15:58 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:19.971 04:15:58 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:19.971 04:15:58 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:19.971 04:15:58 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:19.971 04:15:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:19.971 04:15:58 -- setup/common.sh@18 -- # local node=0 00:04:19.971 04:15:58 -- setup/common.sh@19 -- # local var val 00:04:19.971 04:15:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.971 04:15:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.971 04:15:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:19.971 04:15:58 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:19.971 04:15:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.971 04:15:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28157916 kB' 'MemUsed: 4717008 kB' 'SwapCached: 0 kB' 'Active: 2189660 kB' 'Inactive: 227956 kB' 'Active(anon): 2016436 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 227956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2308612 kB' 'Mapped: 67400 kB' 'AnonPages: 112168 kB' 'Shmem: 1907432 kB' 'KernelStack: 6856 kB' 'PageTables: 3968 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 85804 kB' 'Slab: 393844 kB' 'SReclaimable: 85804 kB' 'SUnreclaim: 308040 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.971 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.971 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@33 -- # echo 0 00:04:19.972 04:15:58 -- setup/common.sh@33 -- # return 0 00:04:19.972 04:15:58 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:19.972 04:15:58 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:19.972 04:15:58 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:19.972 04:15:58 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:19.972 04:15:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:19.972 04:15:58 -- setup/common.sh@18 -- # local node=1 00:04:19.972 04:15:58 -- setup/common.sh@19 -- # local var val 00:04:19.972 04:15:58 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.972 04:15:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.972 04:15:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:19.972 04:15:58 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:19.972 04:15:58 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.972 04:15:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 14952092 kB' 'MemUsed: 12708644 kB' 'SwapCached: 0 kB' 'Active: 7309204 kB' 'Inactive: 3538568 kB' 'Active(anon): 7080656 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3538568 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10457568 kB' 'Mapped: 145372 kB' 'AnonPages: 390256 kB' 'Shmem: 6690452 kB' 'KernelStack: 6024 kB' 'PageTables: 4448 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123424 kB' 'Slab: 383628 kB' 'SReclaimable: 123424 kB' 'SUnreclaim: 260204 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.972 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.972 04:15:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # continue 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.973 04:15:58 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.973 04:15:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.973 04:15:58 -- setup/common.sh@33 -- # echo 0 00:04:19.973 04:15:58 -- setup/common.sh@33 -- # return 0 00:04:19.973 04:15:58 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:19.973 04:15:58 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:19.973 04:15:58 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:19.973 04:15:58 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:19.973 04:15:58 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:19.973 node0=512 expecting 512 00:04:19.973 04:15:58 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:19.973 04:15:58 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:19.973 04:15:58 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:19.973 04:15:58 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:19.973 node1=512 expecting 512 00:04:19.973 04:15:58 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:19.973 00:04:19.973 real 0m1.459s 00:04:19.973 user 0m0.611s 00:04:19.973 sys 0m0.813s 00:04:19.973 04:15:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.973 04:15:58 -- common/autotest_common.sh@10 -- # set +x 00:04:19.973 ************************************ 00:04:19.973 END TEST even_2G_alloc 00:04:19.973 ************************************ 00:04:19.973 04:15:58 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:19.973 04:15:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.973 04:15:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.973 04:15:59 -- common/autotest_common.sh@10 -- # set +x 00:04:19.973 ************************************ 00:04:19.973 START TEST odd_alloc 00:04:19.973 ************************************ 00:04:19.973 04:15:59 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:19.973 04:15:59 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:19.973 04:15:59 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:19.973 04:15:59 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:19.973 04:15:59 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:19.973 04:15:59 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:19.973 04:15:59 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:19.973 04:15:59 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:19.973 04:15:59 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:19.973 04:15:59 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:19.973 04:15:59 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:19.973 04:15:59 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:19.973 04:15:59 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:19.973 04:15:59 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:19.973 04:15:59 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:19.973 04:15:59 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:19.973 04:15:59 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:19.973 04:15:59 -- setup/hugepages.sh@83 -- # : 513 00:04:19.973 04:15:59 -- setup/hugepages.sh@84 -- # : 1 00:04:19.973 04:15:59 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:19.973 04:15:59 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:19.973 04:15:59 -- setup/hugepages.sh@83 -- # : 0 00:04:19.973 04:15:59 -- setup/hugepages.sh@84 -- # : 0 00:04:19.973 04:15:59 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:19.973 04:15:59 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:19.973 04:15:59 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:19.973 04:15:59 -- setup/hugepages.sh@160 -- # setup output 00:04:19.973 04:15:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:19.973 04:15:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:20.908 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:20.908 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:20.908 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:20.908 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:20.908 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:20.908 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:20.908 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:20.908 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:20.908 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:20.908 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:20.908 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:20.908 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:20.908 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:20.908 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:20.908 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:20.908 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:20.908 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:21.171 04:16:00 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:21.171 04:16:00 -- setup/hugepages.sh@89 -- # local node 00:04:21.171 04:16:00 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:21.171 04:16:00 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:21.171 04:16:00 -- setup/hugepages.sh@92 -- # local surp 00:04:21.171 04:16:00 -- setup/hugepages.sh@93 -- # local resv 00:04:21.171 04:16:00 -- setup/hugepages.sh@94 -- # local anon 00:04:21.171 04:16:00 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:21.171 04:16:00 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:21.171 04:16:00 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:21.171 04:16:00 -- setup/common.sh@18 -- # local node= 00:04:21.171 04:16:00 -- setup/common.sh@19 -- # local var val 00:04:21.171 04:16:00 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.171 04:16:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.171 04:16:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.171 04:16:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.171 04:16:00 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.171 04:16:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.171 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.171 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.171 04:16:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43019060 kB' 'MemAvailable: 46798144 kB' 'Buffers: 2708 kB' 'Cached: 12763516 kB' 'SwapCached: 0 kB' 'Active: 9497532 kB' 'Inactive: 3766524 kB' 'Active(anon): 9095760 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501172 kB' 'Mapped: 211744 kB' 'Shmem: 8597928 kB' 'KReclaimable: 209220 kB' 'Slab: 777360 kB' 'SReclaimable: 209220 kB' 'SUnreclaim: 568140 kB' 'KernelStack: 12816 kB' 'PageTables: 8024 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 10155444 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198876 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:21.171 04:16:00 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.171 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.171 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.171 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.171 04:16:00 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.171 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.171 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.171 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.172 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.172 04:16:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.172 04:16:00 -- setup/common.sh@33 -- # echo 0 00:04:21.172 04:16:00 -- setup/common.sh@33 -- # return 0 00:04:21.172 04:16:00 -- setup/hugepages.sh@97 -- # anon=0 00:04:21.172 04:16:00 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:21.172 04:16:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.172 04:16:00 -- setup/common.sh@18 -- # local node= 00:04:21.172 04:16:00 -- setup/common.sh@19 -- # local var val 00:04:21.172 04:16:00 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.172 04:16:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.172 04:16:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.172 04:16:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.173 04:16:00 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.173 04:16:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43022156 kB' 'MemAvailable: 46801240 kB' 'Buffers: 2708 kB' 'Cached: 12763520 kB' 'SwapCached: 0 kB' 'Active: 9497968 kB' 'Inactive: 3766524 kB' 'Active(anon): 9096196 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501620 kB' 'Mapped: 211744 kB' 'Shmem: 8597932 kB' 'KReclaimable: 209220 kB' 'Slab: 777312 kB' 'SReclaimable: 209220 kB' 'SUnreclaim: 568092 kB' 'KernelStack: 12800 kB' 'PageTables: 7964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 10155460 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.173 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.173 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.174 04:16:00 -- setup/common.sh@33 -- # echo 0 00:04:21.174 04:16:00 -- setup/common.sh@33 -- # return 0 00:04:21.174 04:16:00 -- setup/hugepages.sh@99 -- # surp=0 00:04:21.174 04:16:00 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:21.174 04:16:00 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:21.174 04:16:00 -- setup/common.sh@18 -- # local node= 00:04:21.174 04:16:00 -- setup/common.sh@19 -- # local var val 00:04:21.174 04:16:00 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.174 04:16:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.174 04:16:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.174 04:16:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.174 04:16:00 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.174 04:16:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43021116 kB' 'MemAvailable: 46800200 kB' 'Buffers: 2708 kB' 'Cached: 12763532 kB' 'SwapCached: 0 kB' 'Active: 9497012 kB' 'Inactive: 3766524 kB' 'Active(anon): 9095240 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500544 kB' 'Mapped: 211708 kB' 'Shmem: 8597944 kB' 'KReclaimable: 209220 kB' 'Slab: 777304 kB' 'SReclaimable: 209220 kB' 'SUnreclaim: 568084 kB' 'KernelStack: 12848 kB' 'PageTables: 8088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 10155844 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198844 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.174 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.174 04:16:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.175 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.175 04:16:00 -- setup/common.sh@33 -- # echo 0 00:04:21.175 04:16:00 -- setup/common.sh@33 -- # return 0 00:04:21.175 04:16:00 -- setup/hugepages.sh@100 -- # resv=0 00:04:21.175 04:16:00 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:21.175 nr_hugepages=1025 00:04:21.175 04:16:00 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:21.175 resv_hugepages=0 00:04:21.175 04:16:00 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:21.175 surplus_hugepages=0 00:04:21.175 04:16:00 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:21.175 anon_hugepages=0 00:04:21.175 04:16:00 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:21.175 04:16:00 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:21.175 04:16:00 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:21.175 04:16:00 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:21.175 04:16:00 -- setup/common.sh@18 -- # local node= 00:04:21.175 04:16:00 -- setup/common.sh@19 -- # local var val 00:04:21.175 04:16:00 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.175 04:16:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.175 04:16:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.175 04:16:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.175 04:16:00 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.175 04:16:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.175 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43021368 kB' 'MemAvailable: 46800452 kB' 'Buffers: 2708 kB' 'Cached: 12763548 kB' 'SwapCached: 0 kB' 'Active: 9497184 kB' 'Inactive: 3766524 kB' 'Active(anon): 9095412 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500764 kB' 'Mapped: 211708 kB' 'Shmem: 8597960 kB' 'KReclaimable: 209220 kB' 'Slab: 777368 kB' 'SReclaimable: 209220 kB' 'SUnreclaim: 568148 kB' 'KernelStack: 12848 kB' 'PageTables: 8076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 10155860 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.176 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.176 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.177 04:16:00 -- setup/common.sh@33 -- # echo 1025 00:04:21.177 04:16:00 -- setup/common.sh@33 -- # return 0 00:04:21.177 04:16:00 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:21.177 04:16:00 -- setup/hugepages.sh@112 -- # get_nodes 00:04:21.177 04:16:00 -- setup/hugepages.sh@27 -- # local node 00:04:21.177 04:16:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:21.177 04:16:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:21.177 04:16:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:21.177 04:16:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:21.177 04:16:00 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:21.177 04:16:00 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:21.177 04:16:00 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:21.177 04:16:00 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:21.177 04:16:00 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:21.177 04:16:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.177 04:16:00 -- setup/common.sh@18 -- # local node=0 00:04:21.177 04:16:00 -- setup/common.sh@19 -- # local var val 00:04:21.177 04:16:00 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.177 04:16:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.177 04:16:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:21.177 04:16:00 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:21.177 04:16:00 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.177 04:16:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28078456 kB' 'MemUsed: 4796468 kB' 'SwapCached: 0 kB' 'Active: 2187152 kB' 'Inactive: 227956 kB' 'Active(anon): 2013928 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 227956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2308676 kB' 'Mapped: 66660 kB' 'AnonPages: 109656 kB' 'Shmem: 1907496 kB' 'KernelStack: 6776 kB' 'PageTables: 3604 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 85796 kB' 'Slab: 393720 kB' 'SReclaimable: 85796 kB' 'SUnreclaim: 307924 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.177 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.177 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@33 -- # echo 0 00:04:21.178 04:16:00 -- setup/common.sh@33 -- # return 0 00:04:21.178 04:16:00 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:21.178 04:16:00 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:21.178 04:16:00 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:21.178 04:16:00 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:21.178 04:16:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.178 04:16:00 -- setup/common.sh@18 -- # local node=1 00:04:21.178 04:16:00 -- setup/common.sh@19 -- # local var val 00:04:21.178 04:16:00 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.178 04:16:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.178 04:16:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:21.178 04:16:00 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:21.178 04:16:00 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.178 04:16:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 14942912 kB' 'MemUsed: 12717824 kB' 'SwapCached: 0 kB' 'Active: 7310016 kB' 'Inactive: 3538568 kB' 'Active(anon): 7081468 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3538568 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10457580 kB' 'Mapped: 145048 kB' 'AnonPages: 391120 kB' 'Shmem: 6690464 kB' 'KernelStack: 6104 kB' 'PageTables: 4568 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123424 kB' 'Slab: 383648 kB' 'SReclaimable: 123424 kB' 'SUnreclaim: 260224 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.178 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.178 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # continue 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.179 04:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.179 04:16:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.179 04:16:00 -- setup/common.sh@33 -- # echo 0 00:04:21.179 04:16:00 -- setup/common.sh@33 -- # return 0 00:04:21.179 04:16:00 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:21.179 04:16:00 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:21.179 04:16:00 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:21.179 04:16:00 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:21.179 04:16:00 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:21.179 node0=512 expecting 513 00:04:21.179 04:16:00 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:21.179 04:16:00 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:21.179 04:16:00 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:21.179 04:16:00 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:21.179 node1=513 expecting 512 00:04:21.179 04:16:00 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:21.179 00:04:21.179 real 0m1.348s 00:04:21.179 user 0m0.566s 00:04:21.179 sys 0m0.745s 00:04:21.179 04:16:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:21.179 04:16:00 -- common/autotest_common.sh@10 -- # set +x 00:04:21.179 ************************************ 00:04:21.179 END TEST odd_alloc 00:04:21.179 ************************************ 00:04:21.179 04:16:00 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:21.179 04:16:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:21.179 04:16:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:21.179 04:16:00 -- common/autotest_common.sh@10 -- # set +x 00:04:21.179 ************************************ 00:04:21.179 START TEST custom_alloc 00:04:21.179 ************************************ 00:04:21.179 04:16:00 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:21.179 04:16:00 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:21.179 04:16:00 -- setup/hugepages.sh@169 -- # local node 00:04:21.179 04:16:00 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:21.179 04:16:00 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:21.179 04:16:00 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:21.179 04:16:00 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:21.179 04:16:00 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:21.179 04:16:00 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:21.179 04:16:00 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:21.179 04:16:00 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:21.179 04:16:00 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:21.179 04:16:00 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:21.179 04:16:00 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:21.179 04:16:00 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:21.179 04:16:00 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:21.179 04:16:00 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:21.179 04:16:00 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:21.179 04:16:00 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:21.179 04:16:00 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:21.179 04:16:00 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:21.179 04:16:00 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:21.179 04:16:00 -- setup/hugepages.sh@83 -- # : 256 00:04:21.179 04:16:00 -- setup/hugepages.sh@84 -- # : 1 00:04:21.179 04:16:00 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:21.179 04:16:00 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:21.179 04:16:00 -- setup/hugepages.sh@83 -- # : 0 00:04:21.179 04:16:00 -- setup/hugepages.sh@84 -- # : 0 00:04:21.179 04:16:00 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:21.179 04:16:00 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:21.179 04:16:00 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:21.179 04:16:00 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:21.179 04:16:00 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:21.179 04:16:00 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:21.179 04:16:00 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:21.180 04:16:00 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:21.180 04:16:00 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:21.180 04:16:00 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:21.180 04:16:00 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:21.180 04:16:00 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:21.180 04:16:00 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:21.180 04:16:00 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:21.180 04:16:00 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:21.180 04:16:00 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:21.180 04:16:00 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:21.180 04:16:00 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:21.180 04:16:00 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:21.180 04:16:00 -- setup/hugepages.sh@78 -- # return 0 00:04:21.180 04:16:00 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:21.180 04:16:00 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:21.180 04:16:00 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:21.180 04:16:00 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:21.180 04:16:00 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:21.180 04:16:00 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:21.180 04:16:00 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:21.180 04:16:00 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:21.180 04:16:00 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:21.180 04:16:00 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:21.180 04:16:00 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:21.180 04:16:00 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:21.180 04:16:00 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:21.180 04:16:00 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:21.180 04:16:00 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:21.180 04:16:00 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:21.180 04:16:00 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:21.180 04:16:00 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:21.180 04:16:00 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:21.180 04:16:00 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:21.180 04:16:00 -- setup/hugepages.sh@78 -- # return 0 00:04:21.180 04:16:00 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:21.180 04:16:00 -- setup/hugepages.sh@187 -- # setup output 00:04:21.180 04:16:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:21.180 04:16:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:22.556 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:22.556 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:22.556 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:22.556 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:22.556 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:22.556 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:22.556 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:22.556 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:22.556 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:22.556 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:22.556 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:22.556 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:22.556 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:22.556 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:22.556 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:22.556 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:22.556 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:22.556 04:16:01 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:22.556 04:16:01 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:22.556 04:16:01 -- setup/hugepages.sh@89 -- # local node 00:04:22.556 04:16:01 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:22.556 04:16:01 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:22.556 04:16:01 -- setup/hugepages.sh@92 -- # local surp 00:04:22.556 04:16:01 -- setup/hugepages.sh@93 -- # local resv 00:04:22.556 04:16:01 -- setup/hugepages.sh@94 -- # local anon 00:04:22.556 04:16:01 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:22.556 04:16:01 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:22.556 04:16:01 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:22.556 04:16:01 -- setup/common.sh@18 -- # local node= 00:04:22.556 04:16:01 -- setup/common.sh@19 -- # local var val 00:04:22.556 04:16:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.556 04:16:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.556 04:16:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:22.556 04:16:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:22.556 04:16:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.556 04:16:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.556 04:16:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 41994156 kB' 'MemAvailable: 45773224 kB' 'Buffers: 2708 kB' 'Cached: 12763620 kB' 'SwapCached: 0 kB' 'Active: 9496996 kB' 'Inactive: 3766524 kB' 'Active(anon): 9095224 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500452 kB' 'Mapped: 212228 kB' 'Shmem: 8598032 kB' 'KReclaimable: 209188 kB' 'Slab: 777232 kB' 'SReclaimable: 209188 kB' 'SUnreclaim: 568044 kB' 'KernelStack: 12800 kB' 'PageTables: 7956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 10157404 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198956 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.556 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.556 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.557 04:16:01 -- setup/common.sh@33 -- # echo 0 00:04:22.557 04:16:01 -- setup/common.sh@33 -- # return 0 00:04:22.557 04:16:01 -- setup/hugepages.sh@97 -- # anon=0 00:04:22.557 04:16:01 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:22.557 04:16:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:22.557 04:16:01 -- setup/common.sh@18 -- # local node= 00:04:22.557 04:16:01 -- setup/common.sh@19 -- # local var val 00:04:22.557 04:16:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.557 04:16:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.557 04:16:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:22.557 04:16:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:22.557 04:16:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.557 04:16:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.557 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.557 04:16:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 41994592 kB' 'MemAvailable: 45773660 kB' 'Buffers: 2708 kB' 'Cached: 12763620 kB' 'SwapCached: 0 kB' 'Active: 9499960 kB' 'Inactive: 3766524 kB' 'Active(anon): 9098188 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503364 kB' 'Mapped: 211864 kB' 'Shmem: 8598032 kB' 'KReclaimable: 209188 kB' 'Slab: 777232 kB' 'SReclaimable: 209188 kB' 'SUnreclaim: 568044 kB' 'KernelStack: 12768 kB' 'PageTables: 7828 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 10160056 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198956 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.558 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.558 04:16:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.819 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.819 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.820 04:16:01 -- setup/common.sh@33 -- # echo 0 00:04:22.820 04:16:01 -- setup/common.sh@33 -- # return 0 00:04:22.820 04:16:01 -- setup/hugepages.sh@99 -- # surp=0 00:04:22.820 04:16:01 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:22.820 04:16:01 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:22.820 04:16:01 -- setup/common.sh@18 -- # local node= 00:04:22.820 04:16:01 -- setup/common.sh@19 -- # local var val 00:04:22.820 04:16:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.820 04:16:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.820 04:16:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:22.820 04:16:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:22.820 04:16:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.820 04:16:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 41995824 kB' 'MemAvailable: 45774892 kB' 'Buffers: 2708 kB' 'Cached: 12763636 kB' 'SwapCached: 0 kB' 'Active: 9501304 kB' 'Inactive: 3766524 kB' 'Active(anon): 9099532 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504756 kB' 'Mapped: 212240 kB' 'Shmem: 8598048 kB' 'KReclaimable: 209188 kB' 'Slab: 777272 kB' 'SReclaimable: 209188 kB' 'SUnreclaim: 568084 kB' 'KernelStack: 12752 kB' 'PageTables: 7784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 10162196 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198944 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.820 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.820 04:16:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.821 04:16:01 -- setup/common.sh@33 -- # echo 0 00:04:22.821 04:16:01 -- setup/common.sh@33 -- # return 0 00:04:22.821 04:16:01 -- setup/hugepages.sh@100 -- # resv=0 00:04:22.821 04:16:01 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:22.821 nr_hugepages=1536 00:04:22.821 04:16:01 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:22.821 resv_hugepages=0 00:04:22.821 04:16:01 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:22.821 surplus_hugepages=0 00:04:22.821 04:16:01 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:22.821 anon_hugepages=0 00:04:22.821 04:16:01 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:22.821 04:16:01 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:22.821 04:16:01 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:22.821 04:16:01 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:22.821 04:16:01 -- setup/common.sh@18 -- # local node= 00:04:22.821 04:16:01 -- setup/common.sh@19 -- # local var val 00:04:22.821 04:16:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.821 04:16:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.821 04:16:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:22.821 04:16:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:22.821 04:16:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.821 04:16:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 41994312 kB' 'MemAvailable: 45773380 kB' 'Buffers: 2708 kB' 'Cached: 12763636 kB' 'SwapCached: 0 kB' 'Active: 9495816 kB' 'Inactive: 3766524 kB' 'Active(anon): 9094044 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499228 kB' 'Mapped: 211888 kB' 'Shmem: 8598048 kB' 'KReclaimable: 209188 kB' 'Slab: 777272 kB' 'SReclaimable: 209188 kB' 'SUnreclaim: 568084 kB' 'KernelStack: 12736 kB' 'PageTables: 7736 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 10156092 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198940 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.821 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.821 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.822 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.822 04:16:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.823 04:16:01 -- setup/common.sh@33 -- # echo 1536 00:04:22.823 04:16:01 -- setup/common.sh@33 -- # return 0 00:04:22.823 04:16:01 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:22.823 04:16:01 -- setup/hugepages.sh@112 -- # get_nodes 00:04:22.823 04:16:01 -- setup/hugepages.sh@27 -- # local node 00:04:22.823 04:16:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:22.823 04:16:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:22.823 04:16:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:22.823 04:16:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:22.823 04:16:01 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:22.823 04:16:01 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:22.823 04:16:01 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:22.823 04:16:01 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:22.823 04:16:01 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:22.823 04:16:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:22.823 04:16:01 -- setup/common.sh@18 -- # local node=0 00:04:22.823 04:16:01 -- setup/common.sh@19 -- # local var val 00:04:22.823 04:16:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.823 04:16:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.823 04:16:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:22.823 04:16:01 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:22.823 04:16:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.823 04:16:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28085052 kB' 'MemUsed: 4789872 kB' 'SwapCached: 0 kB' 'Active: 2187232 kB' 'Inactive: 227956 kB' 'Active(anon): 2014008 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 227956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2308780 kB' 'Mapped: 66660 kB' 'AnonPages: 109560 kB' 'Shmem: 1907600 kB' 'KernelStack: 6728 kB' 'PageTables: 3412 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 85764 kB' 'Slab: 393564 kB' 'SReclaimable: 85764 kB' 'SUnreclaim: 307800 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.823 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.823 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.824 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.824 04:16:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@33 -- # echo 0 00:04:22.825 04:16:01 -- setup/common.sh@33 -- # return 0 00:04:22.825 04:16:01 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:22.825 04:16:01 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:22.825 04:16:01 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:22.825 04:16:01 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:22.825 04:16:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:22.825 04:16:01 -- setup/common.sh@18 -- # local node=1 00:04:22.825 04:16:01 -- setup/common.sh@19 -- # local var val 00:04:22.825 04:16:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.825 04:16:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.825 04:16:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:22.825 04:16:01 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:22.825 04:16:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.825 04:16:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 13908252 kB' 'MemUsed: 13752484 kB' 'SwapCached: 0 kB' 'Active: 7308668 kB' 'Inactive: 3538568 kB' 'Active(anon): 7080120 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3538568 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10457592 kB' 'Mapped: 145056 kB' 'AnonPages: 389688 kB' 'Shmem: 6690476 kB' 'KernelStack: 6040 kB' 'PageTables: 4424 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123424 kB' 'Slab: 383704 kB' 'SReclaimable: 123424 kB' 'SUnreclaim: 260280 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.825 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # continue 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 04:16:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 04:16:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 04:16:01 -- setup/common.sh@33 -- # echo 0 00:04:22.827 04:16:01 -- setup/common.sh@33 -- # return 0 00:04:22.827 04:16:01 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:22.827 04:16:01 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:22.827 04:16:01 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:22.827 04:16:01 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:22.827 04:16:01 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:22.827 node0=512 expecting 512 00:04:22.827 04:16:01 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:22.827 04:16:01 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:22.827 04:16:01 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:22.827 04:16:01 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:22.827 node1=1024 expecting 1024 00:04:22.827 04:16:01 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:22.827 00:04:22.827 real 0m1.506s 00:04:22.827 user 0m0.658s 00:04:22.827 sys 0m0.815s 00:04:22.827 04:16:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:22.827 04:16:01 -- common/autotest_common.sh@10 -- # set +x 00:04:22.827 ************************************ 00:04:22.827 END TEST custom_alloc 00:04:22.827 ************************************ 00:04:22.827 04:16:01 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:22.827 04:16:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:22.827 04:16:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:22.827 04:16:01 -- common/autotest_common.sh@10 -- # set +x 00:04:22.827 ************************************ 00:04:22.827 START TEST no_shrink_alloc 00:04:22.827 ************************************ 00:04:22.827 04:16:01 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:22.827 04:16:01 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:22.827 04:16:01 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:22.827 04:16:01 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:22.827 04:16:01 -- setup/hugepages.sh@51 -- # shift 00:04:22.827 04:16:01 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:22.827 04:16:01 -- setup/hugepages.sh@52 -- # local node_ids 00:04:22.827 04:16:01 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:22.827 04:16:01 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:22.827 04:16:01 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:22.827 04:16:01 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:22.827 04:16:01 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:22.827 04:16:01 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:22.827 04:16:01 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:22.827 04:16:01 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:22.827 04:16:01 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:22.827 04:16:01 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:22.827 04:16:01 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:22.827 04:16:01 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:22.827 04:16:01 -- setup/hugepages.sh@73 -- # return 0 00:04:22.827 04:16:01 -- setup/hugepages.sh@198 -- # setup output 00:04:22.827 04:16:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:22.827 04:16:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:24.207 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:24.207 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:24.207 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:24.207 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:24.207 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:24.207 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:24.207 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:24.207 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:24.207 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:24.207 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:24.207 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:24.207 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:24.207 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:24.207 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:24.207 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:24.207 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:24.207 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:24.207 04:16:03 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:24.207 04:16:03 -- setup/hugepages.sh@89 -- # local node 00:04:24.207 04:16:03 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:24.207 04:16:03 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:24.207 04:16:03 -- setup/hugepages.sh@92 -- # local surp 00:04:24.207 04:16:03 -- setup/hugepages.sh@93 -- # local resv 00:04:24.207 04:16:03 -- setup/hugepages.sh@94 -- # local anon 00:04:24.207 04:16:03 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:24.207 04:16:03 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:24.207 04:16:03 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:24.207 04:16:03 -- setup/common.sh@18 -- # local node= 00:04:24.207 04:16:03 -- setup/common.sh@19 -- # local var val 00:04:24.207 04:16:03 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.207 04:16:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.207 04:16:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:24.207 04:16:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:24.207 04:16:03 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.207 04:16:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.207 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.207 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.207 04:16:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43045988 kB' 'MemAvailable: 46825056 kB' 'Buffers: 2708 kB' 'Cached: 12763708 kB' 'SwapCached: 0 kB' 'Active: 9496364 kB' 'Inactive: 3766524 kB' 'Active(anon): 9094592 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499680 kB' 'Mapped: 211784 kB' 'Shmem: 8598120 kB' 'KReclaimable: 209188 kB' 'Slab: 777248 kB' 'SReclaimable: 209188 kB' 'SUnreclaim: 568060 kB' 'KernelStack: 12864 kB' 'PageTables: 8036 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10156136 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198988 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:24.207 04:16:03 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.207 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.207 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.207 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.207 04:16:03 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.207 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.207 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.207 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.207 04:16:03 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.207 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.207 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.207 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.207 04:16:03 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.207 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.207 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.207 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.208 04:16:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.208 04:16:03 -- setup/common.sh@33 -- # echo 0 00:04:24.208 04:16:03 -- setup/common.sh@33 -- # return 0 00:04:24.208 04:16:03 -- setup/hugepages.sh@97 -- # anon=0 00:04:24.208 04:16:03 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:24.208 04:16:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:24.208 04:16:03 -- setup/common.sh@18 -- # local node= 00:04:24.208 04:16:03 -- setup/common.sh@19 -- # local var val 00:04:24.208 04:16:03 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.208 04:16:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.208 04:16:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:24.208 04:16:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:24.208 04:16:03 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.208 04:16:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.208 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43047740 kB' 'MemAvailable: 46826808 kB' 'Buffers: 2708 kB' 'Cached: 12763708 kB' 'SwapCached: 0 kB' 'Active: 9496800 kB' 'Inactive: 3766524 kB' 'Active(anon): 9095028 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500112 kB' 'Mapped: 211792 kB' 'Shmem: 8598120 kB' 'KReclaimable: 209188 kB' 'Slab: 777248 kB' 'SReclaimable: 209188 kB' 'SUnreclaim: 568060 kB' 'KernelStack: 12864 kB' 'PageTables: 8032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10156148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198956 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.209 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.209 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.210 04:16:03 -- setup/common.sh@33 -- # echo 0 00:04:24.210 04:16:03 -- setup/common.sh@33 -- # return 0 00:04:24.210 04:16:03 -- setup/hugepages.sh@99 -- # surp=0 00:04:24.210 04:16:03 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:24.210 04:16:03 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:24.210 04:16:03 -- setup/common.sh@18 -- # local node= 00:04:24.210 04:16:03 -- setup/common.sh@19 -- # local var val 00:04:24.210 04:16:03 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.210 04:16:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.210 04:16:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:24.210 04:16:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:24.210 04:16:03 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.210 04:16:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43047728 kB' 'MemAvailable: 46826796 kB' 'Buffers: 2708 kB' 'Cached: 12763724 kB' 'SwapCached: 0 kB' 'Active: 9496220 kB' 'Inactive: 3766524 kB' 'Active(anon): 9094448 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499544 kB' 'Mapped: 211724 kB' 'Shmem: 8598136 kB' 'KReclaimable: 209188 kB' 'Slab: 777248 kB' 'SReclaimable: 209188 kB' 'SUnreclaim: 568060 kB' 'KernelStack: 12896 kB' 'PageTables: 8072 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10156164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198940 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.210 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.210 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.211 04:16:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.211 04:16:03 -- setup/common.sh@33 -- # echo 0 00:04:24.211 04:16:03 -- setup/common.sh@33 -- # return 0 00:04:24.211 04:16:03 -- setup/hugepages.sh@100 -- # resv=0 00:04:24.211 04:16:03 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:24.211 nr_hugepages=1024 00:04:24.211 04:16:03 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:24.211 resv_hugepages=0 00:04:24.211 04:16:03 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:24.211 surplus_hugepages=0 00:04:24.211 04:16:03 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:24.211 anon_hugepages=0 00:04:24.211 04:16:03 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:24.211 04:16:03 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:24.211 04:16:03 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:24.211 04:16:03 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:24.211 04:16:03 -- setup/common.sh@18 -- # local node= 00:04:24.211 04:16:03 -- setup/common.sh@19 -- # local var val 00:04:24.211 04:16:03 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.211 04:16:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.211 04:16:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:24.211 04:16:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:24.211 04:16:03 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.211 04:16:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.211 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43046720 kB' 'MemAvailable: 46825788 kB' 'Buffers: 2708 kB' 'Cached: 12763736 kB' 'SwapCached: 0 kB' 'Active: 9496244 kB' 'Inactive: 3766524 kB' 'Active(anon): 9094472 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499544 kB' 'Mapped: 211724 kB' 'Shmem: 8598148 kB' 'KReclaimable: 209188 kB' 'Slab: 777248 kB' 'SReclaimable: 209188 kB' 'SUnreclaim: 568060 kB' 'KernelStack: 12896 kB' 'PageTables: 8072 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10156180 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198956 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.212 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.212 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.213 04:16:03 -- setup/common.sh@33 -- # echo 1024 00:04:24.213 04:16:03 -- setup/common.sh@33 -- # return 0 00:04:24.213 04:16:03 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:24.213 04:16:03 -- setup/hugepages.sh@112 -- # get_nodes 00:04:24.213 04:16:03 -- setup/hugepages.sh@27 -- # local node 00:04:24.213 04:16:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:24.213 04:16:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:24.213 04:16:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:24.213 04:16:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:24.213 04:16:03 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:24.213 04:16:03 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:24.213 04:16:03 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:24.213 04:16:03 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:24.213 04:16:03 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:24.213 04:16:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:24.213 04:16:03 -- setup/common.sh@18 -- # local node=0 00:04:24.213 04:16:03 -- setup/common.sh@19 -- # local var val 00:04:24.213 04:16:03 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.213 04:16:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.213 04:16:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:24.213 04:16:03 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:24.213 04:16:03 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.213 04:16:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27048608 kB' 'MemUsed: 5826316 kB' 'SwapCached: 0 kB' 'Active: 2187288 kB' 'Inactive: 227956 kB' 'Active(anon): 2014064 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 227956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2308860 kB' 'Mapped: 66660 kB' 'AnonPages: 109556 kB' 'Shmem: 1907680 kB' 'KernelStack: 6776 kB' 'PageTables: 3600 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 85764 kB' 'Slab: 393540 kB' 'SReclaimable: 85764 kB' 'SUnreclaim: 307776 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.213 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.213 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # continue 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.214 04:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.214 04:16:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.214 04:16:03 -- setup/common.sh@33 -- # echo 0 00:04:24.214 04:16:03 -- setup/common.sh@33 -- # return 0 00:04:24.214 04:16:03 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:24.214 04:16:03 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:24.214 04:16:03 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:24.214 04:16:03 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:24.214 04:16:03 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:24.214 node0=1024 expecting 1024 00:04:24.214 04:16:03 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:24.214 04:16:03 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:24.214 04:16:03 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:24.214 04:16:03 -- setup/hugepages.sh@202 -- # setup output 00:04:24.214 04:16:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:24.214 04:16:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:25.603 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:25.603 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:25.603 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:25.603 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:25.603 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:25.603 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:25.603 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:25.603 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:25.603 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:25.603 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:25.603 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:25.603 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:25.603 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:25.603 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:25.603 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:25.603 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:25.603 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:25.603 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:25.603 04:16:04 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:25.603 04:16:04 -- setup/hugepages.sh@89 -- # local node 00:04:25.603 04:16:04 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:25.603 04:16:04 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:25.603 04:16:04 -- setup/hugepages.sh@92 -- # local surp 00:04:25.603 04:16:04 -- setup/hugepages.sh@93 -- # local resv 00:04:25.603 04:16:04 -- setup/hugepages.sh@94 -- # local anon 00:04:25.603 04:16:04 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:25.603 04:16:04 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:25.603 04:16:04 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:25.603 04:16:04 -- setup/common.sh@18 -- # local node= 00:04:25.603 04:16:04 -- setup/common.sh@19 -- # local var val 00:04:25.603 04:16:04 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.603 04:16:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.603 04:16:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.603 04:16:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.603 04:16:04 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.603 04:16:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.603 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.603 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.603 04:16:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43051764 kB' 'MemAvailable: 46830832 kB' 'Buffers: 2708 kB' 'Cached: 12763788 kB' 'SwapCached: 0 kB' 'Active: 9496956 kB' 'Inactive: 3766524 kB' 'Active(anon): 9095184 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500180 kB' 'Mapped: 211700 kB' 'Shmem: 8598200 kB' 'KReclaimable: 209188 kB' 'Slab: 777140 kB' 'SReclaimable: 209188 kB' 'SUnreclaim: 567952 kB' 'KernelStack: 12912 kB' 'PageTables: 8096 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10155980 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199020 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:25.603 04:16:04 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.603 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.603 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.603 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.603 04:16:04 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.603 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.603 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.603 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.603 04:16:04 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.603 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.603 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.603 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.603 04:16:04 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.603 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.603 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.603 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.604 04:16:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.604 04:16:04 -- setup/common.sh@33 -- # echo 0 00:04:25.604 04:16:04 -- setup/common.sh@33 -- # return 0 00:04:25.604 04:16:04 -- setup/hugepages.sh@97 -- # anon=0 00:04:25.604 04:16:04 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:25.604 04:16:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:25.604 04:16:04 -- setup/common.sh@18 -- # local node= 00:04:25.604 04:16:04 -- setup/common.sh@19 -- # local var val 00:04:25.604 04:16:04 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.604 04:16:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.604 04:16:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.604 04:16:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.604 04:16:04 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.604 04:16:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.604 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43055452 kB' 'MemAvailable: 46834520 kB' 'Buffers: 2708 kB' 'Cached: 12763792 kB' 'SwapCached: 0 kB' 'Active: 9496852 kB' 'Inactive: 3766524 kB' 'Active(anon): 9095080 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500028 kB' 'Mapped: 211704 kB' 'Shmem: 8598204 kB' 'KReclaimable: 209188 kB' 'Slab: 777140 kB' 'SReclaimable: 209188 kB' 'SUnreclaim: 567952 kB' 'KernelStack: 12880 kB' 'PageTables: 7984 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10155996 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199004 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.605 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.605 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.606 04:16:04 -- setup/common.sh@33 -- # echo 0 00:04:25.606 04:16:04 -- setup/common.sh@33 -- # return 0 00:04:25.606 04:16:04 -- setup/hugepages.sh@99 -- # surp=0 00:04:25.606 04:16:04 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:25.606 04:16:04 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:25.606 04:16:04 -- setup/common.sh@18 -- # local node= 00:04:25.606 04:16:04 -- setup/common.sh@19 -- # local var val 00:04:25.606 04:16:04 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.606 04:16:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.606 04:16:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.606 04:16:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.606 04:16:04 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.606 04:16:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43055584 kB' 'MemAvailable: 46834652 kB' 'Buffers: 2708 kB' 'Cached: 12763808 kB' 'SwapCached: 0 kB' 'Active: 9496424 kB' 'Inactive: 3766524 kB' 'Active(anon): 9094652 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499620 kB' 'Mapped: 211728 kB' 'Shmem: 8598220 kB' 'KReclaimable: 209188 kB' 'Slab: 777156 kB' 'SReclaimable: 209188 kB' 'SUnreclaim: 567968 kB' 'KernelStack: 12880 kB' 'PageTables: 7992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10156380 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198988 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.606 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.606 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.607 04:16:04 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.607 04:16:04 -- setup/common.sh@33 -- # echo 0 00:04:25.607 04:16:04 -- setup/common.sh@33 -- # return 0 00:04:25.607 04:16:04 -- setup/hugepages.sh@100 -- # resv=0 00:04:25.607 04:16:04 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:25.607 nr_hugepages=1024 00:04:25.607 04:16:04 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:25.607 resv_hugepages=0 00:04:25.607 04:16:04 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:25.607 surplus_hugepages=0 00:04:25.607 04:16:04 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:25.607 anon_hugepages=0 00:04:25.607 04:16:04 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:25.607 04:16:04 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:25.607 04:16:04 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:25.607 04:16:04 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:25.607 04:16:04 -- setup/common.sh@18 -- # local node= 00:04:25.607 04:16:04 -- setup/common.sh@19 -- # local var val 00:04:25.607 04:16:04 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.607 04:16:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.607 04:16:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.607 04:16:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.607 04:16:04 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.607 04:16:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.607 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43054828 kB' 'MemAvailable: 46833896 kB' 'Buffers: 2708 kB' 'Cached: 12763820 kB' 'SwapCached: 0 kB' 'Active: 9496424 kB' 'Inactive: 3766524 kB' 'Active(anon): 9094652 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499592 kB' 'Mapped: 211728 kB' 'Shmem: 8598232 kB' 'KReclaimable: 209188 kB' 'Slab: 777156 kB' 'SReclaimable: 209188 kB' 'SUnreclaim: 567968 kB' 'KernelStack: 12864 kB' 'PageTables: 7932 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 10156396 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198988 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2592348 kB' 'DirectMap2M: 18298880 kB' 'DirectMap1G: 49283072 kB' 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.608 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.608 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.609 04:16:04 -- setup/common.sh@33 -- # echo 1024 00:04:25.609 04:16:04 -- setup/common.sh@33 -- # return 0 00:04:25.609 04:16:04 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:25.609 04:16:04 -- setup/hugepages.sh@112 -- # get_nodes 00:04:25.609 04:16:04 -- setup/hugepages.sh@27 -- # local node 00:04:25.609 04:16:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:25.609 04:16:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:25.609 04:16:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:25.609 04:16:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:25.609 04:16:04 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:25.609 04:16:04 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:25.609 04:16:04 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:25.609 04:16:04 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:25.609 04:16:04 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:25.609 04:16:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:25.609 04:16:04 -- setup/common.sh@18 -- # local node=0 00:04:25.609 04:16:04 -- setup/common.sh@19 -- # local var val 00:04:25.609 04:16:04 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.609 04:16:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.609 04:16:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:25.609 04:16:04 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:25.609 04:16:04 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.609 04:16:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27051424 kB' 'MemUsed: 5823500 kB' 'SwapCached: 0 kB' 'Active: 2187608 kB' 'Inactive: 227956 kB' 'Active(anon): 2014384 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 227956 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2308932 kB' 'Mapped: 66660 kB' 'AnonPages: 109800 kB' 'Shmem: 1907752 kB' 'KernelStack: 6744 kB' 'PageTables: 3456 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 85764 kB' 'Slab: 393508 kB' 'SReclaimable: 85764 kB' 'SUnreclaim: 307744 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.609 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.609 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # continue 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.610 04:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.610 04:16:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.610 04:16:04 -- setup/common.sh@33 -- # echo 0 00:04:25.610 04:16:04 -- setup/common.sh@33 -- # return 0 00:04:25.610 04:16:04 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:25.610 04:16:04 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:25.610 04:16:04 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:25.610 04:16:04 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:25.610 04:16:04 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:25.610 node0=1024 expecting 1024 00:04:25.610 04:16:04 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:25.610 00:04:25.610 real 0m2.763s 00:04:25.610 user 0m1.141s 00:04:25.610 sys 0m1.550s 00:04:25.610 04:16:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:25.610 04:16:04 -- common/autotest_common.sh@10 -- # set +x 00:04:25.610 ************************************ 00:04:25.610 END TEST no_shrink_alloc 00:04:25.610 ************************************ 00:04:25.610 04:16:04 -- setup/hugepages.sh@217 -- # clear_hp 00:04:25.610 04:16:04 -- setup/hugepages.sh@37 -- # local node hp 00:04:25.610 04:16:04 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:25.610 04:16:04 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:25.610 04:16:04 -- setup/hugepages.sh@41 -- # echo 0 00:04:25.610 04:16:04 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:25.610 04:16:04 -- setup/hugepages.sh@41 -- # echo 0 00:04:25.610 04:16:04 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:25.610 04:16:04 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:25.610 04:16:04 -- setup/hugepages.sh@41 -- # echo 0 00:04:25.610 04:16:04 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:25.610 04:16:04 -- setup/hugepages.sh@41 -- # echo 0 00:04:25.610 04:16:04 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:25.610 04:16:04 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:25.610 00:04:25.610 real 0m11.317s 00:04:25.610 user 0m4.371s 00:04:25.610 sys 0m5.881s 00:04:25.610 04:16:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:25.610 04:16:04 -- common/autotest_common.sh@10 -- # set +x 00:04:25.610 ************************************ 00:04:25.610 END TEST hugepages 00:04:25.610 ************************************ 00:04:25.610 04:16:04 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:25.610 04:16:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:25.610 04:16:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:25.610 04:16:04 -- common/autotest_common.sh@10 -- # set +x 00:04:25.610 ************************************ 00:04:25.610 START TEST driver 00:04:25.610 ************************************ 00:04:25.610 04:16:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:25.610 * Looking for test storage... 00:04:25.610 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:25.610 04:16:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:25.610 04:16:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:25.610 04:16:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:25.869 04:16:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:25.869 04:16:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:25.869 04:16:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:25.869 04:16:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:25.869 04:16:04 -- scripts/common.sh@335 -- # IFS=.-: 00:04:25.869 04:16:04 -- scripts/common.sh@335 -- # read -ra ver1 00:04:25.869 04:16:04 -- scripts/common.sh@336 -- # IFS=.-: 00:04:25.869 04:16:04 -- scripts/common.sh@336 -- # read -ra ver2 00:04:25.869 04:16:04 -- scripts/common.sh@337 -- # local 'op=<' 00:04:25.869 04:16:04 -- scripts/common.sh@339 -- # ver1_l=2 00:04:25.869 04:16:04 -- scripts/common.sh@340 -- # ver2_l=1 00:04:25.869 04:16:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:25.869 04:16:04 -- scripts/common.sh@343 -- # case "$op" in 00:04:25.869 04:16:04 -- scripts/common.sh@344 -- # : 1 00:04:25.869 04:16:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:25.869 04:16:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:25.869 04:16:04 -- scripts/common.sh@364 -- # decimal 1 00:04:25.869 04:16:04 -- scripts/common.sh@352 -- # local d=1 00:04:25.869 04:16:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:25.869 04:16:04 -- scripts/common.sh@354 -- # echo 1 00:04:25.869 04:16:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:25.869 04:16:04 -- scripts/common.sh@365 -- # decimal 2 00:04:25.869 04:16:04 -- scripts/common.sh@352 -- # local d=2 00:04:25.869 04:16:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:25.869 04:16:04 -- scripts/common.sh@354 -- # echo 2 00:04:25.869 04:16:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:25.869 04:16:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:25.869 04:16:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:25.869 04:16:04 -- scripts/common.sh@367 -- # return 0 00:04:25.869 04:16:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:25.869 04:16:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:25.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.869 --rc genhtml_branch_coverage=1 00:04:25.869 --rc genhtml_function_coverage=1 00:04:25.869 --rc genhtml_legend=1 00:04:25.869 --rc geninfo_all_blocks=1 00:04:25.869 --rc geninfo_unexecuted_blocks=1 00:04:25.869 00:04:25.869 ' 00:04:25.869 04:16:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:25.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.869 --rc genhtml_branch_coverage=1 00:04:25.869 --rc genhtml_function_coverage=1 00:04:25.869 --rc genhtml_legend=1 00:04:25.869 --rc geninfo_all_blocks=1 00:04:25.869 --rc geninfo_unexecuted_blocks=1 00:04:25.869 00:04:25.869 ' 00:04:25.869 04:16:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:25.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.869 --rc genhtml_branch_coverage=1 00:04:25.869 --rc genhtml_function_coverage=1 00:04:25.869 --rc genhtml_legend=1 00:04:25.869 --rc geninfo_all_blocks=1 00:04:25.869 --rc geninfo_unexecuted_blocks=1 00:04:25.869 00:04:25.869 ' 00:04:25.869 04:16:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:25.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.869 --rc genhtml_branch_coverage=1 00:04:25.869 --rc genhtml_function_coverage=1 00:04:25.869 --rc genhtml_legend=1 00:04:25.869 --rc geninfo_all_blocks=1 00:04:25.869 --rc geninfo_unexecuted_blocks=1 00:04:25.869 00:04:25.869 ' 00:04:25.869 04:16:04 -- setup/driver.sh@68 -- # setup reset 00:04:25.869 04:16:04 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:25.869 04:16:04 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:28.398 04:16:07 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:28.398 04:16:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.398 04:16:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.398 04:16:07 -- common/autotest_common.sh@10 -- # set +x 00:04:28.398 ************************************ 00:04:28.398 START TEST guess_driver 00:04:28.398 ************************************ 00:04:28.398 04:16:07 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:28.398 04:16:07 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:28.398 04:16:07 -- setup/driver.sh@47 -- # local fail=0 00:04:28.398 04:16:07 -- setup/driver.sh@49 -- # pick_driver 00:04:28.398 04:16:07 -- setup/driver.sh@36 -- # vfio 00:04:28.398 04:16:07 -- setup/driver.sh@21 -- # local iommu_grups 00:04:28.398 04:16:07 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:28.398 04:16:07 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:28.398 04:16:07 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:28.398 04:16:07 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:28.398 04:16:07 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:28.398 04:16:07 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:28.398 04:16:07 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:28.398 04:16:07 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:28.398 04:16:07 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:28.398 04:16:07 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:28.398 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:28.398 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:28.398 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:28.398 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:28.398 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:28.398 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:28.398 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:28.398 04:16:07 -- setup/driver.sh@30 -- # return 0 00:04:28.398 04:16:07 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:28.398 04:16:07 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:28.398 04:16:07 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:28.398 04:16:07 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:28.398 Looking for driver=vfio-pci 00:04:28.398 04:16:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:28.398 04:16:07 -- setup/driver.sh@45 -- # setup output config 00:04:28.398 04:16:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:28.398 04:16:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:29.331 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.331 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.331 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.331 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.331 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.331 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.331 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.331 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.331 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.331 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.331 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.332 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.332 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.332 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.332 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.332 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.332 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.332 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.332 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.332 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.332 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.332 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.332 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.332 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.332 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.332 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.332 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.332 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.332 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.332 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.332 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.332 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.332 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.332 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.332 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.332 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.332 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.332 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.332 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.590 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.590 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.590 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.590 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.590 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.590 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:29.590 04:16:08 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:29.590 04:16:08 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:29.590 04:16:08 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:30.525 04:16:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:30.525 04:16:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:30.525 04:16:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:30.525 04:16:09 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:30.525 04:16:09 -- setup/driver.sh@65 -- # setup reset 00:04:30.525 04:16:09 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:30.525 04:16:09 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:33.055 00:04:33.055 real 0m4.941s 00:04:33.055 user 0m1.133s 00:04:33.055 sys 0m1.963s 00:04:33.055 04:16:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.055 04:16:12 -- common/autotest_common.sh@10 -- # set +x 00:04:33.056 ************************************ 00:04:33.056 END TEST guess_driver 00:04:33.056 ************************************ 00:04:33.056 00:04:33.056 real 0m7.469s 00:04:33.056 user 0m1.769s 00:04:33.056 sys 0m2.921s 00:04:33.056 04:16:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.056 04:16:12 -- common/autotest_common.sh@10 -- # set +x 00:04:33.056 ************************************ 00:04:33.056 END TEST driver 00:04:33.056 ************************************ 00:04:33.056 04:16:12 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:33.056 04:16:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.056 04:16:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.056 04:16:12 -- common/autotest_common.sh@10 -- # set +x 00:04:33.056 ************************************ 00:04:33.056 START TEST devices 00:04:33.056 ************************************ 00:04:33.056 04:16:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:33.056 * Looking for test storage... 00:04:33.056 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:33.056 04:16:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:33.056 04:16:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:33.056 04:16:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:33.314 04:16:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:33.314 04:16:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:33.314 04:16:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:33.314 04:16:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:33.314 04:16:12 -- scripts/common.sh@335 -- # IFS=.-: 00:04:33.314 04:16:12 -- scripts/common.sh@335 -- # read -ra ver1 00:04:33.314 04:16:12 -- scripts/common.sh@336 -- # IFS=.-: 00:04:33.314 04:16:12 -- scripts/common.sh@336 -- # read -ra ver2 00:04:33.314 04:16:12 -- scripts/common.sh@337 -- # local 'op=<' 00:04:33.314 04:16:12 -- scripts/common.sh@339 -- # ver1_l=2 00:04:33.314 04:16:12 -- scripts/common.sh@340 -- # ver2_l=1 00:04:33.314 04:16:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:33.314 04:16:12 -- scripts/common.sh@343 -- # case "$op" in 00:04:33.314 04:16:12 -- scripts/common.sh@344 -- # : 1 00:04:33.314 04:16:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:33.314 04:16:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:33.314 04:16:12 -- scripts/common.sh@364 -- # decimal 1 00:04:33.314 04:16:12 -- scripts/common.sh@352 -- # local d=1 00:04:33.314 04:16:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:33.314 04:16:12 -- scripts/common.sh@354 -- # echo 1 00:04:33.314 04:16:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:33.314 04:16:12 -- scripts/common.sh@365 -- # decimal 2 00:04:33.314 04:16:12 -- scripts/common.sh@352 -- # local d=2 00:04:33.314 04:16:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:33.314 04:16:12 -- scripts/common.sh@354 -- # echo 2 00:04:33.314 04:16:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:33.314 04:16:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:33.314 04:16:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:33.314 04:16:12 -- scripts/common.sh@367 -- # return 0 00:04:33.314 04:16:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:33.314 04:16:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:33.314 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.314 --rc genhtml_branch_coverage=1 00:04:33.314 --rc genhtml_function_coverage=1 00:04:33.314 --rc genhtml_legend=1 00:04:33.314 --rc geninfo_all_blocks=1 00:04:33.314 --rc geninfo_unexecuted_blocks=1 00:04:33.314 00:04:33.314 ' 00:04:33.314 04:16:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:33.314 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.314 --rc genhtml_branch_coverage=1 00:04:33.314 --rc genhtml_function_coverage=1 00:04:33.314 --rc genhtml_legend=1 00:04:33.314 --rc geninfo_all_blocks=1 00:04:33.314 --rc geninfo_unexecuted_blocks=1 00:04:33.314 00:04:33.314 ' 00:04:33.314 04:16:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:33.314 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.314 --rc genhtml_branch_coverage=1 00:04:33.314 --rc genhtml_function_coverage=1 00:04:33.314 --rc genhtml_legend=1 00:04:33.314 --rc geninfo_all_blocks=1 00:04:33.314 --rc geninfo_unexecuted_blocks=1 00:04:33.314 00:04:33.314 ' 00:04:33.314 04:16:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:33.314 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.314 --rc genhtml_branch_coverage=1 00:04:33.314 --rc genhtml_function_coverage=1 00:04:33.314 --rc genhtml_legend=1 00:04:33.314 --rc geninfo_all_blocks=1 00:04:33.314 --rc geninfo_unexecuted_blocks=1 00:04:33.314 00:04:33.314 ' 00:04:33.314 04:16:12 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:33.314 04:16:12 -- setup/devices.sh@192 -- # setup reset 00:04:33.314 04:16:12 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:33.314 04:16:12 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:34.692 04:16:13 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:34.692 04:16:13 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:34.692 04:16:13 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:34.692 04:16:13 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:34.692 04:16:13 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:34.692 04:16:13 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:34.692 04:16:13 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:34.692 04:16:13 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:34.692 04:16:13 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:34.692 04:16:13 -- setup/devices.sh@196 -- # blocks=() 00:04:34.692 04:16:13 -- setup/devices.sh@196 -- # declare -a blocks 00:04:34.692 04:16:13 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:34.692 04:16:13 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:34.692 04:16:13 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:34.692 04:16:13 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:34.692 04:16:13 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:34.692 04:16:13 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:34.692 04:16:13 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:04:34.692 04:16:13 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:34.692 04:16:13 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:34.692 04:16:13 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:04:34.692 04:16:13 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:34.692 No valid GPT data, bailing 00:04:34.692 04:16:13 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:34.692 04:16:13 -- scripts/common.sh@393 -- # pt= 00:04:34.692 04:16:13 -- scripts/common.sh@394 -- # return 1 00:04:34.692 04:16:13 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:34.692 04:16:13 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:34.692 04:16:13 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:34.692 04:16:13 -- setup/common.sh@80 -- # echo 1000204886016 00:04:34.692 04:16:13 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:04:34.692 04:16:13 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:34.692 04:16:13 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:04:34.692 04:16:13 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:34.692 04:16:13 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:34.692 04:16:13 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:34.692 04:16:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.692 04:16:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.692 04:16:13 -- common/autotest_common.sh@10 -- # set +x 00:04:34.692 ************************************ 00:04:34.692 START TEST nvme_mount 00:04:34.692 ************************************ 00:04:34.952 04:16:13 -- common/autotest_common.sh@1114 -- # nvme_mount 00:04:34.952 04:16:13 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:34.952 04:16:13 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:34.952 04:16:13 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:34.952 04:16:13 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:34.952 04:16:13 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:34.952 04:16:13 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:34.952 04:16:13 -- setup/common.sh@40 -- # local part_no=1 00:04:34.952 04:16:13 -- setup/common.sh@41 -- # local size=1073741824 00:04:34.952 04:16:13 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:34.952 04:16:13 -- setup/common.sh@44 -- # parts=() 00:04:34.952 04:16:13 -- setup/common.sh@44 -- # local parts 00:04:34.952 04:16:13 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:34.952 04:16:13 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:34.952 04:16:13 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:34.952 04:16:13 -- setup/common.sh@46 -- # (( part++ )) 00:04:34.952 04:16:13 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:34.952 04:16:13 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:34.952 04:16:13 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:34.952 04:16:13 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:35.889 Creating new GPT entries in memory. 00:04:35.889 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:35.889 other utilities. 00:04:35.889 04:16:14 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:35.889 04:16:14 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:35.889 04:16:14 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:35.889 04:16:14 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:35.889 04:16:14 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:36.824 Creating new GPT entries in memory. 00:04:36.824 The operation has completed successfully. 00:04:36.824 04:16:15 -- setup/common.sh@57 -- # (( part++ )) 00:04:36.824 04:16:15 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:36.824 04:16:15 -- setup/common.sh@62 -- # wait 2778081 00:04:36.824 04:16:15 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:36.824 04:16:15 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:04:36.824 04:16:15 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:36.824 04:16:15 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:04:36.824 04:16:15 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:04:36.824 04:16:16 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:37.083 04:16:16 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:37.083 04:16:16 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:37.083 04:16:16 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:04:37.083 04:16:16 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:37.083 04:16:16 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:37.083 04:16:16 -- setup/devices.sh@53 -- # local found=0 00:04:37.083 04:16:16 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:37.083 04:16:16 -- setup/devices.sh@56 -- # : 00:04:37.083 04:16:16 -- setup/devices.sh@59 -- # local pci status 00:04:37.083 04:16:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.083 04:16:16 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:37.083 04:16:16 -- setup/devices.sh@47 -- # setup output config 00:04:37.083 04:16:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:37.083 04:16:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:38.017 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.017 04:16:17 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:04:38.017 04:16:17 -- setup/devices.sh@63 -- # found=1 00:04:38.017 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.017 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.017 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.017 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.017 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.017 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.017 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.017 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.017 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.017 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.017 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.017 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.017 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.017 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.017 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.017 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.017 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.017 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.017 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.018 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.018 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.018 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.018 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.018 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.018 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.018 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.018 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.018 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.018 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.018 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.018 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.018 04:16:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:38.018 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.276 04:16:17 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:38.276 04:16:17 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:38.276 04:16:17 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.276 04:16:17 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:38.276 04:16:17 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:38.276 04:16:17 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:38.276 04:16:17 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.276 04:16:17 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.276 04:16:17 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:38.276 04:16:17 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:38.276 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:38.276 04:16:17 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:38.276 04:16:17 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:38.535 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:38.535 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:38.535 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:38.535 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:38.535 04:16:17 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:04:38.535 04:16:17 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:04:38.535 04:16:17 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.535 04:16:17 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:04:38.535 04:16:17 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:04:38.535 04:16:17 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.535 04:16:17 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:38.535 04:16:17 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:38.535 04:16:17 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:04:38.535 04:16:17 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.535 04:16:17 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:38.535 04:16:17 -- setup/devices.sh@53 -- # local found=0 00:04:38.535 04:16:17 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:38.535 04:16:17 -- setup/devices.sh@56 -- # : 00:04:38.535 04:16:17 -- setup/devices.sh@59 -- # local pci status 00:04:38.535 04:16:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.535 04:16:17 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:38.535 04:16:17 -- setup/devices.sh@47 -- # setup output config 00:04:38.535 04:16:17 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:38.535 04:16:17 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:39.909 04:16:18 -- setup/devices.sh@63 -- # found=1 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:39.909 04:16:18 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:39.909 04:16:18 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.909 04:16:18 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:39.909 04:16:18 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:39.909 04:16:18 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.909 04:16:18 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:04:39.909 04:16:18 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:39.909 04:16:18 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:39.909 04:16:18 -- setup/devices.sh@50 -- # local mount_point= 00:04:39.909 04:16:18 -- setup/devices.sh@51 -- # local test_file= 00:04:39.909 04:16:18 -- setup/devices.sh@53 -- # local found=0 00:04:39.909 04:16:18 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:39.909 04:16:18 -- setup/devices.sh@59 -- # local pci status 00:04:39.909 04:16:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.909 04:16:18 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:39.909 04:16:18 -- setup/devices.sh@47 -- # setup output config 00:04:39.909 04:16:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:39.909 04:16:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:40.842 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.843 04:16:20 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:04:40.843 04:16:20 -- setup/devices.sh@63 -- # found=1 00:04:40.843 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.843 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.843 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.843 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.843 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.843 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.843 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.843 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.843 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.843 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.843 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.843 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.843 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.843 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.843 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.843 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.843 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.843 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.843 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.843 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.843 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.102 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.102 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.102 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.102 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.102 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.102 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.102 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.102 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.102 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.102 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.102 04:16:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.102 04:16:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.102 04:16:20 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:41.102 04:16:20 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:41.102 04:16:20 -- setup/devices.sh@68 -- # return 0 00:04:41.102 04:16:20 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:41.102 04:16:20 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:41.102 04:16:20 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:41.102 04:16:20 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:41.102 04:16:20 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:41.102 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:41.102 00:04:41.102 real 0m6.344s 00:04:41.102 user 0m1.496s 00:04:41.102 sys 0m2.448s 00:04:41.102 04:16:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:41.102 04:16:20 -- common/autotest_common.sh@10 -- # set +x 00:04:41.102 ************************************ 00:04:41.102 END TEST nvme_mount 00:04:41.102 ************************************ 00:04:41.102 04:16:20 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:41.102 04:16:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:41.102 04:16:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:41.102 04:16:20 -- common/autotest_common.sh@10 -- # set +x 00:04:41.102 ************************************ 00:04:41.102 START TEST dm_mount 00:04:41.102 ************************************ 00:04:41.102 04:16:20 -- common/autotest_common.sh@1114 -- # dm_mount 00:04:41.102 04:16:20 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:41.102 04:16:20 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:41.102 04:16:20 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:41.102 04:16:20 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:41.102 04:16:20 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:41.102 04:16:20 -- setup/common.sh@40 -- # local part_no=2 00:04:41.102 04:16:20 -- setup/common.sh@41 -- # local size=1073741824 00:04:41.102 04:16:20 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:41.102 04:16:20 -- setup/common.sh@44 -- # parts=() 00:04:41.102 04:16:20 -- setup/common.sh@44 -- # local parts 00:04:41.102 04:16:20 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:41.102 04:16:20 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:41.102 04:16:20 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:41.102 04:16:20 -- setup/common.sh@46 -- # (( part++ )) 00:04:41.102 04:16:20 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:41.102 04:16:20 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:41.102 04:16:20 -- setup/common.sh@46 -- # (( part++ )) 00:04:41.102 04:16:20 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:41.102 04:16:20 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:41.102 04:16:20 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:41.102 04:16:20 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:42.479 Creating new GPT entries in memory. 00:04:42.479 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:42.479 other utilities. 00:04:42.479 04:16:21 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:42.479 04:16:21 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:42.479 04:16:21 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:42.479 04:16:21 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:42.479 04:16:21 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:43.417 Creating new GPT entries in memory. 00:04:43.417 The operation has completed successfully. 00:04:43.417 04:16:22 -- setup/common.sh@57 -- # (( part++ )) 00:04:43.417 04:16:22 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:43.417 04:16:22 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:43.417 04:16:22 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:43.417 04:16:22 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:04:44.355 The operation has completed successfully. 00:04:44.355 04:16:23 -- setup/common.sh@57 -- # (( part++ )) 00:04:44.355 04:16:23 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:44.355 04:16:23 -- setup/common.sh@62 -- # wait 2780542 00:04:44.355 04:16:23 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:04:44.355 04:16:23 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:44.355 04:16:23 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:44.355 04:16:23 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:04:44.355 04:16:23 -- setup/devices.sh@160 -- # for t in {1..5} 00:04:44.355 04:16:23 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:44.355 04:16:23 -- setup/devices.sh@161 -- # break 00:04:44.355 04:16:23 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:44.355 04:16:23 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:04:44.355 04:16:23 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:04:44.355 04:16:23 -- setup/devices.sh@166 -- # dm=dm-0 00:04:44.355 04:16:23 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:04:44.355 04:16:23 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:04:44.355 04:16:23 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:44.355 04:16:23 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:04:44.355 04:16:23 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:44.355 04:16:23 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:44.355 04:16:23 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:04:44.355 04:16:23 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:44.355 04:16:23 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:44.355 04:16:23 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:44.355 04:16:23 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:04:44.355 04:16:23 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:44.355 04:16:23 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:44.355 04:16:23 -- setup/devices.sh@53 -- # local found=0 00:04:44.355 04:16:23 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:44.355 04:16:23 -- setup/devices.sh@56 -- # : 00:04:44.355 04:16:23 -- setup/devices.sh@59 -- # local pci status 00:04:44.355 04:16:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:44.355 04:16:23 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:44.355 04:16:23 -- setup/devices.sh@47 -- # setup output config 00:04:44.355 04:16:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:44.355 04:16:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:04:45.730 04:16:24 -- setup/devices.sh@63 -- # found=1 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:45.730 04:16:24 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:04:45.730 04:16:24 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:45.730 04:16:24 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:45.730 04:16:24 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:45.730 04:16:24 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:45.730 04:16:24 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:04:45.730 04:16:24 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:45.730 04:16:24 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:04:45.730 04:16:24 -- setup/devices.sh@50 -- # local mount_point= 00:04:45.730 04:16:24 -- setup/devices.sh@51 -- # local test_file= 00:04:45.730 04:16:24 -- setup/devices.sh@53 -- # local found=0 00:04:45.730 04:16:24 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:45.730 04:16:24 -- setup/devices.sh@59 -- # local pci status 00:04:45.730 04:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.730 04:16:24 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:45.730 04:16:24 -- setup/devices.sh@47 -- # setup output config 00:04:45.730 04:16:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.730 04:16:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:04:46.724 04:16:25 -- setup/devices.sh@63 -- # found=1 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.724 04:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:46.724 04:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.982 04:16:26 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:46.982 04:16:26 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:46.982 04:16:26 -- setup/devices.sh@68 -- # return 0 00:04:46.982 04:16:26 -- setup/devices.sh@187 -- # cleanup_dm 00:04:46.982 04:16:26 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:46.982 04:16:26 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:46.982 04:16:26 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:46.982 04:16:26 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:46.982 04:16:26 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:46.982 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:46.982 04:16:26 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:46.982 04:16:26 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:46.982 00:04:46.982 real 0m5.855s 00:04:46.982 user 0m0.953s 00:04:46.982 sys 0m1.765s 00:04:46.982 04:16:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.982 04:16:26 -- common/autotest_common.sh@10 -- # set +x 00:04:46.982 ************************************ 00:04:46.982 END TEST dm_mount 00:04:46.982 ************************************ 00:04:46.982 04:16:26 -- setup/devices.sh@1 -- # cleanup 00:04:46.982 04:16:26 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:46.982 04:16:26 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:46.982 04:16:26 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:46.982 04:16:26 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:46.982 04:16:26 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:46.982 04:16:26 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:47.240 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:47.240 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:47.240 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:47.240 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:47.240 04:16:26 -- setup/devices.sh@12 -- # cleanup_dm 00:04:47.240 04:16:26 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:47.240 04:16:26 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:47.240 04:16:26 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:47.240 04:16:26 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:47.240 04:16:26 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:47.240 04:16:26 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:47.240 00:04:47.240 real 0m14.238s 00:04:47.240 user 0m3.182s 00:04:47.241 sys 0m5.292s 00:04:47.241 04:16:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.241 04:16:26 -- common/autotest_common.sh@10 -- # set +x 00:04:47.241 ************************************ 00:04:47.241 END TEST devices 00:04:47.241 ************************************ 00:04:47.499 00:04:47.499 real 0m43.841s 00:04:47.499 user 0m12.802s 00:04:47.499 sys 0m19.558s 00:04:47.499 04:16:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.499 04:16:26 -- common/autotest_common.sh@10 -- # set +x 00:04:47.499 ************************************ 00:04:47.499 END TEST setup.sh 00:04:47.499 ************************************ 00:04:47.499 04:16:26 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:48.433 Hugepages 00:04:48.433 node hugesize free / total 00:04:48.433 node0 1048576kB 0 / 0 00:04:48.433 node0 2048kB 2048 / 2048 00:04:48.433 node1 1048576kB 0 / 0 00:04:48.433 node1 2048kB 0 / 0 00:04:48.433 00:04:48.433 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:48.433 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:04:48.433 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:04:48.433 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:04:48.433 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:04:48.433 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:04:48.433 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:04:48.433 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:04:48.433 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:04:48.433 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:04:48.433 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:04:48.433 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:04:48.433 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:04:48.433 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:04:48.433 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:04:48.433 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:04:48.691 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:04:48.691 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:04:48.691 04:16:27 -- spdk/autotest.sh@128 -- # uname -s 00:04:48.691 04:16:27 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:04:48.691 04:16:27 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:04:48.691 04:16:27 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:50.069 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:50.069 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:50.069 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:50.069 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:50.069 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:50.069 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:50.069 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:50.069 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:50.069 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:50.069 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:50.069 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:50.069 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:50.069 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:50.069 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:50.069 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:50.069 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:51.005 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:51.005 04:16:30 -- common/autotest_common.sh@1527 -- # sleep 1 00:04:51.943 04:16:31 -- common/autotest_common.sh@1528 -- # bdfs=() 00:04:51.943 04:16:31 -- common/autotest_common.sh@1528 -- # local bdfs 00:04:51.943 04:16:31 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:04:51.943 04:16:31 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:04:51.943 04:16:31 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:51.943 04:16:31 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:51.943 04:16:31 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:51.943 04:16:31 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:51.943 04:16:31 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:51.943 04:16:31 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:51.943 04:16:31 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:51.943 04:16:31 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:53.319 Waiting for block devices as requested 00:04:53.319 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:04:53.319 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:53.578 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:53.578 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:53.578 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:53.578 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:53.838 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:53.838 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:53.838 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:53.838 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:54.097 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:54.097 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:54.097 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:54.097 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:54.356 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:54.356 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:54.356 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:54.614 04:16:33 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:04:54.614 04:16:33 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:04:54.614 04:16:33 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:04:54.614 04:16:33 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:04:54.614 04:16:33 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:54.614 04:16:33 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:04:54.614 04:16:33 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:54.614 04:16:33 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:04:54.614 04:16:33 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:04:54.614 04:16:33 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:04:54.614 04:16:33 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:04:54.614 04:16:33 -- common/autotest_common.sh@1540 -- # grep oacs 00:04:54.614 04:16:33 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:04:54.614 04:16:33 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:04:54.614 04:16:33 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:04:54.614 04:16:33 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:04:54.614 04:16:33 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:04:54.614 04:16:33 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:04:54.614 04:16:33 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:04:54.614 04:16:33 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:04:54.614 04:16:33 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:04:54.614 04:16:33 -- common/autotest_common.sh@1552 -- # continue 00:04:54.614 04:16:33 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:04:54.614 04:16:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:54.614 04:16:33 -- common/autotest_common.sh@10 -- # set +x 00:04:54.614 04:16:33 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:04:54.614 04:16:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:54.614 04:16:33 -- common/autotest_common.sh@10 -- # set +x 00:04:54.614 04:16:33 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:55.990 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:55.990 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:55.990 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:55.990 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:55.990 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:55.990 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:55.990 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:55.990 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:55.990 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:55.990 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:55.990 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:55.990 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:55.990 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:55.990 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:55.990 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:55.990 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:56.924 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:56.924 04:16:35 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:04:56.924 04:16:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:56.924 04:16:35 -- common/autotest_common.sh@10 -- # set +x 00:04:56.924 04:16:35 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:04:56.924 04:16:35 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:04:56.924 04:16:35 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:04:56.924 04:16:35 -- common/autotest_common.sh@1572 -- # bdfs=() 00:04:56.924 04:16:35 -- common/autotest_common.sh@1572 -- # local bdfs 00:04:56.924 04:16:35 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:04:56.924 04:16:35 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:56.924 04:16:35 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:56.924 04:16:35 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:56.924 04:16:36 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:56.924 04:16:36 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:56.924 04:16:36 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:56.924 04:16:36 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:56.924 04:16:36 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:04:56.924 04:16:36 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:04:56.924 04:16:36 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:04:56.924 04:16:36 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:56.924 04:16:36 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:04:56.924 04:16:36 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:04:56.924 04:16:36 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:04:56.924 04:16:36 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=2785970 00:04:56.924 04:16:36 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:56.924 04:16:36 -- common/autotest_common.sh@1593 -- # waitforlisten 2785970 00:04:56.924 04:16:36 -- common/autotest_common.sh@829 -- # '[' -z 2785970 ']' 00:04:56.924 04:16:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:56.924 04:16:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:56.924 04:16:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:56.924 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:56.924 04:16:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:56.924 04:16:36 -- common/autotest_common.sh@10 -- # set +x 00:04:56.924 [2024-11-26 04:16:36.114740] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:04:56.924 [2024-11-26 04:16:36.114821] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2785970 ] 00:04:56.924 EAL: No free 2048 kB hugepages reported on node 1 00:04:57.183 [2024-11-26 04:16:36.175806] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:57.183 [2024-11-26 04:16:36.267585] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:57.183 [2024-11-26 04:16:36.267813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:58.117 04:16:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:58.117 04:16:37 -- common/autotest_common.sh@862 -- # return 0 00:04:58.117 04:16:37 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:04:58.117 04:16:37 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:04:58.117 04:16:37 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:01.402 nvme0n1 00:05:01.403 04:16:40 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:01.403 [2024-11-26 04:16:40.462044] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:01.403 [2024-11-26 04:16:40.462105] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:01.403 request: 00:05:01.403 { 00:05:01.403 "nvme_ctrlr_name": "nvme0", 00:05:01.403 "password": "test", 00:05:01.403 "method": "bdev_nvme_opal_revert", 00:05:01.403 "req_id": 1 00:05:01.403 } 00:05:01.403 Got JSON-RPC error response 00:05:01.403 response: 00:05:01.403 { 00:05:01.403 "code": -32603, 00:05:01.403 "message": "Internal error" 00:05:01.403 } 00:05:01.403 04:16:40 -- common/autotest_common.sh@1599 -- # true 00:05:01.403 04:16:40 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:01.403 04:16:40 -- common/autotest_common.sh@1603 -- # killprocess 2785970 00:05:01.403 04:16:40 -- common/autotest_common.sh@936 -- # '[' -z 2785970 ']' 00:05:01.403 04:16:40 -- common/autotest_common.sh@940 -- # kill -0 2785970 00:05:01.403 04:16:40 -- common/autotest_common.sh@941 -- # uname 00:05:01.403 04:16:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:01.403 04:16:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2785970 00:05:01.403 04:16:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:01.403 04:16:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:01.403 04:16:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2785970' 00:05:01.403 killing process with pid 2785970 00:05:01.403 04:16:40 -- common/autotest_common.sh@955 -- # kill 2785970 00:05:01.403 04:16:40 -- common/autotest_common.sh@960 -- # wait 2785970 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.403 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.404 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:01.663 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:03.563 04:16:42 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:03.563 04:16:42 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:03.563 04:16:42 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:03.563 04:16:42 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:03.563 04:16:42 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:03.563 04:16:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:03.563 04:16:42 -- common/autotest_common.sh@10 -- # set +x 00:05:03.563 04:16:42 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:03.563 04:16:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:03.563 04:16:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.563 04:16:42 -- common/autotest_common.sh@10 -- # set +x 00:05:03.563 ************************************ 00:05:03.563 START TEST env 00:05:03.563 ************************************ 00:05:03.563 04:16:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:03.563 * Looking for test storage... 00:05:03.563 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:03.563 04:16:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:03.563 04:16:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:03.563 04:16:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:03.563 04:16:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:03.563 04:16:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:03.563 04:16:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:03.563 04:16:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:03.563 04:16:42 -- scripts/common.sh@335 -- # IFS=.-: 00:05:03.563 04:16:42 -- scripts/common.sh@335 -- # read -ra ver1 00:05:03.563 04:16:42 -- scripts/common.sh@336 -- # IFS=.-: 00:05:03.563 04:16:42 -- scripts/common.sh@336 -- # read -ra ver2 00:05:03.563 04:16:42 -- scripts/common.sh@337 -- # local 'op=<' 00:05:03.563 04:16:42 -- scripts/common.sh@339 -- # ver1_l=2 00:05:03.563 04:16:42 -- scripts/common.sh@340 -- # ver2_l=1 00:05:03.563 04:16:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:03.563 04:16:42 -- scripts/common.sh@343 -- # case "$op" in 00:05:03.563 04:16:42 -- scripts/common.sh@344 -- # : 1 00:05:03.563 04:16:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:03.563 04:16:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:03.563 04:16:42 -- scripts/common.sh@364 -- # decimal 1 00:05:03.563 04:16:42 -- scripts/common.sh@352 -- # local d=1 00:05:03.563 04:16:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:03.563 04:16:42 -- scripts/common.sh@354 -- # echo 1 00:05:03.563 04:16:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:03.563 04:16:42 -- scripts/common.sh@365 -- # decimal 2 00:05:03.563 04:16:42 -- scripts/common.sh@352 -- # local d=2 00:05:03.563 04:16:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:03.563 04:16:42 -- scripts/common.sh@354 -- # echo 2 00:05:03.563 04:16:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:03.563 04:16:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:03.563 04:16:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:03.563 04:16:42 -- scripts/common.sh@367 -- # return 0 00:05:03.563 04:16:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:03.563 04:16:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:03.563 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:03.563 --rc genhtml_branch_coverage=1 00:05:03.563 --rc genhtml_function_coverage=1 00:05:03.563 --rc genhtml_legend=1 00:05:03.563 --rc geninfo_all_blocks=1 00:05:03.563 --rc geninfo_unexecuted_blocks=1 00:05:03.563 00:05:03.563 ' 00:05:03.563 04:16:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:03.563 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:03.563 --rc genhtml_branch_coverage=1 00:05:03.563 --rc genhtml_function_coverage=1 00:05:03.564 --rc genhtml_legend=1 00:05:03.564 --rc geninfo_all_blocks=1 00:05:03.564 --rc geninfo_unexecuted_blocks=1 00:05:03.564 00:05:03.564 ' 00:05:03.564 04:16:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:03.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:03.564 --rc genhtml_branch_coverage=1 00:05:03.564 --rc genhtml_function_coverage=1 00:05:03.564 --rc genhtml_legend=1 00:05:03.564 --rc geninfo_all_blocks=1 00:05:03.564 --rc geninfo_unexecuted_blocks=1 00:05:03.564 00:05:03.564 ' 00:05:03.564 04:16:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:03.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:03.564 --rc genhtml_branch_coverage=1 00:05:03.564 --rc genhtml_function_coverage=1 00:05:03.564 --rc genhtml_legend=1 00:05:03.564 --rc geninfo_all_blocks=1 00:05:03.564 --rc geninfo_unexecuted_blocks=1 00:05:03.564 00:05:03.564 ' 00:05:03.564 04:16:42 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:03.564 04:16:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:03.564 04:16:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.564 04:16:42 -- common/autotest_common.sh@10 -- # set +x 00:05:03.564 ************************************ 00:05:03.564 START TEST env_memory 00:05:03.564 ************************************ 00:05:03.564 04:16:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:03.564 00:05:03.564 00:05:03.564 CUnit - A unit testing framework for C - Version 2.1-3 00:05:03.564 http://cunit.sourceforge.net/ 00:05:03.564 00:05:03.564 00:05:03.564 Suite: memory 00:05:03.564 Test: alloc and free memory map ...[2024-11-26 04:16:42.507986] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:03.564 passed 00:05:03.564 Test: mem map translation ...[2024-11-26 04:16:42.528792] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:03.564 [2024-11-26 04:16:42.528815] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:03.564 [2024-11-26 04:16:42.528859] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:03.564 [2024-11-26 04:16:42.528870] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:03.564 passed 00:05:03.564 Test: mem map registration ...[2024-11-26 04:16:42.571968] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:03.564 [2024-11-26 04:16:42.572002] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:03.564 passed 00:05:03.564 Test: mem map adjacent registrations ...passed 00:05:03.564 00:05:03.564 Run Summary: Type Total Ran Passed Failed Inactive 00:05:03.564 suites 1 1 n/a 0 0 00:05:03.564 tests 4 4 4 0 0 00:05:03.564 asserts 152 152 152 0 n/a 00:05:03.564 00:05:03.564 Elapsed time = 0.154 seconds 00:05:03.564 00:05:03.564 real 0m0.163s 00:05:03.564 user 0m0.155s 00:05:03.564 sys 0m0.007s 00:05:03.564 04:16:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:03.564 04:16:42 -- common/autotest_common.sh@10 -- # set +x 00:05:03.564 ************************************ 00:05:03.564 END TEST env_memory 00:05:03.564 ************************************ 00:05:03.564 04:16:42 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:03.564 04:16:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:03.564 04:16:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.564 04:16:42 -- common/autotest_common.sh@10 -- # set +x 00:05:03.564 ************************************ 00:05:03.564 START TEST env_vtophys 00:05:03.564 ************************************ 00:05:03.564 04:16:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:03.564 EAL: lib.eal log level changed from notice to debug 00:05:03.564 EAL: Detected lcore 0 as core 0 on socket 0 00:05:03.564 EAL: Detected lcore 1 as core 1 on socket 0 00:05:03.564 EAL: Detected lcore 2 as core 2 on socket 0 00:05:03.564 EAL: Detected lcore 3 as core 3 on socket 0 00:05:03.564 EAL: Detected lcore 4 as core 4 on socket 0 00:05:03.564 EAL: Detected lcore 5 as core 5 on socket 0 00:05:03.564 EAL: Detected lcore 6 as core 8 on socket 0 00:05:03.564 EAL: Detected lcore 7 as core 9 on socket 0 00:05:03.564 EAL: Detected lcore 8 as core 10 on socket 0 00:05:03.564 EAL: Detected lcore 9 as core 11 on socket 0 00:05:03.564 EAL: Detected lcore 10 as core 12 on socket 0 00:05:03.564 EAL: Detected lcore 11 as core 13 on socket 0 00:05:03.564 EAL: Detected lcore 12 as core 0 on socket 1 00:05:03.564 EAL: Detected lcore 13 as core 1 on socket 1 00:05:03.564 EAL: Detected lcore 14 as core 2 on socket 1 00:05:03.564 EAL: Detected lcore 15 as core 3 on socket 1 00:05:03.564 EAL: Detected lcore 16 as core 4 on socket 1 00:05:03.564 EAL: Detected lcore 17 as core 5 on socket 1 00:05:03.564 EAL: Detected lcore 18 as core 8 on socket 1 00:05:03.564 EAL: Detected lcore 19 as core 9 on socket 1 00:05:03.564 EAL: Detected lcore 20 as core 10 on socket 1 00:05:03.564 EAL: Detected lcore 21 as core 11 on socket 1 00:05:03.564 EAL: Detected lcore 22 as core 12 on socket 1 00:05:03.564 EAL: Detected lcore 23 as core 13 on socket 1 00:05:03.564 EAL: Detected lcore 24 as core 0 on socket 0 00:05:03.564 EAL: Detected lcore 25 as core 1 on socket 0 00:05:03.564 EAL: Detected lcore 26 as core 2 on socket 0 00:05:03.564 EAL: Detected lcore 27 as core 3 on socket 0 00:05:03.564 EAL: Detected lcore 28 as core 4 on socket 0 00:05:03.564 EAL: Detected lcore 29 as core 5 on socket 0 00:05:03.564 EAL: Detected lcore 30 as core 8 on socket 0 00:05:03.564 EAL: Detected lcore 31 as core 9 on socket 0 00:05:03.564 EAL: Detected lcore 32 as core 10 on socket 0 00:05:03.564 EAL: Detected lcore 33 as core 11 on socket 0 00:05:03.564 EAL: Detected lcore 34 as core 12 on socket 0 00:05:03.564 EAL: Detected lcore 35 as core 13 on socket 0 00:05:03.564 EAL: Detected lcore 36 as core 0 on socket 1 00:05:03.564 EAL: Detected lcore 37 as core 1 on socket 1 00:05:03.564 EAL: Detected lcore 38 as core 2 on socket 1 00:05:03.564 EAL: Detected lcore 39 as core 3 on socket 1 00:05:03.564 EAL: Detected lcore 40 as core 4 on socket 1 00:05:03.564 EAL: Detected lcore 41 as core 5 on socket 1 00:05:03.564 EAL: Detected lcore 42 as core 8 on socket 1 00:05:03.564 EAL: Detected lcore 43 as core 9 on socket 1 00:05:03.564 EAL: Detected lcore 44 as core 10 on socket 1 00:05:03.564 EAL: Detected lcore 45 as core 11 on socket 1 00:05:03.564 EAL: Detected lcore 46 as core 12 on socket 1 00:05:03.564 EAL: Detected lcore 47 as core 13 on socket 1 00:05:03.564 EAL: Maximum logical cores by configuration: 128 00:05:03.564 EAL: Detected CPU lcores: 48 00:05:03.564 EAL: Detected NUMA nodes: 2 00:05:03.564 EAL: Checking presence of .so 'librte_eal.so.23.0' 00:05:03.564 EAL: Detected shared linkage of DPDK 00:05:03.564 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23.0 00:05:03.564 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23.0 00:05:03.564 EAL: Registered [vdev] bus. 00:05:03.564 EAL: bus.vdev log level changed from disabled to notice 00:05:03.564 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23.0 00:05:03.564 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23.0 00:05:03.564 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:03.564 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:03.564 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:05:03.564 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:05:03.564 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:05:03.564 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:05:03.564 EAL: No shared files mode enabled, IPC will be disabled 00:05:03.564 EAL: No shared files mode enabled, IPC is disabled 00:05:03.564 EAL: Bus pci wants IOVA as 'DC' 00:05:03.564 EAL: Bus vdev wants IOVA as 'DC' 00:05:03.564 EAL: Buses did not request a specific IOVA mode. 00:05:03.564 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:03.564 EAL: Selected IOVA mode 'VA' 00:05:03.564 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.564 EAL: Probing VFIO support... 00:05:03.564 EAL: IOMMU type 1 (Type 1) is supported 00:05:03.564 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:03.564 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:03.564 EAL: VFIO support initialized 00:05:03.564 EAL: Ask a virtual area of 0x2e000 bytes 00:05:03.564 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:03.564 EAL: Setting up physically contiguous memory... 00:05:03.564 EAL: Setting maximum number of open files to 524288 00:05:03.564 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:03.564 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:03.564 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:03.564 EAL: Ask a virtual area of 0x61000 bytes 00:05:03.564 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:03.564 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:03.564 EAL: Ask a virtual area of 0x400000000 bytes 00:05:03.564 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:03.564 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:03.564 EAL: Ask a virtual area of 0x61000 bytes 00:05:03.564 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:03.564 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:03.564 EAL: Ask a virtual area of 0x400000000 bytes 00:05:03.564 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:03.564 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:03.564 EAL: Ask a virtual area of 0x61000 bytes 00:05:03.564 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:03.564 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:03.564 EAL: Ask a virtual area of 0x400000000 bytes 00:05:03.565 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:03.565 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:03.565 EAL: Ask a virtual area of 0x61000 bytes 00:05:03.565 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:03.565 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:03.565 EAL: Ask a virtual area of 0x400000000 bytes 00:05:03.565 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:03.565 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:03.565 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:03.565 EAL: Ask a virtual area of 0x61000 bytes 00:05:03.565 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:03.565 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:03.565 EAL: Ask a virtual area of 0x400000000 bytes 00:05:03.565 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:03.565 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:03.565 EAL: Ask a virtual area of 0x61000 bytes 00:05:03.565 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:03.565 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:03.565 EAL: Ask a virtual area of 0x400000000 bytes 00:05:03.565 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:03.565 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:03.565 EAL: Ask a virtual area of 0x61000 bytes 00:05:03.565 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:03.565 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:03.565 EAL: Ask a virtual area of 0x400000000 bytes 00:05:03.565 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:03.565 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:03.565 EAL: Ask a virtual area of 0x61000 bytes 00:05:03.565 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:03.565 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:03.565 EAL: Ask a virtual area of 0x400000000 bytes 00:05:03.565 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:03.565 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:03.565 EAL: Hugepages will be freed exactly as allocated. 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: TSC frequency is ~2700000 KHz 00:05:03.565 EAL: Main lcore 0 is ready (tid=7f93cf43ea00;cpuset=[0]) 00:05:03.565 EAL: Trying to obtain current memory policy. 00:05:03.565 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:03.565 EAL: Restoring previous memory policy: 0 00:05:03.565 EAL: request: mp_malloc_sync 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: Heap on socket 0 was expanded by 2MB 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:03.565 EAL: Mem event callback 'spdk:(nil)' registered 00:05:03.565 00:05:03.565 00:05:03.565 CUnit - A unit testing framework for C - Version 2.1-3 00:05:03.565 http://cunit.sourceforge.net/ 00:05:03.565 00:05:03.565 00:05:03.565 Suite: components_suite 00:05:03.565 Test: vtophys_malloc_test ...passed 00:05:03.565 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:03.565 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:03.565 EAL: Restoring previous memory policy: 4 00:05:03.565 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.565 EAL: request: mp_malloc_sync 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: Heap on socket 0 was expanded by 4MB 00:05:03.565 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.565 EAL: request: mp_malloc_sync 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: Heap on socket 0 was shrunk by 4MB 00:05:03.565 EAL: Trying to obtain current memory policy. 00:05:03.565 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:03.565 EAL: Restoring previous memory policy: 4 00:05:03.565 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.565 EAL: request: mp_malloc_sync 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: Heap on socket 0 was expanded by 6MB 00:05:03.565 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.565 EAL: request: mp_malloc_sync 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: Heap on socket 0 was shrunk by 6MB 00:05:03.565 EAL: Trying to obtain current memory policy. 00:05:03.565 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:03.565 EAL: Restoring previous memory policy: 4 00:05:03.565 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.565 EAL: request: mp_malloc_sync 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: Heap on socket 0 was expanded by 10MB 00:05:03.565 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.565 EAL: request: mp_malloc_sync 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: Heap on socket 0 was shrunk by 10MB 00:05:03.565 EAL: Trying to obtain current memory policy. 00:05:03.565 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:03.565 EAL: Restoring previous memory policy: 4 00:05:03.565 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.565 EAL: request: mp_malloc_sync 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: Heap on socket 0 was expanded by 18MB 00:05:03.565 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.565 EAL: request: mp_malloc_sync 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: Heap on socket 0 was shrunk by 18MB 00:05:03.565 EAL: Trying to obtain current memory policy. 00:05:03.565 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:03.565 EAL: Restoring previous memory policy: 4 00:05:03.565 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.565 EAL: request: mp_malloc_sync 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: Heap on socket 0 was expanded by 34MB 00:05:03.565 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.565 EAL: request: mp_malloc_sync 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: Heap on socket 0 was shrunk by 34MB 00:05:03.565 EAL: Trying to obtain current memory policy. 00:05:03.565 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:03.565 EAL: Restoring previous memory policy: 4 00:05:03.565 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.565 EAL: request: mp_malloc_sync 00:05:03.565 EAL: No shared files mode enabled, IPC is disabled 00:05:03.565 EAL: Heap on socket 0 was expanded by 66MB 00:05:03.823 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.823 EAL: request: mp_malloc_sync 00:05:03.823 EAL: No shared files mode enabled, IPC is disabled 00:05:03.823 EAL: Heap on socket 0 was shrunk by 66MB 00:05:03.823 EAL: Trying to obtain current memory policy. 00:05:03.823 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:03.823 EAL: Restoring previous memory policy: 4 00:05:03.823 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.823 EAL: request: mp_malloc_sync 00:05:03.823 EAL: No shared files mode enabled, IPC is disabled 00:05:03.823 EAL: Heap on socket 0 was expanded by 130MB 00:05:03.823 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.823 EAL: request: mp_malloc_sync 00:05:03.823 EAL: No shared files mode enabled, IPC is disabled 00:05:03.823 EAL: Heap on socket 0 was shrunk by 130MB 00:05:03.823 EAL: Trying to obtain current memory policy. 00:05:03.823 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:03.823 EAL: Restoring previous memory policy: 4 00:05:03.823 EAL: Calling mem event callback 'spdk:(nil)' 00:05:03.823 EAL: request: mp_malloc_sync 00:05:03.823 EAL: No shared files mode enabled, IPC is disabled 00:05:03.823 EAL: Heap on socket 0 was expanded by 258MB 00:05:03.823 EAL: Calling mem event callback 'spdk:(nil)' 00:05:04.081 EAL: request: mp_malloc_sync 00:05:04.081 EAL: No shared files mode enabled, IPC is disabled 00:05:04.081 EAL: Heap on socket 0 was shrunk by 258MB 00:05:04.081 EAL: Trying to obtain current memory policy. 00:05:04.081 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:04.081 EAL: Restoring previous memory policy: 4 00:05:04.081 EAL: Calling mem event callback 'spdk:(nil)' 00:05:04.081 EAL: request: mp_malloc_sync 00:05:04.081 EAL: No shared files mode enabled, IPC is disabled 00:05:04.081 EAL: Heap on socket 0 was expanded by 514MB 00:05:04.081 EAL: Calling mem event callback 'spdk:(nil)' 00:05:04.339 EAL: request: mp_malloc_sync 00:05:04.339 EAL: No shared files mode enabled, IPC is disabled 00:05:04.339 EAL: Heap on socket 0 was shrunk by 514MB 00:05:04.339 EAL: Trying to obtain current memory policy. 00:05:04.339 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:04.598 EAL: Restoring previous memory policy: 4 00:05:04.598 EAL: Calling mem event callback 'spdk:(nil)' 00:05:04.598 EAL: request: mp_malloc_sync 00:05:04.598 EAL: No shared files mode enabled, IPC is disabled 00:05:04.598 EAL: Heap on socket 0 was expanded by 1026MB 00:05:04.856 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.115 EAL: request: mp_malloc_sync 00:05:05.115 EAL: No shared files mode enabled, IPC is disabled 00:05:05.115 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:05.115 passed 00:05:05.115 00:05:05.115 Run Summary: Type Total Ran Passed Failed Inactive 00:05:05.115 suites 1 1 n/a 0 0 00:05:05.115 tests 2 2 2 0 0 00:05:05.115 asserts 497 497 497 0 n/a 00:05:05.115 00:05:05.115 Elapsed time = 1.351 seconds 00:05:05.115 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.115 EAL: request: mp_malloc_sync 00:05:05.115 EAL: No shared files mode enabled, IPC is disabled 00:05:05.115 EAL: Heap on socket 0 was shrunk by 2MB 00:05:05.115 EAL: No shared files mode enabled, IPC is disabled 00:05:05.115 EAL: No shared files mode enabled, IPC is disabled 00:05:05.115 EAL: No shared files mode enabled, IPC is disabled 00:05:05.115 00:05:05.115 real 0m1.480s 00:05:05.115 user 0m0.837s 00:05:05.115 sys 0m0.599s 00:05:05.115 04:16:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.115 04:16:44 -- common/autotest_common.sh@10 -- # set +x 00:05:05.115 ************************************ 00:05:05.115 END TEST env_vtophys 00:05:05.115 ************************************ 00:05:05.115 04:16:44 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:05.115 04:16:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.115 04:16:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.115 04:16:44 -- common/autotest_common.sh@10 -- # set +x 00:05:05.116 ************************************ 00:05:05.116 START TEST env_pci 00:05:05.116 ************************************ 00:05:05.116 04:16:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:05.116 00:05:05.116 00:05:05.116 CUnit - A unit testing framework for C - Version 2.1-3 00:05:05.116 http://cunit.sourceforge.net/ 00:05:05.116 00:05:05.116 00:05:05.116 Suite: pci 00:05:05.116 Test: pci_hook ...[2024-11-26 04:16:44.174366] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 2787021 has claimed it 00:05:05.116 EAL: Cannot find device (10000:00:01.0) 00:05:05.116 EAL: Failed to attach device on primary process 00:05:05.116 passed 00:05:05.116 00:05:05.116 Run Summary: Type Total Ran Passed Failed Inactive 00:05:05.116 suites 1 1 n/a 0 0 00:05:05.116 tests 1 1 1 0 0 00:05:05.116 asserts 25 25 25 0 n/a 00:05:05.116 00:05:05.116 Elapsed time = 0.021 seconds 00:05:05.116 00:05:05.116 real 0m0.033s 00:05:05.116 user 0m0.007s 00:05:05.116 sys 0m0.026s 00:05:05.116 04:16:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.116 04:16:44 -- common/autotest_common.sh@10 -- # set +x 00:05:05.116 ************************************ 00:05:05.116 END TEST env_pci 00:05:05.116 ************************************ 00:05:05.116 04:16:44 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:05.116 04:16:44 -- env/env.sh@15 -- # uname 00:05:05.116 04:16:44 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:05.116 04:16:44 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:05.116 04:16:44 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:05.116 04:16:44 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:05.116 04:16:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.116 04:16:44 -- common/autotest_common.sh@10 -- # set +x 00:05:05.116 ************************************ 00:05:05.116 START TEST env_dpdk_post_init 00:05:05.116 ************************************ 00:05:05.116 04:16:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:05.116 EAL: Detected CPU lcores: 48 00:05:05.116 EAL: Detected NUMA nodes: 2 00:05:05.116 EAL: Detected shared linkage of DPDK 00:05:05.116 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:05.116 EAL: Selected IOVA mode 'VA' 00:05:05.116 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.116 EAL: VFIO support initialized 00:05:05.116 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:05.116 EAL: Using IOMMU type 1 (Type 1) 00:05:05.116 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:05.375 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:05.375 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:05.375 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:05.375 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:05.376 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:05.376 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:05.376 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:05.376 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:05.376 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:05.376 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:05.376 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:05.376 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:05.376 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:05.376 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:05.376 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:06.308 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:09.589 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:09.589 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:09.589 Starting DPDK initialization... 00:05:09.589 Starting SPDK post initialization... 00:05:09.589 SPDK NVMe probe 00:05:09.589 Attaching to 0000:88:00.0 00:05:09.589 Attached to 0000:88:00.0 00:05:09.589 Cleaning up... 00:05:09.589 00:05:09.589 real 0m4.394s 00:05:09.589 user 0m3.262s 00:05:09.589 sys 0m0.189s 00:05:09.589 04:16:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:09.589 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:05:09.589 ************************************ 00:05:09.589 END TEST env_dpdk_post_init 00:05:09.589 ************************************ 00:05:09.589 04:16:48 -- env/env.sh@26 -- # uname 00:05:09.589 04:16:48 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:09.589 04:16:48 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:09.589 04:16:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:09.589 04:16:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:09.589 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:05:09.589 ************************************ 00:05:09.589 START TEST env_mem_callbacks 00:05:09.589 ************************************ 00:05:09.589 04:16:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:09.589 EAL: Detected CPU lcores: 48 00:05:09.589 EAL: Detected NUMA nodes: 2 00:05:09.589 EAL: Detected shared linkage of DPDK 00:05:09.589 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:09.589 EAL: Selected IOVA mode 'VA' 00:05:09.589 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.589 EAL: VFIO support initialized 00:05:09.589 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:09.589 00:05:09.589 00:05:09.589 CUnit - A unit testing framework for C - Version 2.1-3 00:05:09.589 http://cunit.sourceforge.net/ 00:05:09.589 00:05:09.589 00:05:09.589 Suite: memory 00:05:09.589 Test: test ... 00:05:09.589 register 0x200000200000 2097152 00:05:09.589 malloc 3145728 00:05:09.589 register 0x200000400000 4194304 00:05:09.589 buf 0x200000500000 len 3145728 PASSED 00:05:09.589 malloc 64 00:05:09.589 buf 0x2000004fff40 len 64 PASSED 00:05:09.589 malloc 4194304 00:05:09.589 register 0x200000800000 6291456 00:05:09.589 buf 0x200000a00000 len 4194304 PASSED 00:05:09.589 free 0x200000500000 3145728 00:05:09.589 free 0x2000004fff40 64 00:05:09.589 unregister 0x200000400000 4194304 PASSED 00:05:09.589 free 0x200000a00000 4194304 00:05:09.589 unregister 0x200000800000 6291456 PASSED 00:05:09.589 malloc 8388608 00:05:09.589 register 0x200000400000 10485760 00:05:09.589 buf 0x200000600000 len 8388608 PASSED 00:05:09.589 free 0x200000600000 8388608 00:05:09.589 unregister 0x200000400000 10485760 PASSED 00:05:09.589 passed 00:05:09.589 00:05:09.589 Run Summary: Type Total Ran Passed Failed Inactive 00:05:09.589 suites 1 1 n/a 0 0 00:05:09.589 tests 1 1 1 0 0 00:05:09.589 asserts 15 15 15 0 n/a 00:05:09.589 00:05:09.589 Elapsed time = 0.005 seconds 00:05:09.589 00:05:09.589 real 0m0.048s 00:05:09.589 user 0m0.011s 00:05:09.589 sys 0m0.037s 00:05:09.589 04:16:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:09.589 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:05:09.589 ************************************ 00:05:09.589 END TEST env_mem_callbacks 00:05:09.589 ************************************ 00:05:09.589 00:05:09.589 real 0m6.381s 00:05:09.589 user 0m4.425s 00:05:09.589 sys 0m0.996s 00:05:09.589 04:16:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:09.589 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:05:09.589 ************************************ 00:05:09.589 END TEST env 00:05:09.589 ************************************ 00:05:09.589 04:16:48 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:09.589 04:16:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:09.589 04:16:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:09.589 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:05:09.589 ************************************ 00:05:09.589 START TEST rpc 00:05:09.589 ************************************ 00:05:09.589 04:16:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:09.589 * Looking for test storage... 00:05:09.589 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:09.589 04:16:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:09.589 04:16:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:09.589 04:16:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:09.847 04:16:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:09.847 04:16:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:09.847 04:16:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:09.847 04:16:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:09.847 04:16:48 -- scripts/common.sh@335 -- # IFS=.-: 00:05:09.847 04:16:48 -- scripts/common.sh@335 -- # read -ra ver1 00:05:09.847 04:16:48 -- scripts/common.sh@336 -- # IFS=.-: 00:05:09.847 04:16:48 -- scripts/common.sh@336 -- # read -ra ver2 00:05:09.847 04:16:48 -- scripts/common.sh@337 -- # local 'op=<' 00:05:09.847 04:16:48 -- scripts/common.sh@339 -- # ver1_l=2 00:05:09.847 04:16:48 -- scripts/common.sh@340 -- # ver2_l=1 00:05:09.847 04:16:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:09.847 04:16:48 -- scripts/common.sh@343 -- # case "$op" in 00:05:09.847 04:16:48 -- scripts/common.sh@344 -- # : 1 00:05:09.847 04:16:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:09.847 04:16:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:09.847 04:16:48 -- scripts/common.sh@364 -- # decimal 1 00:05:09.847 04:16:48 -- scripts/common.sh@352 -- # local d=1 00:05:09.847 04:16:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:09.847 04:16:48 -- scripts/common.sh@354 -- # echo 1 00:05:09.847 04:16:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:09.847 04:16:48 -- scripts/common.sh@365 -- # decimal 2 00:05:09.847 04:16:48 -- scripts/common.sh@352 -- # local d=2 00:05:09.847 04:16:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:09.847 04:16:48 -- scripts/common.sh@354 -- # echo 2 00:05:09.847 04:16:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:09.848 04:16:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:09.848 04:16:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:09.848 04:16:48 -- scripts/common.sh@367 -- # return 0 00:05:09.848 04:16:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:09.848 04:16:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:09.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:09.848 --rc genhtml_branch_coverage=1 00:05:09.848 --rc genhtml_function_coverage=1 00:05:09.848 --rc genhtml_legend=1 00:05:09.848 --rc geninfo_all_blocks=1 00:05:09.848 --rc geninfo_unexecuted_blocks=1 00:05:09.848 00:05:09.848 ' 00:05:09.848 04:16:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:09.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:09.848 --rc genhtml_branch_coverage=1 00:05:09.848 --rc genhtml_function_coverage=1 00:05:09.848 --rc genhtml_legend=1 00:05:09.848 --rc geninfo_all_blocks=1 00:05:09.848 --rc geninfo_unexecuted_blocks=1 00:05:09.848 00:05:09.848 ' 00:05:09.848 04:16:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:09.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:09.848 --rc genhtml_branch_coverage=1 00:05:09.848 --rc genhtml_function_coverage=1 00:05:09.848 --rc genhtml_legend=1 00:05:09.848 --rc geninfo_all_blocks=1 00:05:09.848 --rc geninfo_unexecuted_blocks=1 00:05:09.848 00:05:09.848 ' 00:05:09.848 04:16:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:09.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:09.848 --rc genhtml_branch_coverage=1 00:05:09.848 --rc genhtml_function_coverage=1 00:05:09.848 --rc genhtml_legend=1 00:05:09.848 --rc geninfo_all_blocks=1 00:05:09.848 --rc geninfo_unexecuted_blocks=1 00:05:09.848 00:05:09.848 ' 00:05:09.848 04:16:48 -- rpc/rpc.sh@65 -- # spdk_pid=2787694 00:05:09.848 04:16:48 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:09.848 04:16:48 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:09.848 04:16:48 -- rpc/rpc.sh@67 -- # waitforlisten 2787694 00:05:09.848 04:16:48 -- common/autotest_common.sh@829 -- # '[' -z 2787694 ']' 00:05:09.848 04:16:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:09.848 04:16:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:09.848 04:16:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:09.848 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:09.848 04:16:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:09.848 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:05:09.848 [2024-11-26 04:16:48.921937] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:09.848 [2024-11-26 04:16:48.922042] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2787694 ] 00:05:09.848 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.848 [2024-11-26 04:16:48.978379] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.848 [2024-11-26 04:16:49.064738] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:09.848 [2024-11-26 04:16:49.064918] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:09.848 [2024-11-26 04:16:49.064940] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 2787694' to capture a snapshot of events at runtime. 00:05:09.848 [2024-11-26 04:16:49.064956] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid2787694 for offline analysis/debug. 00:05:09.848 [2024-11-26 04:16:49.064989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.787 04:16:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.787 04:16:49 -- common/autotest_common.sh@862 -- # return 0 00:05:10.787 04:16:49 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:10.787 04:16:49 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:10.787 04:16:49 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:10.787 04:16:49 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:10.787 04:16:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.787 04:16:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.787 04:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:10.787 ************************************ 00:05:10.787 START TEST rpc_integrity 00:05:10.787 ************************************ 00:05:10.787 04:16:49 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:10.787 04:16:49 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:10.787 04:16:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:10.787 04:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:10.787 04:16:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:10.787 04:16:49 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:10.787 04:16:49 -- rpc/rpc.sh@13 -- # jq length 00:05:10.787 04:16:49 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:10.787 04:16:49 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:10.787 04:16:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:10.787 04:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:10.787 04:16:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:10.787 04:16:49 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:10.787 04:16:49 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:10.787 04:16:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:10.787 04:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:10.787 04:16:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:10.787 04:16:49 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:10.787 { 00:05:10.787 "name": "Malloc0", 00:05:10.787 "aliases": [ 00:05:10.787 "55daaa9c-1998-4f28-9b4f-f10246e81910" 00:05:10.787 ], 00:05:10.787 "product_name": "Malloc disk", 00:05:10.787 "block_size": 512, 00:05:10.787 "num_blocks": 16384, 00:05:10.787 "uuid": "55daaa9c-1998-4f28-9b4f-f10246e81910", 00:05:10.787 "assigned_rate_limits": { 00:05:10.787 "rw_ios_per_sec": 0, 00:05:10.787 "rw_mbytes_per_sec": 0, 00:05:10.787 "r_mbytes_per_sec": 0, 00:05:10.787 "w_mbytes_per_sec": 0 00:05:10.787 }, 00:05:10.787 "claimed": false, 00:05:10.787 "zoned": false, 00:05:10.787 "supported_io_types": { 00:05:10.787 "read": true, 00:05:10.787 "write": true, 00:05:10.787 "unmap": true, 00:05:10.787 "write_zeroes": true, 00:05:10.787 "flush": true, 00:05:10.787 "reset": true, 00:05:10.787 "compare": false, 00:05:10.787 "compare_and_write": false, 00:05:10.787 "abort": true, 00:05:10.787 "nvme_admin": false, 00:05:10.787 "nvme_io": false 00:05:10.787 }, 00:05:10.787 "memory_domains": [ 00:05:10.787 { 00:05:10.787 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:10.787 "dma_device_type": 2 00:05:10.787 } 00:05:10.787 ], 00:05:10.787 "driver_specific": {} 00:05:10.787 } 00:05:10.787 ]' 00:05:10.787 04:16:49 -- rpc/rpc.sh@17 -- # jq length 00:05:10.787 04:16:49 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:10.787 04:16:49 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:10.787 04:16:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:10.787 04:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:10.787 [2024-11-26 04:16:49.986815] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:10.787 [2024-11-26 04:16:49.986866] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:10.787 [2024-11-26 04:16:49.986891] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xba9b20 00:05:10.787 [2024-11-26 04:16:49.986905] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:10.787 [2024-11-26 04:16:49.988374] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:10.787 [2024-11-26 04:16:49.988404] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:10.787 Passthru0 00:05:10.787 04:16:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:10.787 04:16:49 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:10.787 04:16:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:10.787 04:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:10.787 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:10.787 04:16:50 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:10.787 { 00:05:10.787 "name": "Malloc0", 00:05:10.787 "aliases": [ 00:05:10.787 "55daaa9c-1998-4f28-9b4f-f10246e81910" 00:05:10.787 ], 00:05:10.787 "product_name": "Malloc disk", 00:05:10.787 "block_size": 512, 00:05:10.787 "num_blocks": 16384, 00:05:10.787 "uuid": "55daaa9c-1998-4f28-9b4f-f10246e81910", 00:05:10.787 "assigned_rate_limits": { 00:05:10.787 "rw_ios_per_sec": 0, 00:05:10.787 "rw_mbytes_per_sec": 0, 00:05:10.787 "r_mbytes_per_sec": 0, 00:05:10.787 "w_mbytes_per_sec": 0 00:05:10.787 }, 00:05:10.787 "claimed": true, 00:05:10.787 "claim_type": "exclusive_write", 00:05:10.787 "zoned": false, 00:05:10.787 "supported_io_types": { 00:05:10.787 "read": true, 00:05:10.787 "write": true, 00:05:10.787 "unmap": true, 00:05:10.787 "write_zeroes": true, 00:05:10.787 "flush": true, 00:05:10.787 "reset": true, 00:05:10.787 "compare": false, 00:05:10.787 "compare_and_write": false, 00:05:10.787 "abort": true, 00:05:10.787 "nvme_admin": false, 00:05:10.787 "nvme_io": false 00:05:10.787 }, 00:05:10.787 "memory_domains": [ 00:05:10.787 { 00:05:10.787 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:10.787 "dma_device_type": 2 00:05:10.787 } 00:05:10.787 ], 00:05:10.787 "driver_specific": {} 00:05:10.787 }, 00:05:10.787 { 00:05:10.787 "name": "Passthru0", 00:05:10.787 "aliases": [ 00:05:10.787 "7483de76-469f-523a-9c8f-8c775af19190" 00:05:10.787 ], 00:05:10.787 "product_name": "passthru", 00:05:10.787 "block_size": 512, 00:05:10.787 "num_blocks": 16384, 00:05:10.787 "uuid": "7483de76-469f-523a-9c8f-8c775af19190", 00:05:10.787 "assigned_rate_limits": { 00:05:10.787 "rw_ios_per_sec": 0, 00:05:10.787 "rw_mbytes_per_sec": 0, 00:05:10.787 "r_mbytes_per_sec": 0, 00:05:10.787 "w_mbytes_per_sec": 0 00:05:10.787 }, 00:05:10.787 "claimed": false, 00:05:10.787 "zoned": false, 00:05:10.787 "supported_io_types": { 00:05:10.787 "read": true, 00:05:10.787 "write": true, 00:05:10.787 "unmap": true, 00:05:10.787 "write_zeroes": true, 00:05:10.787 "flush": true, 00:05:10.787 "reset": true, 00:05:10.787 "compare": false, 00:05:10.787 "compare_and_write": false, 00:05:10.787 "abort": true, 00:05:10.787 "nvme_admin": false, 00:05:10.787 "nvme_io": false 00:05:10.787 }, 00:05:10.787 "memory_domains": [ 00:05:10.787 { 00:05:10.787 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:10.787 "dma_device_type": 2 00:05:10.787 } 00:05:10.787 ], 00:05:10.787 "driver_specific": { 00:05:10.787 "passthru": { 00:05:10.787 "name": "Passthru0", 00:05:10.787 "base_bdev_name": "Malloc0" 00:05:10.787 } 00:05:10.787 } 00:05:10.787 } 00:05:10.787 ]' 00:05:10.787 04:16:50 -- rpc/rpc.sh@21 -- # jq length 00:05:11.047 04:16:50 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:11.047 04:16:50 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:11.047 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.047 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.047 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.047 04:16:50 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:11.047 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.047 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.047 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.047 04:16:50 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:11.047 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.047 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.047 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.047 04:16:50 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:11.047 04:16:50 -- rpc/rpc.sh@26 -- # jq length 00:05:11.047 04:16:50 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:11.047 00:05:11.047 real 0m0.231s 00:05:11.047 user 0m0.151s 00:05:11.047 sys 0m0.018s 00:05:11.047 04:16:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.047 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.047 ************************************ 00:05:11.047 END TEST rpc_integrity 00:05:11.047 ************************************ 00:05:11.047 04:16:50 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:11.047 04:16:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:11.047 04:16:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.047 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.047 ************************************ 00:05:11.047 START TEST rpc_plugins 00:05:11.047 ************************************ 00:05:11.047 04:16:50 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:11.047 04:16:50 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:11.047 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.047 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.047 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.047 04:16:50 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:11.047 04:16:50 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:11.047 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.047 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.047 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.047 04:16:50 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:11.047 { 00:05:11.047 "name": "Malloc1", 00:05:11.047 "aliases": [ 00:05:11.047 "307ad83c-2168-45ca-8d2f-61e842847fa5" 00:05:11.047 ], 00:05:11.047 "product_name": "Malloc disk", 00:05:11.047 "block_size": 4096, 00:05:11.047 "num_blocks": 256, 00:05:11.047 "uuid": "307ad83c-2168-45ca-8d2f-61e842847fa5", 00:05:11.047 "assigned_rate_limits": { 00:05:11.047 "rw_ios_per_sec": 0, 00:05:11.047 "rw_mbytes_per_sec": 0, 00:05:11.047 "r_mbytes_per_sec": 0, 00:05:11.047 "w_mbytes_per_sec": 0 00:05:11.047 }, 00:05:11.047 "claimed": false, 00:05:11.047 "zoned": false, 00:05:11.047 "supported_io_types": { 00:05:11.047 "read": true, 00:05:11.047 "write": true, 00:05:11.047 "unmap": true, 00:05:11.047 "write_zeroes": true, 00:05:11.047 "flush": true, 00:05:11.047 "reset": true, 00:05:11.047 "compare": false, 00:05:11.047 "compare_and_write": false, 00:05:11.047 "abort": true, 00:05:11.047 "nvme_admin": false, 00:05:11.047 "nvme_io": false 00:05:11.047 }, 00:05:11.047 "memory_domains": [ 00:05:11.047 { 00:05:11.047 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:11.047 "dma_device_type": 2 00:05:11.047 } 00:05:11.047 ], 00:05:11.047 "driver_specific": {} 00:05:11.047 } 00:05:11.047 ]' 00:05:11.047 04:16:50 -- rpc/rpc.sh@32 -- # jq length 00:05:11.047 04:16:50 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:11.047 04:16:50 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:11.047 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.047 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.047 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.047 04:16:50 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:11.047 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.047 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.047 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.047 04:16:50 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:11.047 04:16:50 -- rpc/rpc.sh@36 -- # jq length 00:05:11.047 04:16:50 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:11.047 00:05:11.047 real 0m0.114s 00:05:11.047 user 0m0.074s 00:05:11.047 sys 0m0.011s 00:05:11.047 04:16:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.047 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.047 ************************************ 00:05:11.047 END TEST rpc_plugins 00:05:11.047 ************************************ 00:05:11.306 04:16:50 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:11.306 04:16:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:11.306 04:16:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.306 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.306 ************************************ 00:05:11.306 START TEST rpc_trace_cmd_test 00:05:11.306 ************************************ 00:05:11.306 04:16:50 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:11.306 04:16:50 -- rpc/rpc.sh@40 -- # local info 00:05:11.306 04:16:50 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:11.306 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.306 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.306 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.306 04:16:50 -- rpc/rpc.sh@42 -- # info='{ 00:05:11.306 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid2787694", 00:05:11.306 "tpoint_group_mask": "0x8", 00:05:11.306 "iscsi_conn": { 00:05:11.306 "mask": "0x2", 00:05:11.306 "tpoint_mask": "0x0" 00:05:11.306 }, 00:05:11.306 "scsi": { 00:05:11.306 "mask": "0x4", 00:05:11.306 "tpoint_mask": "0x0" 00:05:11.306 }, 00:05:11.306 "bdev": { 00:05:11.306 "mask": "0x8", 00:05:11.306 "tpoint_mask": "0xffffffffffffffff" 00:05:11.306 }, 00:05:11.306 "nvmf_rdma": { 00:05:11.306 "mask": "0x10", 00:05:11.306 "tpoint_mask": "0x0" 00:05:11.306 }, 00:05:11.306 "nvmf_tcp": { 00:05:11.306 "mask": "0x20", 00:05:11.306 "tpoint_mask": "0x0" 00:05:11.306 }, 00:05:11.306 "ftl": { 00:05:11.306 "mask": "0x40", 00:05:11.306 "tpoint_mask": "0x0" 00:05:11.306 }, 00:05:11.306 "blobfs": { 00:05:11.306 "mask": "0x80", 00:05:11.306 "tpoint_mask": "0x0" 00:05:11.306 }, 00:05:11.306 "dsa": { 00:05:11.306 "mask": "0x200", 00:05:11.306 "tpoint_mask": "0x0" 00:05:11.306 }, 00:05:11.306 "thread": { 00:05:11.306 "mask": "0x400", 00:05:11.306 "tpoint_mask": "0x0" 00:05:11.306 }, 00:05:11.306 "nvme_pcie": { 00:05:11.306 "mask": "0x800", 00:05:11.306 "tpoint_mask": "0x0" 00:05:11.306 }, 00:05:11.306 "iaa": { 00:05:11.306 "mask": "0x1000", 00:05:11.306 "tpoint_mask": "0x0" 00:05:11.306 }, 00:05:11.306 "nvme_tcp": { 00:05:11.306 "mask": "0x2000", 00:05:11.306 "tpoint_mask": "0x0" 00:05:11.306 }, 00:05:11.306 "bdev_nvme": { 00:05:11.306 "mask": "0x4000", 00:05:11.306 "tpoint_mask": "0x0" 00:05:11.306 } 00:05:11.306 }' 00:05:11.306 04:16:50 -- rpc/rpc.sh@43 -- # jq length 00:05:11.306 04:16:50 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:11.306 04:16:50 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:11.306 04:16:50 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:11.306 04:16:50 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:11.306 04:16:50 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:11.306 04:16:50 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:11.306 04:16:50 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:11.306 04:16:50 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:11.306 04:16:50 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:11.306 00:05:11.306 real 0m0.195s 00:05:11.306 user 0m0.177s 00:05:11.306 sys 0m0.012s 00:05:11.306 04:16:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.306 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.306 ************************************ 00:05:11.306 END TEST rpc_trace_cmd_test 00:05:11.306 ************************************ 00:05:11.306 04:16:50 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:11.306 04:16:50 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:11.306 04:16:50 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:11.306 04:16:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:11.306 04:16:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.306 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.306 ************************************ 00:05:11.306 START TEST rpc_daemon_integrity 00:05:11.306 ************************************ 00:05:11.306 04:16:50 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:11.306 04:16:50 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:11.306 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.306 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.306 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.306 04:16:50 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:11.306 04:16:50 -- rpc/rpc.sh@13 -- # jq length 00:05:11.565 04:16:50 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:11.565 04:16:50 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:11.565 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.565 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.565 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.565 04:16:50 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:11.565 04:16:50 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:11.565 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.565 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.565 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.565 04:16:50 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:11.565 { 00:05:11.565 "name": "Malloc2", 00:05:11.565 "aliases": [ 00:05:11.565 "6c842905-0da9-45be-bf8a-04e8e95c729c" 00:05:11.565 ], 00:05:11.565 "product_name": "Malloc disk", 00:05:11.565 "block_size": 512, 00:05:11.565 "num_blocks": 16384, 00:05:11.565 "uuid": "6c842905-0da9-45be-bf8a-04e8e95c729c", 00:05:11.565 "assigned_rate_limits": { 00:05:11.565 "rw_ios_per_sec": 0, 00:05:11.565 "rw_mbytes_per_sec": 0, 00:05:11.565 "r_mbytes_per_sec": 0, 00:05:11.565 "w_mbytes_per_sec": 0 00:05:11.565 }, 00:05:11.565 "claimed": false, 00:05:11.565 "zoned": false, 00:05:11.565 "supported_io_types": { 00:05:11.565 "read": true, 00:05:11.565 "write": true, 00:05:11.565 "unmap": true, 00:05:11.565 "write_zeroes": true, 00:05:11.565 "flush": true, 00:05:11.565 "reset": true, 00:05:11.565 "compare": false, 00:05:11.565 "compare_and_write": false, 00:05:11.565 "abort": true, 00:05:11.565 "nvme_admin": false, 00:05:11.565 "nvme_io": false 00:05:11.565 }, 00:05:11.565 "memory_domains": [ 00:05:11.565 { 00:05:11.565 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:11.565 "dma_device_type": 2 00:05:11.565 } 00:05:11.565 ], 00:05:11.565 "driver_specific": {} 00:05:11.565 } 00:05:11.565 ]' 00:05:11.565 04:16:50 -- rpc/rpc.sh@17 -- # jq length 00:05:11.565 04:16:50 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:11.565 04:16:50 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:11.565 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.565 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.565 [2024-11-26 04:16:50.604637] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:11.565 [2024-11-26 04:16:50.604696] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:11.565 [2024-11-26 04:16:50.604743] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xba8ec0 00:05:11.565 [2024-11-26 04:16:50.604759] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:11.565 [2024-11-26 04:16:50.606106] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:11.565 [2024-11-26 04:16:50.606136] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:11.565 Passthru0 00:05:11.565 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.565 04:16:50 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:11.565 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.565 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.565 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.565 04:16:50 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:11.565 { 00:05:11.565 "name": "Malloc2", 00:05:11.565 "aliases": [ 00:05:11.565 "6c842905-0da9-45be-bf8a-04e8e95c729c" 00:05:11.565 ], 00:05:11.565 "product_name": "Malloc disk", 00:05:11.565 "block_size": 512, 00:05:11.565 "num_blocks": 16384, 00:05:11.565 "uuid": "6c842905-0da9-45be-bf8a-04e8e95c729c", 00:05:11.565 "assigned_rate_limits": { 00:05:11.565 "rw_ios_per_sec": 0, 00:05:11.565 "rw_mbytes_per_sec": 0, 00:05:11.565 "r_mbytes_per_sec": 0, 00:05:11.565 "w_mbytes_per_sec": 0 00:05:11.565 }, 00:05:11.565 "claimed": true, 00:05:11.565 "claim_type": "exclusive_write", 00:05:11.565 "zoned": false, 00:05:11.565 "supported_io_types": { 00:05:11.565 "read": true, 00:05:11.565 "write": true, 00:05:11.565 "unmap": true, 00:05:11.565 "write_zeroes": true, 00:05:11.565 "flush": true, 00:05:11.565 "reset": true, 00:05:11.565 "compare": false, 00:05:11.565 "compare_and_write": false, 00:05:11.565 "abort": true, 00:05:11.565 "nvme_admin": false, 00:05:11.565 "nvme_io": false 00:05:11.565 }, 00:05:11.565 "memory_domains": [ 00:05:11.565 { 00:05:11.565 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:11.565 "dma_device_type": 2 00:05:11.565 } 00:05:11.565 ], 00:05:11.565 "driver_specific": {} 00:05:11.565 }, 00:05:11.565 { 00:05:11.565 "name": "Passthru0", 00:05:11.565 "aliases": [ 00:05:11.565 "12b47d42-2f6a-5011-ad68-0d238f941c22" 00:05:11.565 ], 00:05:11.565 "product_name": "passthru", 00:05:11.565 "block_size": 512, 00:05:11.565 "num_blocks": 16384, 00:05:11.565 "uuid": "12b47d42-2f6a-5011-ad68-0d238f941c22", 00:05:11.565 "assigned_rate_limits": { 00:05:11.565 "rw_ios_per_sec": 0, 00:05:11.565 "rw_mbytes_per_sec": 0, 00:05:11.565 "r_mbytes_per_sec": 0, 00:05:11.565 "w_mbytes_per_sec": 0 00:05:11.565 }, 00:05:11.565 "claimed": false, 00:05:11.565 "zoned": false, 00:05:11.565 "supported_io_types": { 00:05:11.565 "read": true, 00:05:11.565 "write": true, 00:05:11.565 "unmap": true, 00:05:11.565 "write_zeroes": true, 00:05:11.565 "flush": true, 00:05:11.565 "reset": true, 00:05:11.565 "compare": false, 00:05:11.565 "compare_and_write": false, 00:05:11.565 "abort": true, 00:05:11.565 "nvme_admin": false, 00:05:11.565 "nvme_io": false 00:05:11.565 }, 00:05:11.565 "memory_domains": [ 00:05:11.565 { 00:05:11.565 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:11.565 "dma_device_type": 2 00:05:11.565 } 00:05:11.565 ], 00:05:11.565 "driver_specific": { 00:05:11.565 "passthru": { 00:05:11.565 "name": "Passthru0", 00:05:11.565 "base_bdev_name": "Malloc2" 00:05:11.565 } 00:05:11.565 } 00:05:11.565 } 00:05:11.565 ]' 00:05:11.565 04:16:50 -- rpc/rpc.sh@21 -- # jq length 00:05:11.565 04:16:50 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:11.565 04:16:50 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:11.565 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.565 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.565 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.565 04:16:50 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:11.565 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.565 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.565 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.565 04:16:50 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:11.565 04:16:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:11.565 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.565 04:16:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:11.565 04:16:50 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:11.565 04:16:50 -- rpc/rpc.sh@26 -- # jq length 00:05:11.565 04:16:50 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:11.565 00:05:11.565 real 0m0.225s 00:05:11.565 user 0m0.149s 00:05:11.565 sys 0m0.019s 00:05:11.565 04:16:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.565 04:16:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.565 ************************************ 00:05:11.565 END TEST rpc_daemon_integrity 00:05:11.565 ************************************ 00:05:11.565 04:16:50 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:11.565 04:16:50 -- rpc/rpc.sh@84 -- # killprocess 2787694 00:05:11.565 04:16:50 -- common/autotest_common.sh@936 -- # '[' -z 2787694 ']' 00:05:11.565 04:16:50 -- common/autotest_common.sh@940 -- # kill -0 2787694 00:05:11.565 04:16:50 -- common/autotest_common.sh@941 -- # uname 00:05:11.565 04:16:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:11.565 04:16:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2787694 00:05:11.565 04:16:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:11.565 04:16:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:11.565 04:16:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2787694' 00:05:11.565 killing process with pid 2787694 00:05:11.565 04:16:50 -- common/autotest_common.sh@955 -- # kill 2787694 00:05:11.565 04:16:50 -- common/autotest_common.sh@960 -- # wait 2787694 00:05:12.132 00:05:12.132 real 0m2.445s 00:05:12.132 user 0m3.113s 00:05:12.132 sys 0m0.574s 00:05:12.132 04:16:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:12.132 04:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:12.132 ************************************ 00:05:12.132 END TEST rpc 00:05:12.132 ************************************ 00:05:12.132 04:16:51 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:12.132 04:16:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.132 04:16:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.132 04:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:12.132 ************************************ 00:05:12.132 START TEST rpc_client 00:05:12.132 ************************************ 00:05:12.132 04:16:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:12.132 * Looking for test storage... 00:05:12.132 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:12.132 04:16:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:12.132 04:16:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:12.132 04:16:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:12.132 04:16:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:12.132 04:16:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:12.132 04:16:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:12.132 04:16:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:12.132 04:16:51 -- scripts/common.sh@335 -- # IFS=.-: 00:05:12.132 04:16:51 -- scripts/common.sh@335 -- # read -ra ver1 00:05:12.132 04:16:51 -- scripts/common.sh@336 -- # IFS=.-: 00:05:12.132 04:16:51 -- scripts/common.sh@336 -- # read -ra ver2 00:05:12.132 04:16:51 -- scripts/common.sh@337 -- # local 'op=<' 00:05:12.132 04:16:51 -- scripts/common.sh@339 -- # ver1_l=2 00:05:12.132 04:16:51 -- scripts/common.sh@340 -- # ver2_l=1 00:05:12.132 04:16:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:12.132 04:16:51 -- scripts/common.sh@343 -- # case "$op" in 00:05:12.132 04:16:51 -- scripts/common.sh@344 -- # : 1 00:05:12.132 04:16:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:12.132 04:16:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:12.132 04:16:51 -- scripts/common.sh@364 -- # decimal 1 00:05:12.132 04:16:51 -- scripts/common.sh@352 -- # local d=1 00:05:12.132 04:16:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:12.132 04:16:51 -- scripts/common.sh@354 -- # echo 1 00:05:12.132 04:16:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:12.132 04:16:51 -- scripts/common.sh@365 -- # decimal 2 00:05:12.132 04:16:51 -- scripts/common.sh@352 -- # local d=2 00:05:12.132 04:16:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:12.132 04:16:51 -- scripts/common.sh@354 -- # echo 2 00:05:12.132 04:16:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:12.132 04:16:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:12.132 04:16:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:12.132 04:16:51 -- scripts/common.sh@367 -- # return 0 00:05:12.132 04:16:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:12.132 04:16:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:12.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.132 --rc genhtml_branch_coverage=1 00:05:12.132 --rc genhtml_function_coverage=1 00:05:12.132 --rc genhtml_legend=1 00:05:12.132 --rc geninfo_all_blocks=1 00:05:12.132 --rc geninfo_unexecuted_blocks=1 00:05:12.132 00:05:12.132 ' 00:05:12.132 04:16:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:12.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.132 --rc genhtml_branch_coverage=1 00:05:12.132 --rc genhtml_function_coverage=1 00:05:12.132 --rc genhtml_legend=1 00:05:12.132 --rc geninfo_all_blocks=1 00:05:12.132 --rc geninfo_unexecuted_blocks=1 00:05:12.132 00:05:12.132 ' 00:05:12.132 04:16:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:12.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.132 --rc genhtml_branch_coverage=1 00:05:12.132 --rc genhtml_function_coverage=1 00:05:12.132 --rc genhtml_legend=1 00:05:12.132 --rc geninfo_all_blocks=1 00:05:12.132 --rc geninfo_unexecuted_blocks=1 00:05:12.132 00:05:12.132 ' 00:05:12.132 04:16:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:12.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.133 --rc genhtml_branch_coverage=1 00:05:12.133 --rc genhtml_function_coverage=1 00:05:12.133 --rc genhtml_legend=1 00:05:12.133 --rc geninfo_all_blocks=1 00:05:12.133 --rc geninfo_unexecuted_blocks=1 00:05:12.133 00:05:12.133 ' 00:05:12.133 04:16:51 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:12.391 OK 00:05:12.391 04:16:51 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:12.391 00:05:12.391 real 0m0.155s 00:05:12.391 user 0m0.101s 00:05:12.391 sys 0m0.062s 00:05:12.391 04:16:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:12.391 04:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:12.391 ************************************ 00:05:12.391 END TEST rpc_client 00:05:12.391 ************************************ 00:05:12.391 04:16:51 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:12.391 04:16:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.391 04:16:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.391 04:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:12.391 ************************************ 00:05:12.391 START TEST json_config 00:05:12.391 ************************************ 00:05:12.391 04:16:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:12.391 04:16:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:12.391 04:16:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:12.391 04:16:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:12.391 04:16:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:12.391 04:16:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:12.391 04:16:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:12.391 04:16:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:12.391 04:16:51 -- scripts/common.sh@335 -- # IFS=.-: 00:05:12.391 04:16:51 -- scripts/common.sh@335 -- # read -ra ver1 00:05:12.391 04:16:51 -- scripts/common.sh@336 -- # IFS=.-: 00:05:12.391 04:16:51 -- scripts/common.sh@336 -- # read -ra ver2 00:05:12.391 04:16:51 -- scripts/common.sh@337 -- # local 'op=<' 00:05:12.391 04:16:51 -- scripts/common.sh@339 -- # ver1_l=2 00:05:12.391 04:16:51 -- scripts/common.sh@340 -- # ver2_l=1 00:05:12.392 04:16:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:12.392 04:16:51 -- scripts/common.sh@343 -- # case "$op" in 00:05:12.392 04:16:51 -- scripts/common.sh@344 -- # : 1 00:05:12.392 04:16:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:12.392 04:16:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:12.392 04:16:51 -- scripts/common.sh@364 -- # decimal 1 00:05:12.392 04:16:51 -- scripts/common.sh@352 -- # local d=1 00:05:12.392 04:16:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:12.392 04:16:51 -- scripts/common.sh@354 -- # echo 1 00:05:12.392 04:16:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:12.392 04:16:51 -- scripts/common.sh@365 -- # decimal 2 00:05:12.392 04:16:51 -- scripts/common.sh@352 -- # local d=2 00:05:12.392 04:16:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:12.392 04:16:51 -- scripts/common.sh@354 -- # echo 2 00:05:12.392 04:16:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:12.392 04:16:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:12.392 04:16:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:12.392 04:16:51 -- scripts/common.sh@367 -- # return 0 00:05:12.392 04:16:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:12.392 04:16:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:12.392 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.392 --rc genhtml_branch_coverage=1 00:05:12.392 --rc genhtml_function_coverage=1 00:05:12.392 --rc genhtml_legend=1 00:05:12.392 --rc geninfo_all_blocks=1 00:05:12.392 --rc geninfo_unexecuted_blocks=1 00:05:12.392 00:05:12.392 ' 00:05:12.392 04:16:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:12.392 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.392 --rc genhtml_branch_coverage=1 00:05:12.392 --rc genhtml_function_coverage=1 00:05:12.392 --rc genhtml_legend=1 00:05:12.392 --rc geninfo_all_blocks=1 00:05:12.392 --rc geninfo_unexecuted_blocks=1 00:05:12.392 00:05:12.392 ' 00:05:12.392 04:16:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:12.392 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.392 --rc genhtml_branch_coverage=1 00:05:12.392 --rc genhtml_function_coverage=1 00:05:12.392 --rc genhtml_legend=1 00:05:12.392 --rc geninfo_all_blocks=1 00:05:12.392 --rc geninfo_unexecuted_blocks=1 00:05:12.392 00:05:12.392 ' 00:05:12.392 04:16:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:12.392 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:12.392 --rc genhtml_branch_coverage=1 00:05:12.392 --rc genhtml_function_coverage=1 00:05:12.392 --rc genhtml_legend=1 00:05:12.392 --rc geninfo_all_blocks=1 00:05:12.392 --rc geninfo_unexecuted_blocks=1 00:05:12.392 00:05:12.392 ' 00:05:12.392 04:16:51 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:12.392 04:16:51 -- nvmf/common.sh@7 -- # uname -s 00:05:12.392 04:16:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:12.392 04:16:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:12.392 04:16:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:12.392 04:16:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:12.392 04:16:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:12.392 04:16:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:12.392 04:16:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:12.392 04:16:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:12.392 04:16:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:12.392 04:16:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:12.392 04:16:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:12.392 04:16:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:12.392 04:16:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:12.392 04:16:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:12.392 04:16:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:12.392 04:16:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:12.392 04:16:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:12.392 04:16:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:12.392 04:16:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:12.392 04:16:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:12.392 04:16:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:12.392 04:16:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:12.392 04:16:51 -- paths/export.sh@5 -- # export PATH 00:05:12.392 04:16:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:12.392 04:16:51 -- nvmf/common.sh@46 -- # : 0 00:05:12.392 04:16:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:12.392 04:16:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:12.392 04:16:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:12.392 04:16:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:12.392 04:16:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:12.392 04:16:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:12.392 04:16:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:12.392 04:16:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:12.392 04:16:51 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:12.392 04:16:51 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:12.392 04:16:51 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:12.392 04:16:51 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:12.392 04:16:51 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:12.392 04:16:51 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:12.392 04:16:51 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:12.392 04:16:51 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:12.392 04:16:51 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:12.392 04:16:51 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:12.392 04:16:51 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:12.392 04:16:51 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:12.392 04:16:51 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:12.392 04:16:51 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:12.392 04:16:51 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:12.392 INFO: JSON configuration test init 00:05:12.392 04:16:51 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:12.392 04:16:51 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:12.392 04:16:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:12.392 04:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:12.392 04:16:51 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:12.392 04:16:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:12.392 04:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:12.392 04:16:51 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:12.392 04:16:51 -- json_config/json_config.sh@98 -- # local app=target 00:05:12.392 04:16:51 -- json_config/json_config.sh@99 -- # shift 00:05:12.392 04:16:51 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:12.392 04:16:51 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:12.392 04:16:51 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:12.392 04:16:51 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:12.392 04:16:51 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:12.392 04:16:51 -- json_config/json_config.sh@111 -- # app_pid[$app]=2788186 00:05:12.392 04:16:51 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:12.392 04:16:51 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:12.392 Waiting for target to run... 00:05:12.392 04:16:51 -- json_config/json_config.sh@114 -- # waitforlisten 2788186 /var/tmp/spdk_tgt.sock 00:05:12.392 04:16:51 -- common/autotest_common.sh@829 -- # '[' -z 2788186 ']' 00:05:12.392 04:16:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:12.392 04:16:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.392 04:16:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:12.392 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:12.392 04:16:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.392 04:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:12.392 [2024-11-26 04:16:51.599660] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:12.392 [2024-11-26 04:16:51.599769] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2788186 ] 00:05:12.650 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.909 [2024-11-26 04:16:52.119252] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:13.168 [2024-11-26 04:16:52.199080] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:13.168 [2024-11-26 04:16:52.199276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.426 04:16:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:13.426 04:16:52 -- common/autotest_common.sh@862 -- # return 0 00:05:13.426 04:16:52 -- json_config/json_config.sh@115 -- # echo '' 00:05:13.426 00:05:13.426 04:16:52 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:13.426 04:16:52 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:13.426 04:16:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:13.426 04:16:52 -- common/autotest_common.sh@10 -- # set +x 00:05:13.426 04:16:52 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:13.426 04:16:52 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:13.426 04:16:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:13.426 04:16:52 -- common/autotest_common.sh@10 -- # set +x 00:05:13.426 04:16:52 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:13.426 04:16:52 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:13.426 04:16:52 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:16.776 04:16:55 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:16.776 04:16:55 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:16.776 04:16:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:16.776 04:16:55 -- common/autotest_common.sh@10 -- # set +x 00:05:16.776 04:16:55 -- json_config/json_config.sh@48 -- # local ret=0 00:05:16.776 04:16:55 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:16.776 04:16:55 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:16.776 04:16:55 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:16.776 04:16:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:16.776 04:16:55 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:17.061 04:16:56 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:17.061 04:16:56 -- json_config/json_config.sh@51 -- # local get_types 00:05:17.061 04:16:56 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:17.061 04:16:56 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:17.061 04:16:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:17.061 04:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:17.061 04:16:56 -- json_config/json_config.sh@58 -- # return 0 00:05:17.061 04:16:56 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:17.061 04:16:56 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:17.061 04:16:56 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:17.061 04:16:56 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:17.061 04:16:56 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:17.061 04:16:56 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:17.061 04:16:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:17.061 04:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:17.061 04:16:56 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:17.061 04:16:56 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:17.061 04:16:56 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:17.061 04:16:56 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:17.061 04:16:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:17.319 MallocForNvmf0 00:05:17.319 04:16:56 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:17.319 04:16:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:17.319 MallocForNvmf1 00:05:17.577 04:16:56 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:17.577 04:16:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:17.577 [2024-11-26 04:16:56.781306] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:17.577 04:16:56 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:17.577 04:16:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:18.144 04:16:57 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:18.144 04:16:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:18.144 04:16:57 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:18.144 04:16:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:18.710 04:16:57 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:18.710 04:16:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:18.710 [2024-11-26 04:16:57.909171] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:18.710 04:16:57 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:18.710 04:16:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:18.710 04:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:18.967 04:16:57 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:18.967 04:16:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:18.967 04:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:18.967 04:16:57 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:18.967 04:16:57 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:18.967 04:16:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:19.224 MallocBdevForConfigChangeCheck 00:05:19.224 04:16:58 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:19.224 04:16:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:19.224 04:16:58 -- common/autotest_common.sh@10 -- # set +x 00:05:19.224 04:16:58 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:19.224 04:16:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:19.481 04:16:58 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:19.481 INFO: shutting down applications... 00:05:19.481 04:16:58 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:19.481 04:16:58 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:19.481 04:16:58 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:19.481 04:16:58 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:21.374 Calling clear_iscsi_subsystem 00:05:21.374 Calling clear_nvmf_subsystem 00:05:21.374 Calling clear_nbd_subsystem 00:05:21.374 Calling clear_ublk_subsystem 00:05:21.374 Calling clear_vhost_blk_subsystem 00:05:21.374 Calling clear_vhost_scsi_subsystem 00:05:21.374 Calling clear_scheduler_subsystem 00:05:21.374 Calling clear_bdev_subsystem 00:05:21.374 Calling clear_accel_subsystem 00:05:21.374 Calling clear_vmd_subsystem 00:05:21.374 Calling clear_sock_subsystem 00:05:21.374 Calling clear_iobuf_subsystem 00:05:21.374 04:17:00 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:21.374 04:17:00 -- json_config/json_config.sh@396 -- # count=100 00:05:21.374 04:17:00 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:21.374 04:17:00 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:21.374 04:17:00 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:21.375 04:17:00 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:21.632 04:17:00 -- json_config/json_config.sh@398 -- # break 00:05:21.632 04:17:00 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:21.632 04:17:00 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:21.632 04:17:00 -- json_config/json_config.sh@120 -- # local app=target 00:05:21.632 04:17:00 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:21.632 04:17:00 -- json_config/json_config.sh@124 -- # [[ -n 2788186 ]] 00:05:21.632 04:17:00 -- json_config/json_config.sh@127 -- # kill -SIGINT 2788186 00:05:21.632 04:17:00 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:21.632 04:17:00 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:21.632 04:17:00 -- json_config/json_config.sh@130 -- # kill -0 2788186 00:05:21.632 04:17:00 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:22.198 04:17:01 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:22.198 04:17:01 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:22.198 04:17:01 -- json_config/json_config.sh@130 -- # kill -0 2788186 00:05:22.198 04:17:01 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:22.198 04:17:01 -- json_config/json_config.sh@132 -- # break 00:05:22.198 04:17:01 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:22.198 04:17:01 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:22.198 SPDK target shutdown done 00:05:22.198 04:17:01 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:22.198 INFO: relaunching applications... 00:05:22.198 04:17:01 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:22.198 04:17:01 -- json_config/json_config.sh@98 -- # local app=target 00:05:22.198 04:17:01 -- json_config/json_config.sh@99 -- # shift 00:05:22.198 04:17:01 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:22.198 04:17:01 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:22.198 04:17:01 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:22.198 04:17:01 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:22.198 04:17:01 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:22.198 04:17:01 -- json_config/json_config.sh@111 -- # app_pid[$app]=2789542 00:05:22.198 04:17:01 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:22.198 04:17:01 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:22.198 Waiting for target to run... 00:05:22.198 04:17:01 -- json_config/json_config.sh@114 -- # waitforlisten 2789542 /var/tmp/spdk_tgt.sock 00:05:22.198 04:17:01 -- common/autotest_common.sh@829 -- # '[' -z 2789542 ']' 00:05:22.198 04:17:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:22.198 04:17:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:22.198 04:17:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:22.198 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:22.198 04:17:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:22.198 04:17:01 -- common/autotest_common.sh@10 -- # set +x 00:05:22.198 [2024-11-26 04:17:01.197407] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:22.198 [2024-11-26 04:17:01.197494] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2789542 ] 00:05:22.198 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.766 [2024-11-26 04:17:01.687775] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.766 [2024-11-26 04:17:01.763254] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:22.766 [2024-11-26 04:17:01.763429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.051 [2024-11-26 04:17:04.792466] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:26.051 [2024-11-26 04:17:04.824981] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:26.051 04:17:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:26.051 04:17:05 -- common/autotest_common.sh@862 -- # return 0 00:05:26.051 04:17:05 -- json_config/json_config.sh@115 -- # echo '' 00:05:26.051 00:05:26.051 04:17:05 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:26.051 04:17:05 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:26.051 INFO: Checking if target configuration is the same... 00:05:26.051 04:17:05 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:26.051 04:17:05 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:26.051 04:17:05 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:26.051 + '[' 2 -ne 2 ']' 00:05:26.051 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:26.051 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:26.051 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:26.051 +++ basename /dev/fd/62 00:05:26.051 ++ mktemp /tmp/62.XXX 00:05:26.051 + tmp_file_1=/tmp/62.up6 00:05:26.051 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:26.051 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:26.051 + tmp_file_2=/tmp/spdk_tgt_config.json.nci 00:05:26.051 + ret=0 00:05:26.051 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:26.310 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:26.568 + diff -u /tmp/62.up6 /tmp/spdk_tgt_config.json.nci 00:05:26.568 + echo 'INFO: JSON config files are the same' 00:05:26.568 INFO: JSON config files are the same 00:05:26.568 + rm /tmp/62.up6 /tmp/spdk_tgt_config.json.nci 00:05:26.568 + exit 0 00:05:26.568 04:17:05 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:26.568 04:17:05 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:26.568 INFO: changing configuration and checking if this can be detected... 00:05:26.568 04:17:05 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:26.568 04:17:05 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:26.827 04:17:05 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:26.827 04:17:05 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:26.827 04:17:05 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:26.827 + '[' 2 -ne 2 ']' 00:05:26.827 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:26.827 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:26.827 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:26.827 +++ basename /dev/fd/62 00:05:26.827 ++ mktemp /tmp/62.XXX 00:05:26.827 + tmp_file_1=/tmp/62.m13 00:05:26.827 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:26.827 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:26.827 + tmp_file_2=/tmp/spdk_tgt_config.json.2pl 00:05:26.827 + ret=0 00:05:26.827 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:27.085 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:27.085 + diff -u /tmp/62.m13 /tmp/spdk_tgt_config.json.2pl 00:05:27.085 + ret=1 00:05:27.085 + echo '=== Start of file: /tmp/62.m13 ===' 00:05:27.085 + cat /tmp/62.m13 00:05:27.085 + echo '=== End of file: /tmp/62.m13 ===' 00:05:27.085 + echo '' 00:05:27.085 + echo '=== Start of file: /tmp/spdk_tgt_config.json.2pl ===' 00:05:27.085 + cat /tmp/spdk_tgt_config.json.2pl 00:05:27.085 + echo '=== End of file: /tmp/spdk_tgt_config.json.2pl ===' 00:05:27.085 + echo '' 00:05:27.085 + rm /tmp/62.m13 /tmp/spdk_tgt_config.json.2pl 00:05:27.085 + exit 1 00:05:27.085 04:17:06 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:27.085 INFO: configuration change detected. 00:05:27.085 04:17:06 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:27.085 04:17:06 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:27.085 04:17:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:27.085 04:17:06 -- common/autotest_common.sh@10 -- # set +x 00:05:27.085 04:17:06 -- json_config/json_config.sh@360 -- # local ret=0 00:05:27.085 04:17:06 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:27.085 04:17:06 -- json_config/json_config.sh@370 -- # [[ -n 2789542 ]] 00:05:27.085 04:17:06 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:27.085 04:17:06 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:27.085 04:17:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:27.085 04:17:06 -- common/autotest_common.sh@10 -- # set +x 00:05:27.085 04:17:06 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:27.085 04:17:06 -- json_config/json_config.sh@246 -- # uname -s 00:05:27.085 04:17:06 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:27.085 04:17:06 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:27.085 04:17:06 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:27.085 04:17:06 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:27.085 04:17:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:27.085 04:17:06 -- common/autotest_common.sh@10 -- # set +x 00:05:27.085 04:17:06 -- json_config/json_config.sh@376 -- # killprocess 2789542 00:05:27.085 04:17:06 -- common/autotest_common.sh@936 -- # '[' -z 2789542 ']' 00:05:27.085 04:17:06 -- common/autotest_common.sh@940 -- # kill -0 2789542 00:05:27.085 04:17:06 -- common/autotest_common.sh@941 -- # uname 00:05:27.085 04:17:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:27.085 04:17:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2789542 00:05:27.344 04:17:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:27.344 04:17:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:27.344 04:17:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2789542' 00:05:27.344 killing process with pid 2789542 00:05:27.344 04:17:06 -- common/autotest_common.sh@955 -- # kill 2789542 00:05:27.344 04:17:06 -- common/autotest_common.sh@960 -- # wait 2789542 00:05:29.247 04:17:07 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:29.247 04:17:07 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:29.247 04:17:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:29.247 04:17:07 -- common/autotest_common.sh@10 -- # set +x 00:05:29.247 04:17:07 -- json_config/json_config.sh@381 -- # return 0 00:05:29.247 04:17:07 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:29.247 INFO: Success 00:05:29.247 00:05:29.247 real 0m16.609s 00:05:29.247 user 0m19.111s 00:05:29.247 sys 0m2.276s 00:05:29.247 04:17:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.247 04:17:08 -- common/autotest_common.sh@10 -- # set +x 00:05:29.247 ************************************ 00:05:29.247 END TEST json_config 00:05:29.247 ************************************ 00:05:29.247 04:17:08 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:29.247 04:17:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:29.247 04:17:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.247 04:17:08 -- common/autotest_common.sh@10 -- # set +x 00:05:29.247 ************************************ 00:05:29.247 START TEST json_config_extra_key 00:05:29.247 ************************************ 00:05:29.247 04:17:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:29.247 04:17:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:29.247 04:17:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:29.247 04:17:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:29.247 04:17:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:29.247 04:17:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:29.247 04:17:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:29.247 04:17:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:29.247 04:17:08 -- scripts/common.sh@335 -- # IFS=.-: 00:05:29.247 04:17:08 -- scripts/common.sh@335 -- # read -ra ver1 00:05:29.247 04:17:08 -- scripts/common.sh@336 -- # IFS=.-: 00:05:29.247 04:17:08 -- scripts/common.sh@336 -- # read -ra ver2 00:05:29.247 04:17:08 -- scripts/common.sh@337 -- # local 'op=<' 00:05:29.247 04:17:08 -- scripts/common.sh@339 -- # ver1_l=2 00:05:29.247 04:17:08 -- scripts/common.sh@340 -- # ver2_l=1 00:05:29.247 04:17:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:29.247 04:17:08 -- scripts/common.sh@343 -- # case "$op" in 00:05:29.247 04:17:08 -- scripts/common.sh@344 -- # : 1 00:05:29.247 04:17:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:29.247 04:17:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:29.247 04:17:08 -- scripts/common.sh@364 -- # decimal 1 00:05:29.247 04:17:08 -- scripts/common.sh@352 -- # local d=1 00:05:29.247 04:17:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:29.247 04:17:08 -- scripts/common.sh@354 -- # echo 1 00:05:29.247 04:17:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:29.247 04:17:08 -- scripts/common.sh@365 -- # decimal 2 00:05:29.247 04:17:08 -- scripts/common.sh@352 -- # local d=2 00:05:29.247 04:17:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:29.247 04:17:08 -- scripts/common.sh@354 -- # echo 2 00:05:29.247 04:17:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:29.247 04:17:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:29.247 04:17:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:29.247 04:17:08 -- scripts/common.sh@367 -- # return 0 00:05:29.247 04:17:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:29.247 04:17:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:29.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:29.247 --rc genhtml_branch_coverage=1 00:05:29.247 --rc genhtml_function_coverage=1 00:05:29.247 --rc genhtml_legend=1 00:05:29.247 --rc geninfo_all_blocks=1 00:05:29.247 --rc geninfo_unexecuted_blocks=1 00:05:29.247 00:05:29.247 ' 00:05:29.247 04:17:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:29.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:29.247 --rc genhtml_branch_coverage=1 00:05:29.247 --rc genhtml_function_coverage=1 00:05:29.247 --rc genhtml_legend=1 00:05:29.247 --rc geninfo_all_blocks=1 00:05:29.247 --rc geninfo_unexecuted_blocks=1 00:05:29.247 00:05:29.247 ' 00:05:29.247 04:17:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:29.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:29.247 --rc genhtml_branch_coverage=1 00:05:29.247 --rc genhtml_function_coverage=1 00:05:29.247 --rc genhtml_legend=1 00:05:29.247 --rc geninfo_all_blocks=1 00:05:29.247 --rc geninfo_unexecuted_blocks=1 00:05:29.247 00:05:29.247 ' 00:05:29.247 04:17:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:29.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:29.247 --rc genhtml_branch_coverage=1 00:05:29.247 --rc genhtml_function_coverage=1 00:05:29.247 --rc genhtml_legend=1 00:05:29.247 --rc geninfo_all_blocks=1 00:05:29.247 --rc geninfo_unexecuted_blocks=1 00:05:29.247 00:05:29.247 ' 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:29.247 04:17:08 -- nvmf/common.sh@7 -- # uname -s 00:05:29.247 04:17:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:29.247 04:17:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:29.247 04:17:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:29.247 04:17:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:29.247 04:17:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:29.247 04:17:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:29.247 04:17:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:29.247 04:17:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:29.247 04:17:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:29.247 04:17:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:29.247 04:17:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:29.247 04:17:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:29.247 04:17:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:29.247 04:17:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:29.247 04:17:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:29.247 04:17:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:29.247 04:17:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:29.247 04:17:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:29.247 04:17:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:29.247 04:17:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:29.247 04:17:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:29.247 04:17:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:29.247 04:17:08 -- paths/export.sh@5 -- # export PATH 00:05:29.247 04:17:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:29.247 04:17:08 -- nvmf/common.sh@46 -- # : 0 00:05:29.247 04:17:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:29.247 04:17:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:29.247 04:17:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:29.247 04:17:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:29.247 04:17:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:29.247 04:17:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:29.247 04:17:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:29.247 04:17:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:29.247 INFO: launching applications... 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:29.247 04:17:08 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:29.248 04:17:08 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=2790493 00:05:29.248 04:17:08 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:29.248 04:17:08 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:29.248 Waiting for target to run... 00:05:29.248 04:17:08 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 2790493 /var/tmp/spdk_tgt.sock 00:05:29.248 04:17:08 -- common/autotest_common.sh@829 -- # '[' -z 2790493 ']' 00:05:29.248 04:17:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:29.248 04:17:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:29.248 04:17:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:29.248 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:29.248 04:17:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:29.248 04:17:08 -- common/autotest_common.sh@10 -- # set +x 00:05:29.248 [2024-11-26 04:17:08.207092] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:29.248 [2024-11-26 04:17:08.207183] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2790493 ] 00:05:29.248 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.506 [2024-11-26 04:17:08.684805] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.765 [2024-11-26 04:17:08.764506] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:29.765 [2024-11-26 04:17:08.764730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.024 04:17:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:30.024 04:17:09 -- common/autotest_common.sh@862 -- # return 0 00:05:30.024 04:17:09 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:30.024 00:05:30.024 04:17:09 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:30.024 INFO: shutting down applications... 00:05:30.024 04:17:09 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:30.024 04:17:09 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:30.024 04:17:09 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:30.024 04:17:09 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 2790493 ]] 00:05:30.024 04:17:09 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 2790493 00:05:30.024 04:17:09 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:30.024 04:17:09 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:30.024 04:17:09 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2790493 00:05:30.024 04:17:09 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:30.591 04:17:09 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:30.591 04:17:09 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:30.591 04:17:09 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2790493 00:05:30.591 04:17:09 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:30.591 04:17:09 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:30.591 04:17:09 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:30.591 04:17:09 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:30.591 SPDK target shutdown done 00:05:30.591 04:17:09 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:30.591 Success 00:05:30.591 00:05:30.591 real 0m1.696s 00:05:30.591 user 0m1.580s 00:05:30.591 sys 0m0.589s 00:05:30.591 04:17:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:30.591 04:17:09 -- common/autotest_common.sh@10 -- # set +x 00:05:30.591 ************************************ 00:05:30.591 END TEST json_config_extra_key 00:05:30.591 ************************************ 00:05:30.591 04:17:09 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:30.591 04:17:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:30.591 04:17:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:30.591 04:17:09 -- common/autotest_common.sh@10 -- # set +x 00:05:30.591 ************************************ 00:05:30.591 START TEST alias_rpc 00:05:30.591 ************************************ 00:05:30.591 04:17:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:30.591 * Looking for test storage... 00:05:30.591 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:30.591 04:17:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:30.591 04:17:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:30.591 04:17:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:30.850 04:17:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:30.850 04:17:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:30.850 04:17:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:30.850 04:17:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:30.850 04:17:09 -- scripts/common.sh@335 -- # IFS=.-: 00:05:30.850 04:17:09 -- scripts/common.sh@335 -- # read -ra ver1 00:05:30.850 04:17:09 -- scripts/common.sh@336 -- # IFS=.-: 00:05:30.850 04:17:09 -- scripts/common.sh@336 -- # read -ra ver2 00:05:30.850 04:17:09 -- scripts/common.sh@337 -- # local 'op=<' 00:05:30.850 04:17:09 -- scripts/common.sh@339 -- # ver1_l=2 00:05:30.850 04:17:09 -- scripts/common.sh@340 -- # ver2_l=1 00:05:30.850 04:17:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:30.850 04:17:09 -- scripts/common.sh@343 -- # case "$op" in 00:05:30.850 04:17:09 -- scripts/common.sh@344 -- # : 1 00:05:30.850 04:17:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:30.850 04:17:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:30.850 04:17:09 -- scripts/common.sh@364 -- # decimal 1 00:05:30.850 04:17:09 -- scripts/common.sh@352 -- # local d=1 00:05:30.850 04:17:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:30.850 04:17:09 -- scripts/common.sh@354 -- # echo 1 00:05:30.850 04:17:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:30.850 04:17:09 -- scripts/common.sh@365 -- # decimal 2 00:05:30.850 04:17:09 -- scripts/common.sh@352 -- # local d=2 00:05:30.850 04:17:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:30.850 04:17:09 -- scripts/common.sh@354 -- # echo 2 00:05:30.850 04:17:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:30.850 04:17:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:30.850 04:17:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:30.850 04:17:09 -- scripts/common.sh@367 -- # return 0 00:05:30.850 04:17:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:30.850 04:17:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:30.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:30.850 --rc genhtml_branch_coverage=1 00:05:30.850 --rc genhtml_function_coverage=1 00:05:30.850 --rc genhtml_legend=1 00:05:30.850 --rc geninfo_all_blocks=1 00:05:30.850 --rc geninfo_unexecuted_blocks=1 00:05:30.850 00:05:30.850 ' 00:05:30.850 04:17:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:30.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:30.850 --rc genhtml_branch_coverage=1 00:05:30.850 --rc genhtml_function_coverage=1 00:05:30.850 --rc genhtml_legend=1 00:05:30.850 --rc geninfo_all_blocks=1 00:05:30.850 --rc geninfo_unexecuted_blocks=1 00:05:30.850 00:05:30.850 ' 00:05:30.850 04:17:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:30.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:30.850 --rc genhtml_branch_coverage=1 00:05:30.850 --rc genhtml_function_coverage=1 00:05:30.850 --rc genhtml_legend=1 00:05:30.850 --rc geninfo_all_blocks=1 00:05:30.850 --rc geninfo_unexecuted_blocks=1 00:05:30.850 00:05:30.850 ' 00:05:30.850 04:17:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:30.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:30.850 --rc genhtml_branch_coverage=1 00:05:30.850 --rc genhtml_function_coverage=1 00:05:30.850 --rc genhtml_legend=1 00:05:30.850 --rc geninfo_all_blocks=1 00:05:30.850 --rc geninfo_unexecuted_blocks=1 00:05:30.850 00:05:30.850 ' 00:05:30.850 04:17:09 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:30.850 04:17:09 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=2790807 00:05:30.850 04:17:09 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:30.850 04:17:09 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 2790807 00:05:30.850 04:17:09 -- common/autotest_common.sh@829 -- # '[' -z 2790807 ']' 00:05:30.850 04:17:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:30.850 04:17:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:30.850 04:17:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:30.850 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:30.850 04:17:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:30.850 04:17:09 -- common/autotest_common.sh@10 -- # set +x 00:05:30.850 [2024-11-26 04:17:09.934731] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:30.850 [2024-11-26 04:17:09.934824] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2790807 ] 00:05:30.850 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.850 [2024-11-26 04:17:09.996426] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.109 [2024-11-26 04:17:10.095769] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:31.109 [2024-11-26 04:17:10.095935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.044 04:17:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:32.044 04:17:10 -- common/autotest_common.sh@862 -- # return 0 00:05:32.044 04:17:10 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:32.044 04:17:11 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 2790807 00:05:32.044 04:17:11 -- common/autotest_common.sh@936 -- # '[' -z 2790807 ']' 00:05:32.044 04:17:11 -- common/autotest_common.sh@940 -- # kill -0 2790807 00:05:32.044 04:17:11 -- common/autotest_common.sh@941 -- # uname 00:05:32.044 04:17:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:32.044 04:17:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2790807 00:05:32.044 04:17:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:32.044 04:17:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:32.044 04:17:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2790807' 00:05:32.044 killing process with pid 2790807 00:05:32.044 04:17:11 -- common/autotest_common.sh@955 -- # kill 2790807 00:05:32.044 04:17:11 -- common/autotest_common.sh@960 -- # wait 2790807 00:05:32.610 00:05:32.610 real 0m1.886s 00:05:32.610 user 0m2.180s 00:05:32.610 sys 0m0.478s 00:05:32.610 04:17:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.610 04:17:11 -- common/autotest_common.sh@10 -- # set +x 00:05:32.610 ************************************ 00:05:32.610 END TEST alias_rpc 00:05:32.610 ************************************ 00:05:32.610 04:17:11 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:05:32.610 04:17:11 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:32.610 04:17:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:32.610 04:17:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.610 04:17:11 -- common/autotest_common.sh@10 -- # set +x 00:05:32.610 ************************************ 00:05:32.610 START TEST spdkcli_tcp 00:05:32.610 ************************************ 00:05:32.610 04:17:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:32.610 * Looking for test storage... 00:05:32.610 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:32.610 04:17:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:32.610 04:17:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:32.610 04:17:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:32.610 04:17:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:32.610 04:17:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:32.610 04:17:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:32.610 04:17:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:32.610 04:17:11 -- scripts/common.sh@335 -- # IFS=.-: 00:05:32.610 04:17:11 -- scripts/common.sh@335 -- # read -ra ver1 00:05:32.610 04:17:11 -- scripts/common.sh@336 -- # IFS=.-: 00:05:32.610 04:17:11 -- scripts/common.sh@336 -- # read -ra ver2 00:05:32.610 04:17:11 -- scripts/common.sh@337 -- # local 'op=<' 00:05:32.610 04:17:11 -- scripts/common.sh@339 -- # ver1_l=2 00:05:32.610 04:17:11 -- scripts/common.sh@340 -- # ver2_l=1 00:05:32.610 04:17:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:32.610 04:17:11 -- scripts/common.sh@343 -- # case "$op" in 00:05:32.610 04:17:11 -- scripts/common.sh@344 -- # : 1 00:05:32.610 04:17:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:32.610 04:17:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:32.610 04:17:11 -- scripts/common.sh@364 -- # decimal 1 00:05:32.610 04:17:11 -- scripts/common.sh@352 -- # local d=1 00:05:32.610 04:17:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:32.610 04:17:11 -- scripts/common.sh@354 -- # echo 1 00:05:32.610 04:17:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:32.610 04:17:11 -- scripts/common.sh@365 -- # decimal 2 00:05:32.610 04:17:11 -- scripts/common.sh@352 -- # local d=2 00:05:32.610 04:17:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:32.610 04:17:11 -- scripts/common.sh@354 -- # echo 2 00:05:32.610 04:17:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:32.610 04:17:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:32.610 04:17:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:32.610 04:17:11 -- scripts/common.sh@367 -- # return 0 00:05:32.610 04:17:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:32.610 04:17:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:32.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:32.610 --rc genhtml_branch_coverage=1 00:05:32.610 --rc genhtml_function_coverage=1 00:05:32.610 --rc genhtml_legend=1 00:05:32.610 --rc geninfo_all_blocks=1 00:05:32.610 --rc geninfo_unexecuted_blocks=1 00:05:32.610 00:05:32.610 ' 00:05:32.610 04:17:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:32.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:32.610 --rc genhtml_branch_coverage=1 00:05:32.610 --rc genhtml_function_coverage=1 00:05:32.610 --rc genhtml_legend=1 00:05:32.610 --rc geninfo_all_blocks=1 00:05:32.610 --rc geninfo_unexecuted_blocks=1 00:05:32.610 00:05:32.610 ' 00:05:32.610 04:17:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:32.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:32.610 --rc genhtml_branch_coverage=1 00:05:32.610 --rc genhtml_function_coverage=1 00:05:32.610 --rc genhtml_legend=1 00:05:32.610 --rc geninfo_all_blocks=1 00:05:32.610 --rc geninfo_unexecuted_blocks=1 00:05:32.610 00:05:32.610 ' 00:05:32.610 04:17:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:32.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:32.610 --rc genhtml_branch_coverage=1 00:05:32.610 --rc genhtml_function_coverage=1 00:05:32.610 --rc genhtml_legend=1 00:05:32.610 --rc geninfo_all_blocks=1 00:05:32.610 --rc geninfo_unexecuted_blocks=1 00:05:32.610 00:05:32.610 ' 00:05:32.610 04:17:11 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:32.610 04:17:11 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:32.610 04:17:11 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:32.610 04:17:11 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:32.610 04:17:11 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:32.610 04:17:11 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:32.610 04:17:11 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:32.610 04:17:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:32.610 04:17:11 -- common/autotest_common.sh@10 -- # set +x 00:05:32.610 04:17:11 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=2791029 00:05:32.610 04:17:11 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:32.610 04:17:11 -- spdkcli/tcp.sh@27 -- # waitforlisten 2791029 00:05:32.610 04:17:11 -- common/autotest_common.sh@829 -- # '[' -z 2791029 ']' 00:05:32.610 04:17:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:32.610 04:17:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:32.610 04:17:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:32.610 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:32.610 04:17:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:32.610 04:17:11 -- common/autotest_common.sh@10 -- # set +x 00:05:32.869 [2024-11-26 04:17:11.849180] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:32.869 [2024-11-26 04:17:11.849282] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2791029 ] 00:05:32.869 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.869 [2024-11-26 04:17:11.911175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:32.869 [2024-11-26 04:17:11.996324] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:32.869 [2024-11-26 04:17:11.996589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:32.869 [2024-11-26 04:17:11.996594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.803 04:17:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:33.803 04:17:12 -- common/autotest_common.sh@862 -- # return 0 00:05:33.803 04:17:12 -- spdkcli/tcp.sh@31 -- # socat_pid=2791159 00:05:33.803 04:17:12 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:33.803 04:17:12 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:34.061 [ 00:05:34.061 "bdev_malloc_delete", 00:05:34.061 "bdev_malloc_create", 00:05:34.061 "bdev_null_resize", 00:05:34.061 "bdev_null_delete", 00:05:34.061 "bdev_null_create", 00:05:34.061 "bdev_nvme_cuse_unregister", 00:05:34.061 "bdev_nvme_cuse_register", 00:05:34.061 "bdev_opal_new_user", 00:05:34.061 "bdev_opal_set_lock_state", 00:05:34.061 "bdev_opal_delete", 00:05:34.061 "bdev_opal_get_info", 00:05:34.061 "bdev_opal_create", 00:05:34.061 "bdev_nvme_opal_revert", 00:05:34.061 "bdev_nvme_opal_init", 00:05:34.061 "bdev_nvme_send_cmd", 00:05:34.061 "bdev_nvme_get_path_iostat", 00:05:34.061 "bdev_nvme_get_mdns_discovery_info", 00:05:34.061 "bdev_nvme_stop_mdns_discovery", 00:05:34.061 "bdev_nvme_start_mdns_discovery", 00:05:34.061 "bdev_nvme_set_multipath_policy", 00:05:34.061 "bdev_nvme_set_preferred_path", 00:05:34.061 "bdev_nvme_get_io_paths", 00:05:34.061 "bdev_nvme_remove_error_injection", 00:05:34.061 "bdev_nvme_add_error_injection", 00:05:34.061 "bdev_nvme_get_discovery_info", 00:05:34.061 "bdev_nvme_stop_discovery", 00:05:34.061 "bdev_nvme_start_discovery", 00:05:34.061 "bdev_nvme_get_controller_health_info", 00:05:34.061 "bdev_nvme_disable_controller", 00:05:34.061 "bdev_nvme_enable_controller", 00:05:34.061 "bdev_nvme_reset_controller", 00:05:34.061 "bdev_nvme_get_transport_statistics", 00:05:34.061 "bdev_nvme_apply_firmware", 00:05:34.061 "bdev_nvme_detach_controller", 00:05:34.061 "bdev_nvme_get_controllers", 00:05:34.061 "bdev_nvme_attach_controller", 00:05:34.061 "bdev_nvme_set_hotplug", 00:05:34.061 "bdev_nvme_set_options", 00:05:34.061 "bdev_passthru_delete", 00:05:34.061 "bdev_passthru_create", 00:05:34.061 "bdev_lvol_grow_lvstore", 00:05:34.061 "bdev_lvol_get_lvols", 00:05:34.061 "bdev_lvol_get_lvstores", 00:05:34.061 "bdev_lvol_delete", 00:05:34.061 "bdev_lvol_set_read_only", 00:05:34.061 "bdev_lvol_resize", 00:05:34.061 "bdev_lvol_decouple_parent", 00:05:34.061 "bdev_lvol_inflate", 00:05:34.061 "bdev_lvol_rename", 00:05:34.061 "bdev_lvol_clone_bdev", 00:05:34.061 "bdev_lvol_clone", 00:05:34.061 "bdev_lvol_snapshot", 00:05:34.061 "bdev_lvol_create", 00:05:34.061 "bdev_lvol_delete_lvstore", 00:05:34.061 "bdev_lvol_rename_lvstore", 00:05:34.061 "bdev_lvol_create_lvstore", 00:05:34.061 "bdev_raid_set_options", 00:05:34.061 "bdev_raid_remove_base_bdev", 00:05:34.061 "bdev_raid_add_base_bdev", 00:05:34.061 "bdev_raid_delete", 00:05:34.061 "bdev_raid_create", 00:05:34.061 "bdev_raid_get_bdevs", 00:05:34.061 "bdev_error_inject_error", 00:05:34.061 "bdev_error_delete", 00:05:34.061 "bdev_error_create", 00:05:34.061 "bdev_split_delete", 00:05:34.061 "bdev_split_create", 00:05:34.061 "bdev_delay_delete", 00:05:34.061 "bdev_delay_create", 00:05:34.061 "bdev_delay_update_latency", 00:05:34.061 "bdev_zone_block_delete", 00:05:34.061 "bdev_zone_block_create", 00:05:34.061 "blobfs_create", 00:05:34.061 "blobfs_detect", 00:05:34.061 "blobfs_set_cache_size", 00:05:34.061 "bdev_aio_delete", 00:05:34.061 "bdev_aio_rescan", 00:05:34.061 "bdev_aio_create", 00:05:34.061 "bdev_ftl_set_property", 00:05:34.061 "bdev_ftl_get_properties", 00:05:34.061 "bdev_ftl_get_stats", 00:05:34.061 "bdev_ftl_unmap", 00:05:34.061 "bdev_ftl_unload", 00:05:34.061 "bdev_ftl_delete", 00:05:34.061 "bdev_ftl_load", 00:05:34.061 "bdev_ftl_create", 00:05:34.061 "bdev_virtio_attach_controller", 00:05:34.061 "bdev_virtio_scsi_get_devices", 00:05:34.061 "bdev_virtio_detach_controller", 00:05:34.061 "bdev_virtio_blk_set_hotplug", 00:05:34.061 "bdev_iscsi_delete", 00:05:34.061 "bdev_iscsi_create", 00:05:34.061 "bdev_iscsi_set_options", 00:05:34.061 "accel_error_inject_error", 00:05:34.061 "ioat_scan_accel_module", 00:05:34.061 "dsa_scan_accel_module", 00:05:34.061 "iaa_scan_accel_module", 00:05:34.061 "vfu_virtio_create_scsi_endpoint", 00:05:34.061 "vfu_virtio_scsi_remove_target", 00:05:34.062 "vfu_virtio_scsi_add_target", 00:05:34.062 "vfu_virtio_create_blk_endpoint", 00:05:34.062 "vfu_virtio_delete_endpoint", 00:05:34.062 "iscsi_set_options", 00:05:34.062 "iscsi_get_auth_groups", 00:05:34.062 "iscsi_auth_group_remove_secret", 00:05:34.062 "iscsi_auth_group_add_secret", 00:05:34.062 "iscsi_delete_auth_group", 00:05:34.062 "iscsi_create_auth_group", 00:05:34.062 "iscsi_set_discovery_auth", 00:05:34.062 "iscsi_get_options", 00:05:34.062 "iscsi_target_node_request_logout", 00:05:34.062 "iscsi_target_node_set_redirect", 00:05:34.062 "iscsi_target_node_set_auth", 00:05:34.062 "iscsi_target_node_add_lun", 00:05:34.062 "iscsi_get_connections", 00:05:34.062 "iscsi_portal_group_set_auth", 00:05:34.062 "iscsi_start_portal_group", 00:05:34.062 "iscsi_delete_portal_group", 00:05:34.062 "iscsi_create_portal_group", 00:05:34.062 "iscsi_get_portal_groups", 00:05:34.062 "iscsi_delete_target_node", 00:05:34.062 "iscsi_target_node_remove_pg_ig_maps", 00:05:34.062 "iscsi_target_node_add_pg_ig_maps", 00:05:34.062 "iscsi_create_target_node", 00:05:34.062 "iscsi_get_target_nodes", 00:05:34.062 "iscsi_delete_initiator_group", 00:05:34.062 "iscsi_initiator_group_remove_initiators", 00:05:34.062 "iscsi_initiator_group_add_initiators", 00:05:34.062 "iscsi_create_initiator_group", 00:05:34.062 "iscsi_get_initiator_groups", 00:05:34.062 "nvmf_set_crdt", 00:05:34.062 "nvmf_set_config", 00:05:34.062 "nvmf_set_max_subsystems", 00:05:34.062 "nvmf_subsystem_get_listeners", 00:05:34.062 "nvmf_subsystem_get_qpairs", 00:05:34.062 "nvmf_subsystem_get_controllers", 00:05:34.062 "nvmf_get_stats", 00:05:34.062 "nvmf_get_transports", 00:05:34.062 "nvmf_create_transport", 00:05:34.062 "nvmf_get_targets", 00:05:34.062 "nvmf_delete_target", 00:05:34.062 "nvmf_create_target", 00:05:34.062 "nvmf_subsystem_allow_any_host", 00:05:34.062 "nvmf_subsystem_remove_host", 00:05:34.062 "nvmf_subsystem_add_host", 00:05:34.062 "nvmf_subsystem_remove_ns", 00:05:34.062 "nvmf_subsystem_add_ns", 00:05:34.062 "nvmf_subsystem_listener_set_ana_state", 00:05:34.062 "nvmf_discovery_get_referrals", 00:05:34.062 "nvmf_discovery_remove_referral", 00:05:34.062 "nvmf_discovery_add_referral", 00:05:34.062 "nvmf_subsystem_remove_listener", 00:05:34.062 "nvmf_subsystem_add_listener", 00:05:34.062 "nvmf_delete_subsystem", 00:05:34.062 "nvmf_create_subsystem", 00:05:34.062 "nvmf_get_subsystems", 00:05:34.062 "env_dpdk_get_mem_stats", 00:05:34.062 "nbd_get_disks", 00:05:34.062 "nbd_stop_disk", 00:05:34.062 "nbd_start_disk", 00:05:34.062 "ublk_recover_disk", 00:05:34.062 "ublk_get_disks", 00:05:34.062 "ublk_stop_disk", 00:05:34.062 "ublk_start_disk", 00:05:34.062 "ublk_destroy_target", 00:05:34.062 "ublk_create_target", 00:05:34.062 "virtio_blk_create_transport", 00:05:34.062 "virtio_blk_get_transports", 00:05:34.062 "vhost_controller_set_coalescing", 00:05:34.062 "vhost_get_controllers", 00:05:34.062 "vhost_delete_controller", 00:05:34.062 "vhost_create_blk_controller", 00:05:34.062 "vhost_scsi_controller_remove_target", 00:05:34.062 "vhost_scsi_controller_add_target", 00:05:34.062 "vhost_start_scsi_controller", 00:05:34.062 "vhost_create_scsi_controller", 00:05:34.062 "thread_set_cpumask", 00:05:34.062 "framework_get_scheduler", 00:05:34.062 "framework_set_scheduler", 00:05:34.062 "framework_get_reactors", 00:05:34.062 "thread_get_io_channels", 00:05:34.062 "thread_get_pollers", 00:05:34.062 "thread_get_stats", 00:05:34.062 "framework_monitor_context_switch", 00:05:34.062 "spdk_kill_instance", 00:05:34.062 "log_enable_timestamps", 00:05:34.062 "log_get_flags", 00:05:34.062 "log_clear_flag", 00:05:34.062 "log_set_flag", 00:05:34.062 "log_get_level", 00:05:34.062 "log_set_level", 00:05:34.062 "log_get_print_level", 00:05:34.062 "log_set_print_level", 00:05:34.062 "framework_enable_cpumask_locks", 00:05:34.062 "framework_disable_cpumask_locks", 00:05:34.062 "framework_wait_init", 00:05:34.062 "framework_start_init", 00:05:34.062 "scsi_get_devices", 00:05:34.062 "bdev_get_histogram", 00:05:34.062 "bdev_enable_histogram", 00:05:34.062 "bdev_set_qos_limit", 00:05:34.062 "bdev_set_qd_sampling_period", 00:05:34.062 "bdev_get_bdevs", 00:05:34.062 "bdev_reset_iostat", 00:05:34.062 "bdev_get_iostat", 00:05:34.062 "bdev_examine", 00:05:34.062 "bdev_wait_for_examine", 00:05:34.062 "bdev_set_options", 00:05:34.062 "notify_get_notifications", 00:05:34.062 "notify_get_types", 00:05:34.062 "accel_get_stats", 00:05:34.062 "accel_set_options", 00:05:34.062 "accel_set_driver", 00:05:34.062 "accel_crypto_key_destroy", 00:05:34.062 "accel_crypto_keys_get", 00:05:34.062 "accel_crypto_key_create", 00:05:34.062 "accel_assign_opc", 00:05:34.062 "accel_get_module_info", 00:05:34.062 "accel_get_opc_assignments", 00:05:34.062 "vmd_rescan", 00:05:34.062 "vmd_remove_device", 00:05:34.062 "vmd_enable", 00:05:34.062 "sock_set_default_impl", 00:05:34.062 "sock_impl_set_options", 00:05:34.062 "sock_impl_get_options", 00:05:34.062 "iobuf_get_stats", 00:05:34.062 "iobuf_set_options", 00:05:34.062 "framework_get_pci_devices", 00:05:34.062 "framework_get_config", 00:05:34.062 "framework_get_subsystems", 00:05:34.062 "vfu_tgt_set_base_path", 00:05:34.062 "trace_get_info", 00:05:34.062 "trace_get_tpoint_group_mask", 00:05:34.062 "trace_disable_tpoint_group", 00:05:34.062 "trace_enable_tpoint_group", 00:05:34.062 "trace_clear_tpoint_mask", 00:05:34.062 "trace_set_tpoint_mask", 00:05:34.062 "spdk_get_version", 00:05:34.062 "rpc_get_methods" 00:05:34.062 ] 00:05:34.062 04:17:13 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:34.062 04:17:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:34.062 04:17:13 -- common/autotest_common.sh@10 -- # set +x 00:05:34.062 04:17:13 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:34.062 04:17:13 -- spdkcli/tcp.sh@38 -- # killprocess 2791029 00:05:34.062 04:17:13 -- common/autotest_common.sh@936 -- # '[' -z 2791029 ']' 00:05:34.062 04:17:13 -- common/autotest_common.sh@940 -- # kill -0 2791029 00:05:34.062 04:17:13 -- common/autotest_common.sh@941 -- # uname 00:05:34.062 04:17:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:34.062 04:17:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2791029 00:05:34.062 04:17:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:34.062 04:17:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:34.062 04:17:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2791029' 00:05:34.062 killing process with pid 2791029 00:05:34.062 04:17:13 -- common/autotest_common.sh@955 -- # kill 2791029 00:05:34.062 04:17:13 -- common/autotest_common.sh@960 -- # wait 2791029 00:05:34.629 00:05:34.629 real 0m1.896s 00:05:34.629 user 0m3.667s 00:05:34.629 sys 0m0.513s 00:05:34.629 04:17:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.629 04:17:13 -- common/autotest_common.sh@10 -- # set +x 00:05:34.629 ************************************ 00:05:34.629 END TEST spdkcli_tcp 00:05:34.629 ************************************ 00:05:34.629 04:17:13 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:34.629 04:17:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.629 04:17:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.629 04:17:13 -- common/autotest_common.sh@10 -- # set +x 00:05:34.629 ************************************ 00:05:34.629 START TEST dpdk_mem_utility 00:05:34.629 ************************************ 00:05:34.629 04:17:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:34.629 * Looking for test storage... 00:05:34.629 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:34.629 04:17:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:34.629 04:17:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:34.629 04:17:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:34.629 04:17:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:34.629 04:17:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:34.629 04:17:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:34.629 04:17:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:34.629 04:17:13 -- scripts/common.sh@335 -- # IFS=.-: 00:05:34.629 04:17:13 -- scripts/common.sh@335 -- # read -ra ver1 00:05:34.629 04:17:13 -- scripts/common.sh@336 -- # IFS=.-: 00:05:34.629 04:17:13 -- scripts/common.sh@336 -- # read -ra ver2 00:05:34.629 04:17:13 -- scripts/common.sh@337 -- # local 'op=<' 00:05:34.629 04:17:13 -- scripts/common.sh@339 -- # ver1_l=2 00:05:34.629 04:17:13 -- scripts/common.sh@340 -- # ver2_l=1 00:05:34.629 04:17:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:34.629 04:17:13 -- scripts/common.sh@343 -- # case "$op" in 00:05:34.629 04:17:13 -- scripts/common.sh@344 -- # : 1 00:05:34.629 04:17:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:34.629 04:17:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:34.629 04:17:13 -- scripts/common.sh@364 -- # decimal 1 00:05:34.629 04:17:13 -- scripts/common.sh@352 -- # local d=1 00:05:34.629 04:17:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:34.629 04:17:13 -- scripts/common.sh@354 -- # echo 1 00:05:34.629 04:17:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:34.629 04:17:13 -- scripts/common.sh@365 -- # decimal 2 00:05:34.629 04:17:13 -- scripts/common.sh@352 -- # local d=2 00:05:34.629 04:17:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:34.629 04:17:13 -- scripts/common.sh@354 -- # echo 2 00:05:34.629 04:17:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:34.629 04:17:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:34.629 04:17:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:34.629 04:17:13 -- scripts/common.sh@367 -- # return 0 00:05:34.630 04:17:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:34.630 04:17:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:34.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.630 --rc genhtml_branch_coverage=1 00:05:34.630 --rc genhtml_function_coverage=1 00:05:34.630 --rc genhtml_legend=1 00:05:34.630 --rc geninfo_all_blocks=1 00:05:34.630 --rc geninfo_unexecuted_blocks=1 00:05:34.630 00:05:34.630 ' 00:05:34.630 04:17:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:34.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.630 --rc genhtml_branch_coverage=1 00:05:34.630 --rc genhtml_function_coverage=1 00:05:34.630 --rc genhtml_legend=1 00:05:34.630 --rc geninfo_all_blocks=1 00:05:34.630 --rc geninfo_unexecuted_blocks=1 00:05:34.630 00:05:34.630 ' 00:05:34.630 04:17:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:34.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.630 --rc genhtml_branch_coverage=1 00:05:34.630 --rc genhtml_function_coverage=1 00:05:34.630 --rc genhtml_legend=1 00:05:34.630 --rc geninfo_all_blocks=1 00:05:34.630 --rc geninfo_unexecuted_blocks=1 00:05:34.630 00:05:34.630 ' 00:05:34.630 04:17:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:34.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.630 --rc genhtml_branch_coverage=1 00:05:34.630 --rc genhtml_function_coverage=1 00:05:34.630 --rc genhtml_legend=1 00:05:34.630 --rc geninfo_all_blocks=1 00:05:34.630 --rc geninfo_unexecuted_blocks=1 00:05:34.630 00:05:34.630 ' 00:05:34.630 04:17:13 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:34.630 04:17:13 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=2791363 00:05:34.630 04:17:13 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:34.630 04:17:13 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 2791363 00:05:34.630 04:17:13 -- common/autotest_common.sh@829 -- # '[' -z 2791363 ']' 00:05:34.630 04:17:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:34.630 04:17:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:34.630 04:17:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:34.630 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:34.630 04:17:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:34.630 04:17:13 -- common/autotest_common.sh@10 -- # set +x 00:05:34.630 [2024-11-26 04:17:13.771853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:34.630 [2024-11-26 04:17:13.771949] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2791363 ] 00:05:34.630 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.630 [2024-11-26 04:17:13.828140] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.888 [2024-11-26 04:17:13.914948] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:34.888 [2024-11-26 04:17:13.915153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.823 04:17:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:35.823 04:17:14 -- common/autotest_common.sh@862 -- # return 0 00:05:35.823 04:17:14 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:35.823 04:17:14 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:35.823 04:17:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.823 04:17:14 -- common/autotest_common.sh@10 -- # set +x 00:05:35.823 { 00:05:35.823 "filename": "/tmp/spdk_mem_dump.txt" 00:05:35.823 } 00:05:35.823 04:17:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.823 04:17:14 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:35.823 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:35.823 1 heaps totaling size 814.000000 MiB 00:05:35.823 size: 814.000000 MiB heap id: 0 00:05:35.823 end heaps---------- 00:05:35.823 8 mempools totaling size 598.116089 MiB 00:05:35.823 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:35.823 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:35.823 size: 84.521057 MiB name: bdev_io_2791363 00:05:35.823 size: 51.011292 MiB name: evtpool_2791363 00:05:35.823 size: 50.003479 MiB name: msgpool_2791363 00:05:35.823 size: 21.763794 MiB name: PDU_Pool 00:05:35.823 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:35.823 size: 0.026123 MiB name: Session_Pool 00:05:35.823 end mempools------- 00:05:35.823 6 memzones totaling size 4.142822 MiB 00:05:35.823 size: 1.000366 MiB name: RG_ring_0_2791363 00:05:35.823 size: 1.000366 MiB name: RG_ring_1_2791363 00:05:35.823 size: 1.000366 MiB name: RG_ring_4_2791363 00:05:35.823 size: 1.000366 MiB name: RG_ring_5_2791363 00:05:35.823 size: 0.125366 MiB name: RG_ring_2_2791363 00:05:35.823 size: 0.015991 MiB name: RG_ring_3_2791363 00:05:35.823 end memzones------- 00:05:35.823 04:17:14 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:35.823 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:35.823 list of free elements. size: 12.519348 MiB 00:05:35.823 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:35.823 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:35.823 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:35.823 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:35.823 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:35.823 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:35.823 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:35.823 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:35.823 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:35.823 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:35.823 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:35.823 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:35.823 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:35.823 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:35.823 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:35.823 list of standard malloc elements. size: 199.218079 MiB 00:05:35.823 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:35.823 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:35.823 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:35.823 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:35.823 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:35.823 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:35.823 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:35.823 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:35.823 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:35.823 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:35.823 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:35.823 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:35.823 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:35.823 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:35.823 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:35.823 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:35.823 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:35.823 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:35.823 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:35.823 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:35.823 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:35.823 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:35.823 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:35.823 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:35.823 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:35.823 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:35.823 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:35.823 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:35.823 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:35.823 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:35.823 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:35.823 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:35.823 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:35.823 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:35.823 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:35.823 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:35.823 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:35.823 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:35.824 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:35.824 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:35.824 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:35.824 list of memzone associated elements. size: 602.262573 MiB 00:05:35.824 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:35.824 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:35.824 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:35.824 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:35.824 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:35.824 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_2791363_0 00:05:35.824 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:35.824 associated memzone info: size: 48.002930 MiB name: MP_evtpool_2791363_0 00:05:35.824 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:35.824 associated memzone info: size: 48.002930 MiB name: MP_msgpool_2791363_0 00:05:35.824 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:35.824 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:35.824 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:35.824 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:35.824 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:35.824 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_2791363 00:05:35.824 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:35.824 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_2791363 00:05:35.824 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:35.824 associated memzone info: size: 1.007996 MiB name: MP_evtpool_2791363 00:05:35.824 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:35.824 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:35.824 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:35.824 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:35.824 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:35.824 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:35.824 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:35.824 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:35.824 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:35.824 associated memzone info: size: 1.000366 MiB name: RG_ring_0_2791363 00:05:35.824 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:35.824 associated memzone info: size: 1.000366 MiB name: RG_ring_1_2791363 00:05:35.824 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:35.824 associated memzone info: size: 1.000366 MiB name: RG_ring_4_2791363 00:05:35.824 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:35.824 associated memzone info: size: 1.000366 MiB name: RG_ring_5_2791363 00:05:35.824 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:35.824 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_2791363 00:05:35.824 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:35.824 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:35.824 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:35.824 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:35.824 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:35.824 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:35.824 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:35.824 associated memzone info: size: 0.125366 MiB name: RG_ring_2_2791363 00:05:35.824 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:35.824 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:35.824 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:35.824 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:35.824 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:35.824 associated memzone info: size: 0.015991 MiB name: RG_ring_3_2791363 00:05:35.824 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:35.824 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:35.824 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:35.824 associated memzone info: size: 0.000183 MiB name: MP_msgpool_2791363 00:05:35.824 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:35.824 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_2791363 00:05:35.824 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:35.824 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:35.824 04:17:14 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:35.824 04:17:14 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 2791363 00:05:35.824 04:17:14 -- common/autotest_common.sh@936 -- # '[' -z 2791363 ']' 00:05:35.824 04:17:14 -- common/autotest_common.sh@940 -- # kill -0 2791363 00:05:35.824 04:17:14 -- common/autotest_common.sh@941 -- # uname 00:05:35.824 04:17:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:35.824 04:17:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2791363 00:05:35.824 04:17:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:35.824 04:17:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:35.824 04:17:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2791363' 00:05:35.824 killing process with pid 2791363 00:05:35.824 04:17:14 -- common/autotest_common.sh@955 -- # kill 2791363 00:05:35.824 04:17:14 -- common/autotest_common.sh@960 -- # wait 2791363 00:05:36.083 00:05:36.083 real 0m1.685s 00:05:36.083 user 0m1.839s 00:05:36.083 sys 0m0.450s 00:05:36.083 04:17:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.083 04:17:15 -- common/autotest_common.sh@10 -- # set +x 00:05:36.083 ************************************ 00:05:36.083 END TEST dpdk_mem_utility 00:05:36.083 ************************************ 00:05:36.083 04:17:15 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:36.083 04:17:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:36.083 04:17:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.083 04:17:15 -- common/autotest_common.sh@10 -- # set +x 00:05:36.083 ************************************ 00:05:36.083 START TEST event 00:05:36.083 ************************************ 00:05:36.083 04:17:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:36.341 * Looking for test storage... 00:05:36.341 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:36.341 04:17:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:36.341 04:17:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:36.341 04:17:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:36.341 04:17:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:36.341 04:17:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:36.341 04:17:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:36.341 04:17:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:36.341 04:17:15 -- scripts/common.sh@335 -- # IFS=.-: 00:05:36.341 04:17:15 -- scripts/common.sh@335 -- # read -ra ver1 00:05:36.341 04:17:15 -- scripts/common.sh@336 -- # IFS=.-: 00:05:36.341 04:17:15 -- scripts/common.sh@336 -- # read -ra ver2 00:05:36.341 04:17:15 -- scripts/common.sh@337 -- # local 'op=<' 00:05:36.341 04:17:15 -- scripts/common.sh@339 -- # ver1_l=2 00:05:36.341 04:17:15 -- scripts/common.sh@340 -- # ver2_l=1 00:05:36.341 04:17:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:36.341 04:17:15 -- scripts/common.sh@343 -- # case "$op" in 00:05:36.341 04:17:15 -- scripts/common.sh@344 -- # : 1 00:05:36.341 04:17:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:36.341 04:17:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:36.341 04:17:15 -- scripts/common.sh@364 -- # decimal 1 00:05:36.341 04:17:15 -- scripts/common.sh@352 -- # local d=1 00:05:36.341 04:17:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:36.341 04:17:15 -- scripts/common.sh@354 -- # echo 1 00:05:36.341 04:17:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:36.341 04:17:15 -- scripts/common.sh@365 -- # decimal 2 00:05:36.341 04:17:15 -- scripts/common.sh@352 -- # local d=2 00:05:36.341 04:17:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:36.341 04:17:15 -- scripts/common.sh@354 -- # echo 2 00:05:36.341 04:17:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:36.341 04:17:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:36.341 04:17:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:36.341 04:17:15 -- scripts/common.sh@367 -- # return 0 00:05:36.341 04:17:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:36.341 04:17:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:36.341 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.341 --rc genhtml_branch_coverage=1 00:05:36.341 --rc genhtml_function_coverage=1 00:05:36.341 --rc genhtml_legend=1 00:05:36.341 --rc geninfo_all_blocks=1 00:05:36.341 --rc geninfo_unexecuted_blocks=1 00:05:36.341 00:05:36.341 ' 00:05:36.341 04:17:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:36.341 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.341 --rc genhtml_branch_coverage=1 00:05:36.341 --rc genhtml_function_coverage=1 00:05:36.341 --rc genhtml_legend=1 00:05:36.341 --rc geninfo_all_blocks=1 00:05:36.341 --rc geninfo_unexecuted_blocks=1 00:05:36.341 00:05:36.341 ' 00:05:36.341 04:17:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:36.341 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.341 --rc genhtml_branch_coverage=1 00:05:36.341 --rc genhtml_function_coverage=1 00:05:36.341 --rc genhtml_legend=1 00:05:36.341 --rc geninfo_all_blocks=1 00:05:36.341 --rc geninfo_unexecuted_blocks=1 00:05:36.341 00:05:36.341 ' 00:05:36.341 04:17:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:36.341 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.341 --rc genhtml_branch_coverage=1 00:05:36.341 --rc genhtml_function_coverage=1 00:05:36.341 --rc genhtml_legend=1 00:05:36.341 --rc geninfo_all_blocks=1 00:05:36.341 --rc geninfo_unexecuted_blocks=1 00:05:36.341 00:05:36.341 ' 00:05:36.341 04:17:15 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:36.341 04:17:15 -- bdev/nbd_common.sh@6 -- # set -e 00:05:36.341 04:17:15 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:36.341 04:17:15 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:36.341 04:17:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.341 04:17:15 -- common/autotest_common.sh@10 -- # set +x 00:05:36.341 ************************************ 00:05:36.341 START TEST event_perf 00:05:36.341 ************************************ 00:05:36.341 04:17:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:36.341 Running I/O for 1 seconds...[2024-11-26 04:17:15.458193] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:36.341 [2024-11-26 04:17:15.458281] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2791693 ] 00:05:36.341 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.341 [2024-11-26 04:17:15.519945] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:36.605 [2024-11-26 04:17:15.612607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:36.605 [2024-11-26 04:17:15.612660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:36.605 [2024-11-26 04:17:15.612778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.605 [2024-11-26 04:17:15.612774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:37.537 Running I/O for 1 seconds... 00:05:37.537 lcore 0: 231280 00:05:37.537 lcore 1: 231279 00:05:37.537 lcore 2: 231280 00:05:37.537 lcore 3: 231279 00:05:37.537 done. 00:05:37.537 00:05:37.537 real 0m1.253s 00:05:37.538 user 0m4.162s 00:05:37.538 sys 0m0.086s 00:05:37.538 04:17:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.538 04:17:16 -- common/autotest_common.sh@10 -- # set +x 00:05:37.538 ************************************ 00:05:37.538 END TEST event_perf 00:05:37.538 ************************************ 00:05:37.538 04:17:16 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:37.538 04:17:16 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:37.538 04:17:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.538 04:17:16 -- common/autotest_common.sh@10 -- # set +x 00:05:37.538 ************************************ 00:05:37.538 START TEST event_reactor 00:05:37.538 ************************************ 00:05:37.538 04:17:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:37.538 [2024-11-26 04:17:16.739846] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:37.538 [2024-11-26 04:17:16.739940] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2791850 ] 00:05:37.795 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.795 [2024-11-26 04:17:16.803115] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.795 [2024-11-26 04:17:16.893329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.168 test_start 00:05:39.168 oneshot 00:05:39.168 tick 100 00:05:39.168 tick 100 00:05:39.168 tick 250 00:05:39.168 tick 100 00:05:39.168 tick 100 00:05:39.168 tick 250 00:05:39.168 tick 500 00:05:39.168 tick 100 00:05:39.168 tick 100 00:05:39.168 tick 100 00:05:39.168 tick 250 00:05:39.168 tick 100 00:05:39.168 tick 100 00:05:39.168 test_end 00:05:39.168 00:05:39.168 real 0m1.250s 00:05:39.168 user 0m1.157s 00:05:39.168 sys 0m0.089s 00:05:39.168 04:17:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.168 04:17:17 -- common/autotest_common.sh@10 -- # set +x 00:05:39.168 ************************************ 00:05:39.168 END TEST event_reactor 00:05:39.168 ************************************ 00:05:39.168 04:17:17 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:39.168 04:17:17 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:39.168 04:17:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.168 04:17:17 -- common/autotest_common.sh@10 -- # set +x 00:05:39.168 ************************************ 00:05:39.168 START TEST event_reactor_perf 00:05:39.168 ************************************ 00:05:39.168 04:17:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:39.168 [2024-11-26 04:17:18.013890] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:39.168 [2024-11-26 04:17:18.013993] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2792006 ] 00:05:39.168 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.168 [2024-11-26 04:17:18.075269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.168 [2024-11-26 04:17:18.167829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.102 test_start 00:05:40.102 test_end 00:05:40.102 Performance: 354417 events per second 00:05:40.102 00:05:40.102 real 0m1.249s 00:05:40.102 user 0m1.157s 00:05:40.102 sys 0m0.087s 00:05:40.102 04:17:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.102 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.102 ************************************ 00:05:40.102 END TEST event_reactor_perf 00:05:40.102 ************************************ 00:05:40.102 04:17:19 -- event/event.sh@49 -- # uname -s 00:05:40.102 04:17:19 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:40.102 04:17:19 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:40.102 04:17:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.102 04:17:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.102 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.102 ************************************ 00:05:40.102 START TEST event_scheduler 00:05:40.102 ************************************ 00:05:40.102 04:17:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:40.102 * Looking for test storage... 00:05:40.362 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:05:40.362 04:17:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:40.362 04:17:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:40.362 04:17:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:40.362 04:17:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:40.362 04:17:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:40.362 04:17:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:40.362 04:17:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:40.362 04:17:19 -- scripts/common.sh@335 -- # IFS=.-: 00:05:40.362 04:17:19 -- scripts/common.sh@335 -- # read -ra ver1 00:05:40.362 04:17:19 -- scripts/common.sh@336 -- # IFS=.-: 00:05:40.362 04:17:19 -- scripts/common.sh@336 -- # read -ra ver2 00:05:40.362 04:17:19 -- scripts/common.sh@337 -- # local 'op=<' 00:05:40.362 04:17:19 -- scripts/common.sh@339 -- # ver1_l=2 00:05:40.362 04:17:19 -- scripts/common.sh@340 -- # ver2_l=1 00:05:40.362 04:17:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:40.362 04:17:19 -- scripts/common.sh@343 -- # case "$op" in 00:05:40.362 04:17:19 -- scripts/common.sh@344 -- # : 1 00:05:40.362 04:17:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:40.362 04:17:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:40.362 04:17:19 -- scripts/common.sh@364 -- # decimal 1 00:05:40.362 04:17:19 -- scripts/common.sh@352 -- # local d=1 00:05:40.362 04:17:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:40.362 04:17:19 -- scripts/common.sh@354 -- # echo 1 00:05:40.362 04:17:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:40.362 04:17:19 -- scripts/common.sh@365 -- # decimal 2 00:05:40.362 04:17:19 -- scripts/common.sh@352 -- # local d=2 00:05:40.362 04:17:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:40.362 04:17:19 -- scripts/common.sh@354 -- # echo 2 00:05:40.362 04:17:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:40.362 04:17:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:40.362 04:17:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:40.362 04:17:19 -- scripts/common.sh@367 -- # return 0 00:05:40.362 04:17:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:40.362 04:17:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:40.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:40.362 --rc genhtml_branch_coverage=1 00:05:40.362 --rc genhtml_function_coverage=1 00:05:40.362 --rc genhtml_legend=1 00:05:40.362 --rc geninfo_all_blocks=1 00:05:40.362 --rc geninfo_unexecuted_blocks=1 00:05:40.362 00:05:40.362 ' 00:05:40.362 04:17:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:40.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:40.362 --rc genhtml_branch_coverage=1 00:05:40.362 --rc genhtml_function_coverage=1 00:05:40.362 --rc genhtml_legend=1 00:05:40.362 --rc geninfo_all_blocks=1 00:05:40.362 --rc geninfo_unexecuted_blocks=1 00:05:40.362 00:05:40.362 ' 00:05:40.362 04:17:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:40.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:40.362 --rc genhtml_branch_coverage=1 00:05:40.362 --rc genhtml_function_coverage=1 00:05:40.362 --rc genhtml_legend=1 00:05:40.362 --rc geninfo_all_blocks=1 00:05:40.362 --rc geninfo_unexecuted_blocks=1 00:05:40.362 00:05:40.362 ' 00:05:40.362 04:17:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:40.362 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:40.362 --rc genhtml_branch_coverage=1 00:05:40.362 --rc genhtml_function_coverage=1 00:05:40.362 --rc genhtml_legend=1 00:05:40.362 --rc geninfo_all_blocks=1 00:05:40.362 --rc geninfo_unexecuted_blocks=1 00:05:40.362 00:05:40.362 ' 00:05:40.362 04:17:19 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:40.362 04:17:19 -- scheduler/scheduler.sh@35 -- # scheduler_pid=2792203 00:05:40.362 04:17:19 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:40.362 04:17:19 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:40.362 04:17:19 -- scheduler/scheduler.sh@37 -- # waitforlisten 2792203 00:05:40.362 04:17:19 -- common/autotest_common.sh@829 -- # '[' -z 2792203 ']' 00:05:40.362 04:17:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:40.362 04:17:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:40.362 04:17:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:40.362 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:40.362 04:17:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:40.362 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.362 [2024-11-26 04:17:19.457114] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:40.362 [2024-11-26 04:17:19.457197] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2792203 ] 00:05:40.362 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.362 [2024-11-26 04:17:19.516928] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:40.621 [2024-11-26 04:17:19.601344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.621 [2024-11-26 04:17:19.601401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:40.621 [2024-11-26 04:17:19.601469] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:40.621 [2024-11-26 04:17:19.601472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:40.621 04:17:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:40.621 04:17:19 -- common/autotest_common.sh@862 -- # return 0 00:05:40.621 04:17:19 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:40.621 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.621 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.621 POWER: Env isn't set yet! 00:05:40.621 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:40.621 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:05:40.621 POWER: Cannot get available frequencies of lcore 0 00:05:40.621 POWER: Attempting to initialise PSTAT power management... 00:05:40.621 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:40.621 POWER: Initialized successfully for lcore 0 power management 00:05:40.621 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:40.621 POWER: Initialized successfully for lcore 1 power management 00:05:40.621 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:40.621 POWER: Initialized successfully for lcore 2 power management 00:05:40.621 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:40.621 POWER: Initialized successfully for lcore 3 power management 00:05:40.621 [2024-11-26 04:17:19.721883] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:05:40.621 [2024-11-26 04:17:19.721901] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:05:40.621 [2024-11-26 04:17:19.721913] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:05:40.621 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.621 04:17:19 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:40.621 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.621 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.621 [2024-11-26 04:17:19.821186] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:40.621 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.621 04:17:19 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:40.621 04:17:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.621 04:17:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.621 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.621 ************************************ 00:05:40.621 START TEST scheduler_create_thread 00:05:40.621 ************************************ 00:05:40.621 04:17:19 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:05:40.621 04:17:19 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:40.621 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.621 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.621 2 00:05:40.621 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.621 04:17:19 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:40.621 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.621 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.880 3 00:05:40.880 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.880 04:17:19 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:40.880 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.880 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.880 4 00:05:40.880 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.880 04:17:19 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:40.880 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.880 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.880 5 00:05:40.880 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.880 04:17:19 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:40.880 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.880 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.880 6 00:05:40.880 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.880 04:17:19 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:40.880 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.880 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.880 7 00:05:40.880 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.880 04:17:19 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:40.880 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.880 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.880 8 00:05:40.880 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.880 04:17:19 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:40.880 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.880 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.880 9 00:05:40.880 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.880 04:17:19 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:40.880 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.880 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.880 10 00:05:40.880 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.880 04:17:19 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:40.880 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.880 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.880 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.880 04:17:19 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:40.880 04:17:19 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:40.880 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.880 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:40.880 04:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.880 04:17:19 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:40.880 04:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.880 04:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:42.255 04:17:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.255 04:17:21 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:42.255 04:17:21 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:42.255 04:17:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.255 04:17:21 -- common/autotest_common.sh@10 -- # set +x 00:05:43.655 04:17:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.655 00:05:43.655 real 0m2.621s 00:05:43.655 user 0m0.012s 00:05:43.655 sys 0m0.003s 00:05:43.655 04:17:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.655 04:17:22 -- common/autotest_common.sh@10 -- # set +x 00:05:43.655 ************************************ 00:05:43.655 END TEST scheduler_create_thread 00:05:43.655 ************************************ 00:05:43.655 04:17:22 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:43.655 04:17:22 -- scheduler/scheduler.sh@46 -- # killprocess 2792203 00:05:43.655 04:17:22 -- common/autotest_common.sh@936 -- # '[' -z 2792203 ']' 00:05:43.655 04:17:22 -- common/autotest_common.sh@940 -- # kill -0 2792203 00:05:43.655 04:17:22 -- common/autotest_common.sh@941 -- # uname 00:05:43.655 04:17:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:43.655 04:17:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2792203 00:05:43.655 04:17:22 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:43.655 04:17:22 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:43.655 04:17:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2792203' 00:05:43.655 killing process with pid 2792203 00:05:43.655 04:17:22 -- common/autotest_common.sh@955 -- # kill 2792203 00:05:43.655 04:17:22 -- common/autotest_common.sh@960 -- # wait 2792203 00:05:43.959 [2024-11-26 04:17:22.928537] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:43.959 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:05:43.959 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:43.959 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:05:43.959 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:43.959 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:05:43.959 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:43.959 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:05:43.959 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:43.959 00:05:43.959 real 0m3.875s 00:05:43.959 user 0m5.906s 00:05:43.959 sys 0m0.319s 00:05:43.959 04:17:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.959 04:17:23 -- common/autotest_common.sh@10 -- # set +x 00:05:43.959 ************************************ 00:05:43.959 END TEST event_scheduler 00:05:43.959 ************************************ 00:05:44.218 04:17:23 -- event/event.sh@51 -- # modprobe -n nbd 00:05:44.218 04:17:23 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:44.218 04:17:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:44.218 04:17:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.218 04:17:23 -- common/autotest_common.sh@10 -- # set +x 00:05:44.218 ************************************ 00:05:44.218 START TEST app_repeat 00:05:44.218 ************************************ 00:05:44.218 04:17:23 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:05:44.218 04:17:23 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:44.218 04:17:23 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:44.218 04:17:23 -- event/event.sh@13 -- # local nbd_list 00:05:44.218 04:17:23 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:44.218 04:17:23 -- event/event.sh@14 -- # local bdev_list 00:05:44.218 04:17:23 -- event/event.sh@15 -- # local repeat_times=4 00:05:44.218 04:17:23 -- event/event.sh@17 -- # modprobe nbd 00:05:44.218 04:17:23 -- event/event.sh@19 -- # repeat_pid=2792789 00:05:44.218 04:17:23 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:44.218 04:17:23 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:44.218 04:17:23 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 2792789' 00:05:44.218 Process app_repeat pid: 2792789 00:05:44.218 04:17:23 -- event/event.sh@23 -- # for i in {0..2} 00:05:44.218 04:17:23 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:44.218 spdk_app_start Round 0 00:05:44.218 04:17:23 -- event/event.sh@25 -- # waitforlisten 2792789 /var/tmp/spdk-nbd.sock 00:05:44.218 04:17:23 -- common/autotest_common.sh@829 -- # '[' -z 2792789 ']' 00:05:44.218 04:17:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:44.218 04:17:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:44.218 04:17:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:44.218 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:44.218 04:17:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:44.218 04:17:23 -- common/autotest_common.sh@10 -- # set +x 00:05:44.218 [2024-11-26 04:17:23.212510] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:44.218 [2024-11-26 04:17:23.212591] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2792789 ] 00:05:44.218 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.218 [2024-11-26 04:17:23.276123] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:44.218 [2024-11-26 04:17:23.364623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:44.218 [2024-11-26 04:17:23.364628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.151 04:17:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:45.151 04:17:24 -- common/autotest_common.sh@862 -- # return 0 00:05:45.151 04:17:24 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:45.409 Malloc0 00:05:45.409 04:17:24 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:45.668 Malloc1 00:05:45.668 04:17:24 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@12 -- # local i 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:45.668 04:17:24 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:45.929 /dev/nbd0 00:05:45.929 04:17:25 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:45.929 04:17:25 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:45.929 04:17:25 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:45.929 04:17:25 -- common/autotest_common.sh@867 -- # local i 00:05:45.929 04:17:25 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:45.929 04:17:25 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:45.929 04:17:25 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:45.929 04:17:25 -- common/autotest_common.sh@871 -- # break 00:05:45.929 04:17:25 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:45.929 04:17:25 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:45.929 04:17:25 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:45.929 1+0 records in 00:05:45.929 1+0 records out 00:05:45.929 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000184389 s, 22.2 MB/s 00:05:45.929 04:17:25 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:45.929 04:17:25 -- common/autotest_common.sh@884 -- # size=4096 00:05:45.929 04:17:25 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:45.929 04:17:25 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:45.929 04:17:25 -- common/autotest_common.sh@887 -- # return 0 00:05:45.929 04:17:25 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:45.929 04:17:25 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:45.929 04:17:25 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:46.186 /dev/nbd1 00:05:46.186 04:17:25 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:46.186 04:17:25 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:46.186 04:17:25 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:46.186 04:17:25 -- common/autotest_common.sh@867 -- # local i 00:05:46.186 04:17:25 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:46.186 04:17:25 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:46.186 04:17:25 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:46.186 04:17:25 -- common/autotest_common.sh@871 -- # break 00:05:46.186 04:17:25 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:46.186 04:17:25 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:46.186 04:17:25 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:46.186 1+0 records in 00:05:46.186 1+0 records out 00:05:46.186 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00019055 s, 21.5 MB/s 00:05:46.186 04:17:25 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:46.186 04:17:25 -- common/autotest_common.sh@884 -- # size=4096 00:05:46.186 04:17:25 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:46.186 04:17:25 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:46.186 04:17:25 -- common/autotest_common.sh@887 -- # return 0 00:05:46.186 04:17:25 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:46.186 04:17:25 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:46.186 04:17:25 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:46.186 04:17:25 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:46.186 04:17:25 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:46.444 04:17:25 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:46.444 { 00:05:46.444 "nbd_device": "/dev/nbd0", 00:05:46.444 "bdev_name": "Malloc0" 00:05:46.444 }, 00:05:46.444 { 00:05:46.444 "nbd_device": "/dev/nbd1", 00:05:46.444 "bdev_name": "Malloc1" 00:05:46.444 } 00:05:46.444 ]' 00:05:46.444 04:17:25 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:46.444 { 00:05:46.444 "nbd_device": "/dev/nbd0", 00:05:46.444 "bdev_name": "Malloc0" 00:05:46.444 }, 00:05:46.444 { 00:05:46.444 "nbd_device": "/dev/nbd1", 00:05:46.444 "bdev_name": "Malloc1" 00:05:46.444 } 00:05:46.444 ]' 00:05:46.444 04:17:25 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:46.444 04:17:25 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:46.444 /dev/nbd1' 00:05:46.444 04:17:25 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:46.445 /dev/nbd1' 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@65 -- # count=2 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@95 -- # count=2 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:46.445 256+0 records in 00:05:46.445 256+0 records out 00:05:46.445 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00389293 s, 269 MB/s 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:46.445 256+0 records in 00:05:46.445 256+0 records out 00:05:46.445 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224194 s, 46.8 MB/s 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:46.445 04:17:25 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:46.703 256+0 records in 00:05:46.703 256+0 records out 00:05:46.703 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244744 s, 42.8 MB/s 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@51 -- # local i 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:46.703 04:17:25 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:46.961 04:17:25 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:46.961 04:17:25 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:46.961 04:17:25 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:46.961 04:17:25 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:46.961 04:17:25 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:46.961 04:17:25 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:46.961 04:17:25 -- bdev/nbd_common.sh@41 -- # break 00:05:46.961 04:17:25 -- bdev/nbd_common.sh@45 -- # return 0 00:05:46.961 04:17:25 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:46.961 04:17:25 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:47.219 04:17:26 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:47.219 04:17:26 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:47.219 04:17:26 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:47.219 04:17:26 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:47.219 04:17:26 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:47.219 04:17:26 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:47.219 04:17:26 -- bdev/nbd_common.sh@41 -- # break 00:05:47.219 04:17:26 -- bdev/nbd_common.sh@45 -- # return 0 00:05:47.219 04:17:26 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:47.219 04:17:26 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:47.219 04:17:26 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:47.478 04:17:26 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:47.478 04:17:26 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:47.478 04:17:26 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:47.478 04:17:26 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:47.478 04:17:26 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:47.478 04:17:26 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:47.478 04:17:26 -- bdev/nbd_common.sh@65 -- # true 00:05:47.478 04:17:26 -- bdev/nbd_common.sh@65 -- # count=0 00:05:47.478 04:17:26 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:47.478 04:17:26 -- bdev/nbd_common.sh@104 -- # count=0 00:05:47.478 04:17:26 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:47.478 04:17:26 -- bdev/nbd_common.sh@109 -- # return 0 00:05:47.478 04:17:26 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:47.735 04:17:26 -- event/event.sh@35 -- # sleep 3 00:05:47.994 [2024-11-26 04:17:27.058644] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:47.994 [2024-11-26 04:17:27.146091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:47.994 [2024-11-26 04:17:27.146091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.994 [2024-11-26 04:17:27.207442] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:47.994 [2024-11-26 04:17:27.207531] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:51.276 04:17:29 -- event/event.sh@23 -- # for i in {0..2} 00:05:51.276 04:17:29 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:51.276 spdk_app_start Round 1 00:05:51.276 04:17:29 -- event/event.sh@25 -- # waitforlisten 2792789 /var/tmp/spdk-nbd.sock 00:05:51.276 04:17:29 -- common/autotest_common.sh@829 -- # '[' -z 2792789 ']' 00:05:51.276 04:17:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:51.276 04:17:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:51.276 04:17:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:51.276 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:51.276 04:17:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:51.276 04:17:29 -- common/autotest_common.sh@10 -- # set +x 00:05:51.276 04:17:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:51.276 04:17:30 -- common/autotest_common.sh@862 -- # return 0 00:05:51.276 04:17:30 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:51.276 Malloc0 00:05:51.276 04:17:30 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:51.534 Malloc1 00:05:51.534 04:17:30 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:51.534 04:17:30 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:51.534 04:17:30 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:51.534 04:17:30 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:51.534 04:17:30 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:51.534 04:17:30 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:51.534 04:17:30 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:51.534 04:17:30 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:51.534 04:17:30 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:51.534 04:17:30 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:51.534 04:17:30 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:51.534 04:17:30 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:51.535 04:17:30 -- bdev/nbd_common.sh@12 -- # local i 00:05:51.535 04:17:30 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:51.535 04:17:30 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:51.535 04:17:30 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:51.793 /dev/nbd0 00:05:51.793 04:17:30 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:51.793 04:17:30 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:51.793 04:17:30 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:51.793 04:17:30 -- common/autotest_common.sh@867 -- # local i 00:05:51.793 04:17:30 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:51.793 04:17:30 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:51.793 04:17:30 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:51.793 04:17:30 -- common/autotest_common.sh@871 -- # break 00:05:51.793 04:17:30 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:51.793 04:17:30 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:51.793 04:17:30 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:51.793 1+0 records in 00:05:51.793 1+0 records out 00:05:51.793 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000172961 s, 23.7 MB/s 00:05:51.793 04:17:30 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:51.793 04:17:30 -- common/autotest_common.sh@884 -- # size=4096 00:05:51.793 04:17:30 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:51.793 04:17:30 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:51.793 04:17:30 -- common/autotest_common.sh@887 -- # return 0 00:05:51.793 04:17:30 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:51.793 04:17:30 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:51.793 04:17:30 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:52.050 /dev/nbd1 00:05:52.050 04:17:31 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:52.050 04:17:31 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:52.050 04:17:31 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:52.050 04:17:31 -- common/autotest_common.sh@867 -- # local i 00:05:52.050 04:17:31 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:52.050 04:17:31 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:52.050 04:17:31 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:52.050 04:17:31 -- common/autotest_common.sh@871 -- # break 00:05:52.050 04:17:31 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:52.050 04:17:31 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:52.050 04:17:31 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:52.050 1+0 records in 00:05:52.050 1+0 records out 00:05:52.050 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000200851 s, 20.4 MB/s 00:05:52.050 04:17:31 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:52.050 04:17:31 -- common/autotest_common.sh@884 -- # size=4096 00:05:52.050 04:17:31 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:52.050 04:17:31 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:52.050 04:17:31 -- common/autotest_common.sh@887 -- # return 0 00:05:52.050 04:17:31 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:52.050 04:17:31 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:52.050 04:17:31 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:52.050 04:17:31 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:52.050 04:17:31 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:52.308 04:17:31 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:52.308 { 00:05:52.308 "nbd_device": "/dev/nbd0", 00:05:52.309 "bdev_name": "Malloc0" 00:05:52.309 }, 00:05:52.309 { 00:05:52.309 "nbd_device": "/dev/nbd1", 00:05:52.309 "bdev_name": "Malloc1" 00:05:52.309 } 00:05:52.309 ]' 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:52.309 { 00:05:52.309 "nbd_device": "/dev/nbd0", 00:05:52.309 "bdev_name": "Malloc0" 00:05:52.309 }, 00:05:52.309 { 00:05:52.309 "nbd_device": "/dev/nbd1", 00:05:52.309 "bdev_name": "Malloc1" 00:05:52.309 } 00:05:52.309 ]' 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:52.309 /dev/nbd1' 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:52.309 /dev/nbd1' 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@65 -- # count=2 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@95 -- # count=2 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:52.309 256+0 records in 00:05:52.309 256+0 records out 00:05:52.309 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00510532 s, 205 MB/s 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:52.309 256+0 records in 00:05:52.309 256+0 records out 00:05:52.309 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225007 s, 46.6 MB/s 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:52.309 04:17:31 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:52.567 256+0 records in 00:05:52.567 256+0 records out 00:05:52.567 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244511 s, 42.9 MB/s 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@51 -- # local i 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:52.567 04:17:31 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:52.825 04:17:31 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:52.826 04:17:31 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:52.826 04:17:31 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:52.826 04:17:31 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:52.826 04:17:31 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:52.826 04:17:31 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:52.826 04:17:31 -- bdev/nbd_common.sh@41 -- # break 00:05:52.826 04:17:31 -- bdev/nbd_common.sh@45 -- # return 0 00:05:52.826 04:17:31 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:52.826 04:17:31 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:53.083 04:17:32 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:53.083 04:17:32 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:53.083 04:17:32 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:53.083 04:17:32 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:53.083 04:17:32 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:53.083 04:17:32 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:53.083 04:17:32 -- bdev/nbd_common.sh@41 -- # break 00:05:53.083 04:17:32 -- bdev/nbd_common.sh@45 -- # return 0 00:05:53.083 04:17:32 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:53.083 04:17:32 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:53.083 04:17:32 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:53.341 04:17:32 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:53.341 04:17:32 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:53.341 04:17:32 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:53.341 04:17:32 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:53.341 04:17:32 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:53.341 04:17:32 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:53.341 04:17:32 -- bdev/nbd_common.sh@65 -- # true 00:05:53.341 04:17:32 -- bdev/nbd_common.sh@65 -- # count=0 00:05:53.341 04:17:32 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:53.341 04:17:32 -- bdev/nbd_common.sh@104 -- # count=0 00:05:53.341 04:17:32 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:53.341 04:17:32 -- bdev/nbd_common.sh@109 -- # return 0 00:05:53.341 04:17:32 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:53.600 04:17:32 -- event/event.sh@35 -- # sleep 3 00:05:53.858 [2024-11-26 04:17:32.907676] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:53.858 [2024-11-26 04:17:32.994709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:53.858 [2024-11-26 04:17:32.994713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.858 [2024-11-26 04:17:33.055962] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:53.858 [2024-11-26 04:17:33.056050] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:57.138 04:17:35 -- event/event.sh@23 -- # for i in {0..2} 00:05:57.138 04:17:35 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:57.138 spdk_app_start Round 2 00:05:57.138 04:17:35 -- event/event.sh@25 -- # waitforlisten 2792789 /var/tmp/spdk-nbd.sock 00:05:57.138 04:17:35 -- common/autotest_common.sh@829 -- # '[' -z 2792789 ']' 00:05:57.138 04:17:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:57.138 04:17:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:57.138 04:17:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:57.138 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:57.138 04:17:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:57.138 04:17:35 -- common/autotest_common.sh@10 -- # set +x 00:05:57.138 04:17:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:57.138 04:17:35 -- common/autotest_common.sh@862 -- # return 0 00:05:57.138 04:17:35 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:57.138 Malloc0 00:05:57.138 04:17:36 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:57.396 Malloc1 00:05:57.396 04:17:36 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:57.396 04:17:36 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:57.396 04:17:36 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:57.396 04:17:36 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:57.396 04:17:36 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:57.396 04:17:36 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:57.396 04:17:36 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:57.397 04:17:36 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:57.397 04:17:36 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:57.397 04:17:36 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:57.397 04:17:36 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:57.397 04:17:36 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:57.397 04:17:36 -- bdev/nbd_common.sh@12 -- # local i 00:05:57.397 04:17:36 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:57.397 04:17:36 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:57.397 04:17:36 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:57.654 /dev/nbd0 00:05:57.654 04:17:36 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:57.654 04:17:36 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:57.654 04:17:36 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:57.654 04:17:36 -- common/autotest_common.sh@867 -- # local i 00:05:57.654 04:17:36 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:57.654 04:17:36 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:57.654 04:17:36 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:57.654 04:17:36 -- common/autotest_common.sh@871 -- # break 00:05:57.654 04:17:36 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:57.654 04:17:36 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:57.654 04:17:36 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:57.654 1+0 records in 00:05:57.654 1+0 records out 00:05:57.654 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000183873 s, 22.3 MB/s 00:05:57.654 04:17:36 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:57.654 04:17:36 -- common/autotest_common.sh@884 -- # size=4096 00:05:57.654 04:17:36 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:57.654 04:17:36 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:57.654 04:17:36 -- common/autotest_common.sh@887 -- # return 0 00:05:57.654 04:17:36 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:57.654 04:17:36 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:57.654 04:17:36 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:57.912 /dev/nbd1 00:05:57.912 04:17:36 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:57.912 04:17:36 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:57.912 04:17:36 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:57.912 04:17:36 -- common/autotest_common.sh@867 -- # local i 00:05:57.912 04:17:36 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:57.912 04:17:36 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:57.912 04:17:36 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:57.912 04:17:37 -- common/autotest_common.sh@871 -- # break 00:05:57.912 04:17:37 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:57.912 04:17:37 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:57.912 04:17:37 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:57.912 1+0 records in 00:05:57.912 1+0 records out 00:05:57.912 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000206176 s, 19.9 MB/s 00:05:57.912 04:17:37 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:57.912 04:17:37 -- common/autotest_common.sh@884 -- # size=4096 00:05:57.912 04:17:37 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:57.912 04:17:37 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:57.912 04:17:37 -- common/autotest_common.sh@887 -- # return 0 00:05:57.912 04:17:37 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:57.912 04:17:37 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:57.912 04:17:37 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:57.912 04:17:37 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:57.912 04:17:37 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:58.170 { 00:05:58.170 "nbd_device": "/dev/nbd0", 00:05:58.170 "bdev_name": "Malloc0" 00:05:58.170 }, 00:05:58.170 { 00:05:58.170 "nbd_device": "/dev/nbd1", 00:05:58.170 "bdev_name": "Malloc1" 00:05:58.170 } 00:05:58.170 ]' 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:58.170 { 00:05:58.170 "nbd_device": "/dev/nbd0", 00:05:58.170 "bdev_name": "Malloc0" 00:05:58.170 }, 00:05:58.170 { 00:05:58.170 "nbd_device": "/dev/nbd1", 00:05:58.170 "bdev_name": "Malloc1" 00:05:58.170 } 00:05:58.170 ]' 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:58.170 /dev/nbd1' 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:58.170 /dev/nbd1' 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@65 -- # count=2 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@95 -- # count=2 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:58.170 256+0 records in 00:05:58.170 256+0 records out 00:05:58.170 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00511487 s, 205 MB/s 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:58.170 256+0 records in 00:05:58.170 256+0 records out 00:05:58.170 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226264 s, 46.3 MB/s 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:58.170 256+0 records in 00:05:58.170 256+0 records out 00:05:58.170 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244995 s, 42.8 MB/s 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@51 -- # local i 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:58.170 04:17:37 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@41 -- # break 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@45 -- # return 0 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@41 -- # break 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@45 -- # return 0 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:58.736 04:17:37 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:58.994 04:17:38 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:58.994 04:17:38 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:58.994 04:17:38 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:59.252 04:17:38 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:59.252 04:17:38 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:59.252 04:17:38 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:59.252 04:17:38 -- bdev/nbd_common.sh@65 -- # true 00:05:59.252 04:17:38 -- bdev/nbd_common.sh@65 -- # count=0 00:05:59.252 04:17:38 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:59.252 04:17:38 -- bdev/nbd_common.sh@104 -- # count=0 00:05:59.252 04:17:38 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:59.252 04:17:38 -- bdev/nbd_common.sh@109 -- # return 0 00:05:59.252 04:17:38 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:59.510 04:17:38 -- event/event.sh@35 -- # sleep 3 00:05:59.769 [2024-11-26 04:17:38.758458] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:59.769 [2024-11-26 04:17:38.847015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:59.769 [2024-11-26 04:17:38.847019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.769 [2024-11-26 04:17:38.903262] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:59.769 [2024-11-26 04:17:38.903338] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:03.051 04:17:41 -- event/event.sh@38 -- # waitforlisten 2792789 /var/tmp/spdk-nbd.sock 00:06:03.051 04:17:41 -- common/autotest_common.sh@829 -- # '[' -z 2792789 ']' 00:06:03.051 04:17:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:03.051 04:17:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:03.051 04:17:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:03.051 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:03.051 04:17:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:03.051 04:17:41 -- common/autotest_common.sh@10 -- # set +x 00:06:03.051 04:17:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:03.051 04:17:41 -- common/autotest_common.sh@862 -- # return 0 00:06:03.051 04:17:41 -- event/event.sh@39 -- # killprocess 2792789 00:06:03.051 04:17:41 -- common/autotest_common.sh@936 -- # '[' -z 2792789 ']' 00:06:03.051 04:17:41 -- common/autotest_common.sh@940 -- # kill -0 2792789 00:06:03.051 04:17:41 -- common/autotest_common.sh@941 -- # uname 00:06:03.051 04:17:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:03.051 04:17:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2792789 00:06:03.051 04:17:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:03.051 04:17:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:03.051 04:17:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2792789' 00:06:03.051 killing process with pid 2792789 00:06:03.051 04:17:41 -- common/autotest_common.sh@955 -- # kill 2792789 00:06:03.051 04:17:41 -- common/autotest_common.sh@960 -- # wait 2792789 00:06:03.051 spdk_app_start is called in Round 0. 00:06:03.051 Shutdown signal received, stop current app iteration 00:06:03.051 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:03.051 spdk_app_start is called in Round 1. 00:06:03.051 Shutdown signal received, stop current app iteration 00:06:03.051 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:03.051 spdk_app_start is called in Round 2. 00:06:03.051 Shutdown signal received, stop current app iteration 00:06:03.051 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:03.051 spdk_app_start is called in Round 3. 00:06:03.051 Shutdown signal received, stop current app iteration 00:06:03.051 04:17:42 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:03.051 04:17:42 -- event/event.sh@42 -- # return 0 00:06:03.051 00:06:03.051 real 0m18.835s 00:06:03.051 user 0m41.295s 00:06:03.051 sys 0m3.146s 00:06:03.051 04:17:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:03.051 04:17:42 -- common/autotest_common.sh@10 -- # set +x 00:06:03.051 ************************************ 00:06:03.051 END TEST app_repeat 00:06:03.051 ************************************ 00:06:03.051 04:17:42 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:03.051 04:17:42 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:03.051 04:17:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:03.051 04:17:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.051 04:17:42 -- common/autotest_common.sh@10 -- # set +x 00:06:03.051 ************************************ 00:06:03.051 START TEST cpu_locks 00:06:03.051 ************************************ 00:06:03.051 04:17:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:03.051 * Looking for test storage... 00:06:03.051 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:03.051 04:17:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:03.051 04:17:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:03.051 04:17:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:03.051 04:17:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:03.051 04:17:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:03.051 04:17:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:03.051 04:17:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:03.051 04:17:42 -- scripts/common.sh@335 -- # IFS=.-: 00:06:03.051 04:17:42 -- scripts/common.sh@335 -- # read -ra ver1 00:06:03.051 04:17:42 -- scripts/common.sh@336 -- # IFS=.-: 00:06:03.051 04:17:42 -- scripts/common.sh@336 -- # read -ra ver2 00:06:03.051 04:17:42 -- scripts/common.sh@337 -- # local 'op=<' 00:06:03.051 04:17:42 -- scripts/common.sh@339 -- # ver1_l=2 00:06:03.051 04:17:42 -- scripts/common.sh@340 -- # ver2_l=1 00:06:03.051 04:17:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:03.051 04:17:42 -- scripts/common.sh@343 -- # case "$op" in 00:06:03.051 04:17:42 -- scripts/common.sh@344 -- # : 1 00:06:03.051 04:17:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:03.051 04:17:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:03.051 04:17:42 -- scripts/common.sh@364 -- # decimal 1 00:06:03.051 04:17:42 -- scripts/common.sh@352 -- # local d=1 00:06:03.051 04:17:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:03.051 04:17:42 -- scripts/common.sh@354 -- # echo 1 00:06:03.052 04:17:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:03.052 04:17:42 -- scripts/common.sh@365 -- # decimal 2 00:06:03.052 04:17:42 -- scripts/common.sh@352 -- # local d=2 00:06:03.052 04:17:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:03.052 04:17:42 -- scripts/common.sh@354 -- # echo 2 00:06:03.052 04:17:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:03.052 04:17:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:03.052 04:17:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:03.052 04:17:42 -- scripts/common.sh@367 -- # return 0 00:06:03.052 04:17:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:03.052 04:17:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:03.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.052 --rc genhtml_branch_coverage=1 00:06:03.052 --rc genhtml_function_coverage=1 00:06:03.052 --rc genhtml_legend=1 00:06:03.052 --rc geninfo_all_blocks=1 00:06:03.052 --rc geninfo_unexecuted_blocks=1 00:06:03.052 00:06:03.052 ' 00:06:03.052 04:17:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:03.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.052 --rc genhtml_branch_coverage=1 00:06:03.052 --rc genhtml_function_coverage=1 00:06:03.052 --rc genhtml_legend=1 00:06:03.052 --rc geninfo_all_blocks=1 00:06:03.052 --rc geninfo_unexecuted_blocks=1 00:06:03.052 00:06:03.052 ' 00:06:03.052 04:17:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:03.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.052 --rc genhtml_branch_coverage=1 00:06:03.052 --rc genhtml_function_coverage=1 00:06:03.052 --rc genhtml_legend=1 00:06:03.052 --rc geninfo_all_blocks=1 00:06:03.052 --rc geninfo_unexecuted_blocks=1 00:06:03.052 00:06:03.052 ' 00:06:03.052 04:17:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:03.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.052 --rc genhtml_branch_coverage=1 00:06:03.052 --rc genhtml_function_coverage=1 00:06:03.052 --rc genhtml_legend=1 00:06:03.052 --rc geninfo_all_blocks=1 00:06:03.052 --rc geninfo_unexecuted_blocks=1 00:06:03.052 00:06:03.052 ' 00:06:03.052 04:17:42 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:03.052 04:17:42 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:03.052 04:17:42 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:03.052 04:17:42 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:03.052 04:17:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:03.052 04:17:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.052 04:17:42 -- common/autotest_common.sh@10 -- # set +x 00:06:03.052 ************************************ 00:06:03.052 START TEST default_locks 00:06:03.052 ************************************ 00:06:03.052 04:17:42 -- common/autotest_common.sh@1114 -- # default_locks 00:06:03.052 04:17:42 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=2795340 00:06:03.052 04:17:42 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:03.052 04:17:42 -- event/cpu_locks.sh@47 -- # waitforlisten 2795340 00:06:03.052 04:17:42 -- common/autotest_common.sh@829 -- # '[' -z 2795340 ']' 00:06:03.052 04:17:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:03.052 04:17:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:03.052 04:17:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:03.052 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:03.052 04:17:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:03.052 04:17:42 -- common/autotest_common.sh@10 -- # set +x 00:06:03.052 [2024-11-26 04:17:42.252751] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:03.052 [2024-11-26 04:17:42.252849] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2795340 ] 00:06:03.311 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.311 [2024-11-26 04:17:42.315269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.311 [2024-11-26 04:17:42.403737] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:03.311 [2024-11-26 04:17:42.403943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.246 04:17:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:04.246 04:17:43 -- common/autotest_common.sh@862 -- # return 0 00:06:04.246 04:17:43 -- event/cpu_locks.sh@49 -- # locks_exist 2795340 00:06:04.246 04:17:43 -- event/cpu_locks.sh@22 -- # lslocks -p 2795340 00:06:04.246 04:17:43 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:04.504 lslocks: write error 00:06:04.504 04:17:43 -- event/cpu_locks.sh@50 -- # killprocess 2795340 00:06:04.504 04:17:43 -- common/autotest_common.sh@936 -- # '[' -z 2795340 ']' 00:06:04.504 04:17:43 -- common/autotest_common.sh@940 -- # kill -0 2795340 00:06:04.504 04:17:43 -- common/autotest_common.sh@941 -- # uname 00:06:04.504 04:17:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:04.504 04:17:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2795340 00:06:04.504 04:17:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:04.504 04:17:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:04.504 04:17:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2795340' 00:06:04.504 killing process with pid 2795340 00:06:04.504 04:17:43 -- common/autotest_common.sh@955 -- # kill 2795340 00:06:04.504 04:17:43 -- common/autotest_common.sh@960 -- # wait 2795340 00:06:05.070 04:17:43 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 2795340 00:06:05.070 04:17:43 -- common/autotest_common.sh@650 -- # local es=0 00:06:05.071 04:17:43 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2795340 00:06:05.071 04:17:43 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:05.071 04:17:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:05.071 04:17:44 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:05.071 04:17:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:05.071 04:17:44 -- common/autotest_common.sh@653 -- # waitforlisten 2795340 00:06:05.071 04:17:44 -- common/autotest_common.sh@829 -- # '[' -z 2795340 ']' 00:06:05.071 04:17:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:05.071 04:17:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:05.071 04:17:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:05.071 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:05.071 04:17:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:05.071 04:17:44 -- common/autotest_common.sh@10 -- # set +x 00:06:05.071 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2795340) - No such process 00:06:05.071 ERROR: process (pid: 2795340) is no longer running 00:06:05.071 04:17:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:05.071 04:17:44 -- common/autotest_common.sh@862 -- # return 1 00:06:05.071 04:17:44 -- common/autotest_common.sh@653 -- # es=1 00:06:05.071 04:17:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:05.071 04:17:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:05.071 04:17:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:05.071 04:17:44 -- event/cpu_locks.sh@54 -- # no_locks 00:06:05.071 04:17:44 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:05.071 04:17:44 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:05.071 04:17:44 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:05.071 00:06:05.071 real 0m1.801s 00:06:05.071 user 0m1.941s 00:06:05.071 sys 0m0.576s 00:06:05.071 04:17:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.071 04:17:44 -- common/autotest_common.sh@10 -- # set +x 00:06:05.071 ************************************ 00:06:05.071 END TEST default_locks 00:06:05.071 ************************************ 00:06:05.071 04:17:44 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:05.071 04:17:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:05.071 04:17:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.071 04:17:44 -- common/autotest_common.sh@10 -- # set +x 00:06:05.071 ************************************ 00:06:05.071 START TEST default_locks_via_rpc 00:06:05.071 ************************************ 00:06:05.071 04:17:44 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:05.071 04:17:44 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=2795519 00:06:05.071 04:17:44 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:05.071 04:17:44 -- event/cpu_locks.sh@63 -- # waitforlisten 2795519 00:06:05.071 04:17:44 -- common/autotest_common.sh@829 -- # '[' -z 2795519 ']' 00:06:05.071 04:17:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:05.071 04:17:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:05.071 04:17:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:05.071 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:05.071 04:17:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:05.071 04:17:44 -- common/autotest_common.sh@10 -- # set +x 00:06:05.071 [2024-11-26 04:17:44.086792] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:05.071 [2024-11-26 04:17:44.086884] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2795519 ] 00:06:05.071 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.071 [2024-11-26 04:17:44.149267] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.071 [2024-11-26 04:17:44.234750] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:05.071 [2024-11-26 04:17:44.234941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.005 04:17:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:06.005 04:17:45 -- common/autotest_common.sh@862 -- # return 0 00:06:06.005 04:17:45 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:06.005 04:17:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:06.005 04:17:45 -- common/autotest_common.sh@10 -- # set +x 00:06:06.005 04:17:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:06.005 04:17:45 -- event/cpu_locks.sh@67 -- # no_locks 00:06:06.005 04:17:45 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:06.005 04:17:45 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:06.005 04:17:45 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:06.005 04:17:45 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:06.005 04:17:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:06.005 04:17:45 -- common/autotest_common.sh@10 -- # set +x 00:06:06.005 04:17:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:06.005 04:17:45 -- event/cpu_locks.sh@71 -- # locks_exist 2795519 00:06:06.005 04:17:45 -- event/cpu_locks.sh@22 -- # lslocks -p 2795519 00:06:06.005 04:17:45 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:06.263 04:17:45 -- event/cpu_locks.sh@73 -- # killprocess 2795519 00:06:06.263 04:17:45 -- common/autotest_common.sh@936 -- # '[' -z 2795519 ']' 00:06:06.263 04:17:45 -- common/autotest_common.sh@940 -- # kill -0 2795519 00:06:06.263 04:17:45 -- common/autotest_common.sh@941 -- # uname 00:06:06.263 04:17:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:06.263 04:17:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2795519 00:06:06.263 04:17:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:06.263 04:17:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:06.263 04:17:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2795519' 00:06:06.263 killing process with pid 2795519 00:06:06.263 04:17:45 -- common/autotest_common.sh@955 -- # kill 2795519 00:06:06.263 04:17:45 -- common/autotest_common.sh@960 -- # wait 2795519 00:06:06.829 00:06:06.829 real 0m1.775s 00:06:06.829 user 0m1.912s 00:06:06.829 sys 0m0.564s 00:06:06.829 04:17:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.829 04:17:45 -- common/autotest_common.sh@10 -- # set +x 00:06:06.829 ************************************ 00:06:06.829 END TEST default_locks_via_rpc 00:06:06.829 ************************************ 00:06:06.829 04:17:45 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:06.829 04:17:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:06.829 04:17:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.829 04:17:45 -- common/autotest_common.sh@10 -- # set +x 00:06:06.829 ************************************ 00:06:06.829 START TEST non_locking_app_on_locked_coremask 00:06:06.829 ************************************ 00:06:06.829 04:17:45 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:06.829 04:17:45 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=2795819 00:06:06.829 04:17:45 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:06.829 04:17:45 -- event/cpu_locks.sh@81 -- # waitforlisten 2795819 /var/tmp/spdk.sock 00:06:06.829 04:17:45 -- common/autotest_common.sh@829 -- # '[' -z 2795819 ']' 00:06:06.829 04:17:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:06.829 04:17:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:06.829 04:17:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:06.829 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:06.829 04:17:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:06.829 04:17:45 -- common/autotest_common.sh@10 -- # set +x 00:06:06.829 [2024-11-26 04:17:45.892744] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:06.829 [2024-11-26 04:17:45.892848] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2795819 ] 00:06:06.829 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.829 [2024-11-26 04:17:45.949586] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.829 [2024-11-26 04:17:46.034926] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:06.829 [2024-11-26 04:17:46.035106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.764 04:17:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:07.764 04:17:46 -- common/autotest_common.sh@862 -- # return 0 00:06:07.764 04:17:46 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=2795956 00:06:07.764 04:17:46 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:07.764 04:17:46 -- event/cpu_locks.sh@85 -- # waitforlisten 2795956 /var/tmp/spdk2.sock 00:06:07.764 04:17:46 -- common/autotest_common.sh@829 -- # '[' -z 2795956 ']' 00:06:07.764 04:17:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:07.764 04:17:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:07.764 04:17:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:07.764 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:07.764 04:17:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:07.764 04:17:46 -- common/autotest_common.sh@10 -- # set +x 00:06:07.764 [2024-11-26 04:17:46.915515] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:07.764 [2024-11-26 04:17:46.915592] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2795956 ] 00:06:07.764 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.025 [2024-11-26 04:17:47.005566] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:08.025 [2024-11-26 04:17:47.005600] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.025 [2024-11-26 04:17:47.181954] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:08.025 [2024-11-26 04:17:47.182164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.961 04:17:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:08.961 04:17:47 -- common/autotest_common.sh@862 -- # return 0 00:06:08.961 04:17:47 -- event/cpu_locks.sh@87 -- # locks_exist 2795819 00:06:08.961 04:17:47 -- event/cpu_locks.sh@22 -- # lslocks -p 2795819 00:06:08.961 04:17:47 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:09.219 lslocks: write error 00:06:09.219 04:17:48 -- event/cpu_locks.sh@89 -- # killprocess 2795819 00:06:09.219 04:17:48 -- common/autotest_common.sh@936 -- # '[' -z 2795819 ']' 00:06:09.219 04:17:48 -- common/autotest_common.sh@940 -- # kill -0 2795819 00:06:09.219 04:17:48 -- common/autotest_common.sh@941 -- # uname 00:06:09.219 04:17:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:09.219 04:17:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2795819 00:06:09.219 04:17:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:09.219 04:17:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:09.219 04:17:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2795819' 00:06:09.219 killing process with pid 2795819 00:06:09.219 04:17:48 -- common/autotest_common.sh@955 -- # kill 2795819 00:06:09.219 04:17:48 -- common/autotest_common.sh@960 -- # wait 2795819 00:06:10.153 04:17:49 -- event/cpu_locks.sh@90 -- # killprocess 2795956 00:06:10.153 04:17:49 -- common/autotest_common.sh@936 -- # '[' -z 2795956 ']' 00:06:10.153 04:17:49 -- common/autotest_common.sh@940 -- # kill -0 2795956 00:06:10.153 04:17:49 -- common/autotest_common.sh@941 -- # uname 00:06:10.153 04:17:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:10.153 04:17:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2795956 00:06:10.153 04:17:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:10.153 04:17:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:10.153 04:17:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2795956' 00:06:10.153 killing process with pid 2795956 00:06:10.153 04:17:49 -- common/autotest_common.sh@955 -- # kill 2795956 00:06:10.153 04:17:49 -- common/autotest_common.sh@960 -- # wait 2795956 00:06:10.411 00:06:10.411 real 0m3.681s 00:06:10.411 user 0m4.083s 00:06:10.411 sys 0m1.070s 00:06:10.411 04:17:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:10.411 04:17:49 -- common/autotest_common.sh@10 -- # set +x 00:06:10.411 ************************************ 00:06:10.411 END TEST non_locking_app_on_locked_coremask 00:06:10.411 ************************************ 00:06:10.411 04:17:49 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:10.411 04:17:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:10.411 04:17:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.411 04:17:49 -- common/autotest_common.sh@10 -- # set +x 00:06:10.411 ************************************ 00:06:10.411 START TEST locking_app_on_unlocked_coremask 00:06:10.411 ************************************ 00:06:10.411 04:17:49 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:10.411 04:17:49 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=2796265 00:06:10.411 04:17:49 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:10.411 04:17:49 -- event/cpu_locks.sh@99 -- # waitforlisten 2796265 /var/tmp/spdk.sock 00:06:10.411 04:17:49 -- common/autotest_common.sh@829 -- # '[' -z 2796265 ']' 00:06:10.411 04:17:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:10.411 04:17:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:10.411 04:17:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:10.411 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:10.411 04:17:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:10.411 04:17:49 -- common/autotest_common.sh@10 -- # set +x 00:06:10.411 [2024-11-26 04:17:49.600157] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:10.411 [2024-11-26 04:17:49.600258] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2796265 ] 00:06:10.411 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.670 [2024-11-26 04:17:49.659075] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:10.670 [2024-11-26 04:17:49.659117] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.670 [2024-11-26 04:17:49.744232] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:10.670 [2024-11-26 04:17:49.744400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.604 04:17:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:11.604 04:17:50 -- common/autotest_common.sh@862 -- # return 0 00:06:11.604 04:17:50 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=2796407 00:06:11.604 04:17:50 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:11.604 04:17:50 -- event/cpu_locks.sh@103 -- # waitforlisten 2796407 /var/tmp/spdk2.sock 00:06:11.604 04:17:50 -- common/autotest_common.sh@829 -- # '[' -z 2796407 ']' 00:06:11.604 04:17:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:11.604 04:17:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:11.604 04:17:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:11.604 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:11.604 04:17:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:11.604 04:17:50 -- common/autotest_common.sh@10 -- # set +x 00:06:11.604 [2024-11-26 04:17:50.620280] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:11.604 [2024-11-26 04:17:50.620355] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2796407 ] 00:06:11.604 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.604 [2024-11-26 04:17:50.711356] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.864 [2024-11-26 04:17:50.892459] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:11.864 [2024-11-26 04:17:50.892667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.472 04:17:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:12.472 04:17:51 -- common/autotest_common.sh@862 -- # return 0 00:06:12.472 04:17:51 -- event/cpu_locks.sh@105 -- # locks_exist 2796407 00:06:12.472 04:17:51 -- event/cpu_locks.sh@22 -- # lslocks -p 2796407 00:06:12.472 04:17:51 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:13.038 lslocks: write error 00:06:13.038 04:17:51 -- event/cpu_locks.sh@107 -- # killprocess 2796265 00:06:13.038 04:17:51 -- common/autotest_common.sh@936 -- # '[' -z 2796265 ']' 00:06:13.038 04:17:51 -- common/autotest_common.sh@940 -- # kill -0 2796265 00:06:13.038 04:17:51 -- common/autotest_common.sh@941 -- # uname 00:06:13.038 04:17:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:13.038 04:17:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2796265 00:06:13.038 04:17:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:13.038 04:17:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:13.038 04:17:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2796265' 00:06:13.038 killing process with pid 2796265 00:06:13.038 04:17:52 -- common/autotest_common.sh@955 -- # kill 2796265 00:06:13.038 04:17:52 -- common/autotest_common.sh@960 -- # wait 2796265 00:06:13.604 04:17:52 -- event/cpu_locks.sh@108 -- # killprocess 2796407 00:06:13.604 04:17:52 -- common/autotest_common.sh@936 -- # '[' -z 2796407 ']' 00:06:13.604 04:17:52 -- common/autotest_common.sh@940 -- # kill -0 2796407 00:06:13.604 04:17:52 -- common/autotest_common.sh@941 -- # uname 00:06:13.604 04:17:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:13.604 04:17:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2796407 00:06:13.863 04:17:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:13.863 04:17:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:13.863 04:17:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2796407' 00:06:13.863 killing process with pid 2796407 00:06:13.863 04:17:52 -- common/autotest_common.sh@955 -- # kill 2796407 00:06:13.863 04:17:52 -- common/autotest_common.sh@960 -- # wait 2796407 00:06:14.124 00:06:14.124 real 0m3.704s 00:06:14.124 user 0m4.074s 00:06:14.124 sys 0m1.053s 00:06:14.124 04:17:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:14.124 04:17:53 -- common/autotest_common.sh@10 -- # set +x 00:06:14.124 ************************************ 00:06:14.124 END TEST locking_app_on_unlocked_coremask 00:06:14.124 ************************************ 00:06:14.124 04:17:53 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:14.124 04:17:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:14.124 04:17:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.124 04:17:53 -- common/autotest_common.sh@10 -- # set +x 00:06:14.124 ************************************ 00:06:14.124 START TEST locking_app_on_locked_coremask 00:06:14.124 ************************************ 00:06:14.124 04:17:53 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:14.124 04:17:53 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=2796722 00:06:14.124 04:17:53 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:14.124 04:17:53 -- event/cpu_locks.sh@116 -- # waitforlisten 2796722 /var/tmp/spdk.sock 00:06:14.124 04:17:53 -- common/autotest_common.sh@829 -- # '[' -z 2796722 ']' 00:06:14.124 04:17:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:14.124 04:17:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:14.124 04:17:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:14.124 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:14.124 04:17:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:14.124 04:17:53 -- common/autotest_common.sh@10 -- # set +x 00:06:14.124 [2024-11-26 04:17:53.335198] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:14.124 [2024-11-26 04:17:53.335293] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2796722 ] 00:06:14.384 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.384 [2024-11-26 04:17:53.394245] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.384 [2024-11-26 04:17:53.478417] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:14.384 [2024-11-26 04:17:53.478575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.323 04:17:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:15.323 04:17:54 -- common/autotest_common.sh@862 -- # return 0 00:06:15.323 04:17:54 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=2796862 00:06:15.323 04:17:54 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 2796862 /var/tmp/spdk2.sock 00:06:15.323 04:17:54 -- common/autotest_common.sh@650 -- # local es=0 00:06:15.323 04:17:54 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2796862 /var/tmp/spdk2.sock 00:06:15.323 04:17:54 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:15.323 04:17:54 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:15.323 04:17:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:15.323 04:17:54 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:15.323 04:17:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:15.323 04:17:54 -- common/autotest_common.sh@653 -- # waitforlisten 2796862 /var/tmp/spdk2.sock 00:06:15.323 04:17:54 -- common/autotest_common.sh@829 -- # '[' -z 2796862 ']' 00:06:15.323 04:17:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:15.323 04:17:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:15.323 04:17:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:15.323 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:15.323 04:17:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:15.323 04:17:54 -- common/autotest_common.sh@10 -- # set +x 00:06:15.323 [2024-11-26 04:17:54.344636] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:15.323 [2024-11-26 04:17:54.344728] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2796862 ] 00:06:15.323 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.323 [2024-11-26 04:17:54.431741] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 2796722 has claimed it. 00:06:15.323 [2024-11-26 04:17:54.431805] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:15.890 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2796862) - No such process 00:06:15.890 ERROR: process (pid: 2796862) is no longer running 00:06:15.890 04:17:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:15.890 04:17:55 -- common/autotest_common.sh@862 -- # return 1 00:06:15.891 04:17:55 -- common/autotest_common.sh@653 -- # es=1 00:06:15.891 04:17:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:15.891 04:17:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:15.891 04:17:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:15.891 04:17:55 -- event/cpu_locks.sh@122 -- # locks_exist 2796722 00:06:15.891 04:17:55 -- event/cpu_locks.sh@22 -- # lslocks -p 2796722 00:06:15.891 04:17:55 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:16.151 lslocks: write error 00:06:16.151 04:17:55 -- event/cpu_locks.sh@124 -- # killprocess 2796722 00:06:16.151 04:17:55 -- common/autotest_common.sh@936 -- # '[' -z 2796722 ']' 00:06:16.151 04:17:55 -- common/autotest_common.sh@940 -- # kill -0 2796722 00:06:16.151 04:17:55 -- common/autotest_common.sh@941 -- # uname 00:06:16.151 04:17:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:16.151 04:17:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2796722 00:06:16.151 04:17:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:16.151 04:17:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:16.151 04:17:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2796722' 00:06:16.151 killing process with pid 2796722 00:06:16.151 04:17:55 -- common/autotest_common.sh@955 -- # kill 2796722 00:06:16.151 04:17:55 -- common/autotest_common.sh@960 -- # wait 2796722 00:06:16.718 00:06:16.718 real 0m2.464s 00:06:16.718 user 0m2.868s 00:06:16.718 sys 0m0.622s 00:06:16.718 04:17:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:16.718 04:17:55 -- common/autotest_common.sh@10 -- # set +x 00:06:16.718 ************************************ 00:06:16.718 END TEST locking_app_on_locked_coremask 00:06:16.718 ************************************ 00:06:16.718 04:17:55 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:16.718 04:17:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:16.718 04:17:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.718 04:17:55 -- common/autotest_common.sh@10 -- # set +x 00:06:16.718 ************************************ 00:06:16.718 START TEST locking_overlapped_coremask 00:06:16.718 ************************************ 00:06:16.718 04:17:55 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:16.718 04:17:55 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=2797155 00:06:16.718 04:17:55 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:16.718 04:17:55 -- event/cpu_locks.sh@133 -- # waitforlisten 2797155 /var/tmp/spdk.sock 00:06:16.718 04:17:55 -- common/autotest_common.sh@829 -- # '[' -z 2797155 ']' 00:06:16.718 04:17:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:16.718 04:17:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:16.718 04:17:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:16.718 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:16.718 04:17:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:16.718 04:17:55 -- common/autotest_common.sh@10 -- # set +x 00:06:16.718 [2024-11-26 04:17:55.825795] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:16.718 [2024-11-26 04:17:55.825884] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2797155 ] 00:06:16.718 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.718 [2024-11-26 04:17:55.890386] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:16.979 [2024-11-26 04:17:55.980731] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:16.979 [2024-11-26 04:17:55.980975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:16.979 [2024-11-26 04:17:55.981032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:16.979 [2024-11-26 04:17:55.981035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.549 04:17:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:17.549 04:17:56 -- common/autotest_common.sh@862 -- # return 0 00:06:17.549 04:17:56 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=2797190 00:06:17.549 04:17:56 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 2797190 /var/tmp/spdk2.sock 00:06:17.549 04:17:56 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:17.549 04:17:56 -- common/autotest_common.sh@650 -- # local es=0 00:06:17.549 04:17:56 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2797190 /var/tmp/spdk2.sock 00:06:17.549 04:17:56 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:17.807 04:17:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:17.807 04:17:56 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:17.807 04:17:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:17.807 04:17:56 -- common/autotest_common.sh@653 -- # waitforlisten 2797190 /var/tmp/spdk2.sock 00:06:17.807 04:17:56 -- common/autotest_common.sh@829 -- # '[' -z 2797190 ']' 00:06:17.807 04:17:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:17.807 04:17:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:17.807 04:17:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:17.807 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:17.807 04:17:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:17.807 04:17:56 -- common/autotest_common.sh@10 -- # set +x 00:06:17.807 [2024-11-26 04:17:56.823065] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:17.807 [2024-11-26 04:17:56.823144] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2797190 ] 00:06:17.807 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.807 [2024-11-26 04:17:56.915729] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2797155 has claimed it. 00:06:17.807 [2024-11-26 04:17:56.915791] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:18.376 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2797190) - No such process 00:06:18.376 ERROR: process (pid: 2797190) is no longer running 00:06:18.376 04:17:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:18.376 04:17:57 -- common/autotest_common.sh@862 -- # return 1 00:06:18.376 04:17:57 -- common/autotest_common.sh@653 -- # es=1 00:06:18.376 04:17:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:18.376 04:17:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:18.376 04:17:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:18.377 04:17:57 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:18.377 04:17:57 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:18.377 04:17:57 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:18.377 04:17:57 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:18.377 04:17:57 -- event/cpu_locks.sh@141 -- # killprocess 2797155 00:06:18.377 04:17:57 -- common/autotest_common.sh@936 -- # '[' -z 2797155 ']' 00:06:18.377 04:17:57 -- common/autotest_common.sh@940 -- # kill -0 2797155 00:06:18.377 04:17:57 -- common/autotest_common.sh@941 -- # uname 00:06:18.377 04:17:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:18.377 04:17:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2797155 00:06:18.377 04:17:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:18.377 04:17:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:18.377 04:17:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2797155' 00:06:18.377 killing process with pid 2797155 00:06:18.377 04:17:57 -- common/autotest_common.sh@955 -- # kill 2797155 00:06:18.377 04:17:57 -- common/autotest_common.sh@960 -- # wait 2797155 00:06:18.947 00:06:18.947 real 0m2.205s 00:06:18.947 user 0m6.333s 00:06:18.947 sys 0m0.508s 00:06:18.947 04:17:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.947 04:17:57 -- common/autotest_common.sh@10 -- # set +x 00:06:18.947 ************************************ 00:06:18.947 END TEST locking_overlapped_coremask 00:06:18.947 ************************************ 00:06:18.947 04:17:58 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:18.947 04:17:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:18.947 04:17:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.947 04:17:58 -- common/autotest_common.sh@10 -- # set +x 00:06:18.947 ************************************ 00:06:18.947 START TEST locking_overlapped_coremask_via_rpc 00:06:18.947 ************************************ 00:06:18.947 04:17:58 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:18.947 04:17:58 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=2797463 00:06:18.947 04:17:58 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:18.947 04:17:58 -- event/cpu_locks.sh@149 -- # waitforlisten 2797463 /var/tmp/spdk.sock 00:06:18.947 04:17:58 -- common/autotest_common.sh@829 -- # '[' -z 2797463 ']' 00:06:18.947 04:17:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:18.947 04:17:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:18.947 04:17:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:18.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:18.947 04:17:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:18.947 04:17:58 -- common/autotest_common.sh@10 -- # set +x 00:06:18.947 [2024-11-26 04:17:58.056612] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:18.947 [2024-11-26 04:17:58.056729] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2797463 ] 00:06:18.947 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.947 [2024-11-26 04:17:58.119135] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:18.947 [2024-11-26 04:17:58.119185] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:19.207 [2024-11-26 04:17:58.212948] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:19.207 [2024-11-26 04:17:58.213185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:19.207 [2024-11-26 04:17:58.213252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:19.207 [2024-11-26 04:17:58.213255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.155 04:17:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:20.155 04:17:59 -- common/autotest_common.sh@862 -- # return 0 00:06:20.155 04:17:59 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=2797509 00:06:20.155 04:17:59 -- event/cpu_locks.sh@153 -- # waitforlisten 2797509 /var/tmp/spdk2.sock 00:06:20.155 04:17:59 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:20.155 04:17:59 -- common/autotest_common.sh@829 -- # '[' -z 2797509 ']' 00:06:20.155 04:17:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:20.155 04:17:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:20.155 04:17:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:20.155 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:20.155 04:17:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:20.155 04:17:59 -- common/autotest_common.sh@10 -- # set +x 00:06:20.155 [2024-11-26 04:17:59.091420] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:20.155 [2024-11-26 04:17:59.091494] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2797509 ] 00:06:20.155 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.155 [2024-11-26 04:17:59.185152] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:20.155 [2024-11-26 04:17:59.185190] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:20.155 [2024-11-26 04:17:59.360400] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:20.155 [2024-11-26 04:17:59.360644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:20.155 [2024-11-26 04:17:59.360701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:20.155 [2024-11-26 04:17:59.360703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:21.092 04:18:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:21.092 04:18:00 -- common/autotest_common.sh@862 -- # return 0 00:06:21.092 04:18:00 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:21.092 04:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.092 04:18:00 -- common/autotest_common.sh@10 -- # set +x 00:06:21.092 04:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:21.092 04:18:00 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:21.092 04:18:00 -- common/autotest_common.sh@650 -- # local es=0 00:06:21.092 04:18:00 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:21.092 04:18:00 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:21.092 04:18:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:21.092 04:18:00 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:21.092 04:18:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:21.092 04:18:00 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:21.092 04:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:21.092 04:18:00 -- common/autotest_common.sh@10 -- # set +x 00:06:21.092 [2024-11-26 04:18:00.047802] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2797463 has claimed it. 00:06:21.092 request: 00:06:21.092 { 00:06:21.092 "method": "framework_enable_cpumask_locks", 00:06:21.092 "req_id": 1 00:06:21.092 } 00:06:21.092 Got JSON-RPC error response 00:06:21.092 response: 00:06:21.092 { 00:06:21.092 "code": -32603, 00:06:21.092 "message": "Failed to claim CPU core: 2" 00:06:21.092 } 00:06:21.092 04:18:00 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:21.092 04:18:00 -- common/autotest_common.sh@653 -- # es=1 00:06:21.092 04:18:00 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:21.092 04:18:00 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:21.092 04:18:00 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:21.092 04:18:00 -- event/cpu_locks.sh@158 -- # waitforlisten 2797463 /var/tmp/spdk.sock 00:06:21.092 04:18:00 -- common/autotest_common.sh@829 -- # '[' -z 2797463 ']' 00:06:21.092 04:18:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:21.092 04:18:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:21.092 04:18:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:21.092 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:21.092 04:18:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:21.092 04:18:00 -- common/autotest_common.sh@10 -- # set +x 00:06:21.351 04:18:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:21.351 04:18:00 -- common/autotest_common.sh@862 -- # return 0 00:06:21.351 04:18:00 -- event/cpu_locks.sh@159 -- # waitforlisten 2797509 /var/tmp/spdk2.sock 00:06:21.351 04:18:00 -- common/autotest_common.sh@829 -- # '[' -z 2797509 ']' 00:06:21.351 04:18:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:21.351 04:18:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:21.351 04:18:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:21.351 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:21.351 04:18:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:21.351 04:18:00 -- common/autotest_common.sh@10 -- # set +x 00:06:21.611 04:18:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:21.611 04:18:00 -- common/autotest_common.sh@862 -- # return 0 00:06:21.611 04:18:00 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:21.611 04:18:00 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:21.611 04:18:00 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:21.611 04:18:00 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:21.611 00:06:21.611 real 0m2.600s 00:06:21.611 user 0m1.316s 00:06:21.611 sys 0m0.214s 00:06:21.611 04:18:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:21.611 04:18:00 -- common/autotest_common.sh@10 -- # set +x 00:06:21.611 ************************************ 00:06:21.611 END TEST locking_overlapped_coremask_via_rpc 00:06:21.611 ************************************ 00:06:21.611 04:18:00 -- event/cpu_locks.sh@174 -- # cleanup 00:06:21.611 04:18:00 -- event/cpu_locks.sh@15 -- # [[ -z 2797463 ]] 00:06:21.611 04:18:00 -- event/cpu_locks.sh@15 -- # killprocess 2797463 00:06:21.611 04:18:00 -- common/autotest_common.sh@936 -- # '[' -z 2797463 ']' 00:06:21.611 04:18:00 -- common/autotest_common.sh@940 -- # kill -0 2797463 00:06:21.611 04:18:00 -- common/autotest_common.sh@941 -- # uname 00:06:21.611 04:18:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:21.611 04:18:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2797463 00:06:21.611 04:18:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:21.611 04:18:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:21.611 04:18:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2797463' 00:06:21.611 killing process with pid 2797463 00:06:21.611 04:18:00 -- common/autotest_common.sh@955 -- # kill 2797463 00:06:21.611 04:18:00 -- common/autotest_common.sh@960 -- # wait 2797463 00:06:21.869 04:18:01 -- event/cpu_locks.sh@16 -- # [[ -z 2797509 ]] 00:06:21.869 04:18:01 -- event/cpu_locks.sh@16 -- # killprocess 2797509 00:06:21.869 04:18:01 -- common/autotest_common.sh@936 -- # '[' -z 2797509 ']' 00:06:21.869 04:18:01 -- common/autotest_common.sh@940 -- # kill -0 2797509 00:06:21.869 04:18:01 -- common/autotest_common.sh@941 -- # uname 00:06:21.869 04:18:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:21.869 04:18:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2797509 00:06:21.869 04:18:01 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:21.869 04:18:01 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:21.869 04:18:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2797509' 00:06:21.869 killing process with pid 2797509 00:06:21.869 04:18:01 -- common/autotest_common.sh@955 -- # kill 2797509 00:06:21.869 04:18:01 -- common/autotest_common.sh@960 -- # wait 2797509 00:06:22.436 04:18:01 -- event/cpu_locks.sh@18 -- # rm -f 00:06:22.436 04:18:01 -- event/cpu_locks.sh@1 -- # cleanup 00:06:22.436 04:18:01 -- event/cpu_locks.sh@15 -- # [[ -z 2797463 ]] 00:06:22.436 04:18:01 -- event/cpu_locks.sh@15 -- # killprocess 2797463 00:06:22.436 04:18:01 -- common/autotest_common.sh@936 -- # '[' -z 2797463 ']' 00:06:22.436 04:18:01 -- common/autotest_common.sh@940 -- # kill -0 2797463 00:06:22.436 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2797463) - No such process 00:06:22.436 04:18:01 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2797463 is not found' 00:06:22.436 Process with pid 2797463 is not found 00:06:22.436 04:18:01 -- event/cpu_locks.sh@16 -- # [[ -z 2797509 ]] 00:06:22.436 04:18:01 -- event/cpu_locks.sh@16 -- # killprocess 2797509 00:06:22.436 04:18:01 -- common/autotest_common.sh@936 -- # '[' -z 2797509 ']' 00:06:22.436 04:18:01 -- common/autotest_common.sh@940 -- # kill -0 2797509 00:06:22.436 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2797509) - No such process 00:06:22.436 04:18:01 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2797509 is not found' 00:06:22.436 Process with pid 2797509 is not found 00:06:22.436 04:18:01 -- event/cpu_locks.sh@18 -- # rm -f 00:06:22.436 00:06:22.436 real 0m19.416s 00:06:22.436 user 0m35.229s 00:06:22.436 sys 0m5.463s 00:06:22.436 04:18:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.436 04:18:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.436 ************************************ 00:06:22.436 END TEST cpu_locks 00:06:22.436 ************************************ 00:06:22.436 00:06:22.436 real 0m46.202s 00:06:22.436 user 1m29.074s 00:06:22.436 sys 0m9.378s 00:06:22.436 04:18:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.436 04:18:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.436 ************************************ 00:06:22.436 END TEST event 00:06:22.436 ************************************ 00:06:22.436 04:18:01 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:22.436 04:18:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:22.436 04:18:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.436 04:18:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.436 ************************************ 00:06:22.436 START TEST thread 00:06:22.436 ************************************ 00:06:22.436 04:18:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:22.436 * Looking for test storage... 00:06:22.436 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:22.436 04:18:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:22.436 04:18:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:22.436 04:18:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:22.436 04:18:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:22.436 04:18:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:22.436 04:18:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:22.436 04:18:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:22.436 04:18:01 -- scripts/common.sh@335 -- # IFS=.-: 00:06:22.436 04:18:01 -- scripts/common.sh@335 -- # read -ra ver1 00:06:22.436 04:18:01 -- scripts/common.sh@336 -- # IFS=.-: 00:06:22.436 04:18:01 -- scripts/common.sh@336 -- # read -ra ver2 00:06:22.436 04:18:01 -- scripts/common.sh@337 -- # local 'op=<' 00:06:22.436 04:18:01 -- scripts/common.sh@339 -- # ver1_l=2 00:06:22.436 04:18:01 -- scripts/common.sh@340 -- # ver2_l=1 00:06:22.436 04:18:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:22.436 04:18:01 -- scripts/common.sh@343 -- # case "$op" in 00:06:22.436 04:18:01 -- scripts/common.sh@344 -- # : 1 00:06:22.436 04:18:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:22.436 04:18:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:22.436 04:18:01 -- scripts/common.sh@364 -- # decimal 1 00:06:22.436 04:18:01 -- scripts/common.sh@352 -- # local d=1 00:06:22.436 04:18:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:22.436 04:18:01 -- scripts/common.sh@354 -- # echo 1 00:06:22.436 04:18:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:22.436 04:18:01 -- scripts/common.sh@365 -- # decimal 2 00:06:22.436 04:18:01 -- scripts/common.sh@352 -- # local d=2 00:06:22.436 04:18:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:22.436 04:18:01 -- scripts/common.sh@354 -- # echo 2 00:06:22.436 04:18:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:22.436 04:18:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:22.436 04:18:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:22.436 04:18:01 -- scripts/common.sh@367 -- # return 0 00:06:22.436 04:18:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:22.436 04:18:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:22.436 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:22.436 --rc genhtml_branch_coverage=1 00:06:22.436 --rc genhtml_function_coverage=1 00:06:22.436 --rc genhtml_legend=1 00:06:22.436 --rc geninfo_all_blocks=1 00:06:22.436 --rc geninfo_unexecuted_blocks=1 00:06:22.436 00:06:22.436 ' 00:06:22.436 04:18:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:22.436 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:22.436 --rc genhtml_branch_coverage=1 00:06:22.436 --rc genhtml_function_coverage=1 00:06:22.436 --rc genhtml_legend=1 00:06:22.436 --rc geninfo_all_blocks=1 00:06:22.436 --rc geninfo_unexecuted_blocks=1 00:06:22.436 00:06:22.436 ' 00:06:22.436 04:18:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:22.436 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:22.436 --rc genhtml_branch_coverage=1 00:06:22.436 --rc genhtml_function_coverage=1 00:06:22.436 --rc genhtml_legend=1 00:06:22.436 --rc geninfo_all_blocks=1 00:06:22.436 --rc geninfo_unexecuted_blocks=1 00:06:22.436 00:06:22.436 ' 00:06:22.436 04:18:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:22.436 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:22.436 --rc genhtml_branch_coverage=1 00:06:22.436 --rc genhtml_function_coverage=1 00:06:22.436 --rc genhtml_legend=1 00:06:22.436 --rc geninfo_all_blocks=1 00:06:22.436 --rc geninfo_unexecuted_blocks=1 00:06:22.436 00:06:22.436 ' 00:06:22.436 04:18:01 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:22.436 04:18:01 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:22.436 04:18:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.436 04:18:01 -- common/autotest_common.sh@10 -- # set +x 00:06:22.695 ************************************ 00:06:22.695 START TEST thread_poller_perf 00:06:22.695 ************************************ 00:06:22.695 04:18:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:22.695 [2024-11-26 04:18:01.674400] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:22.695 [2024-11-26 04:18:01.674484] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2798079 ] 00:06:22.695 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.695 [2024-11-26 04:18:01.735640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.695 [2024-11-26 04:18:01.825778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.695 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:24.076 [2024-11-26T03:18:03.302Z] ====================================== 00:06:24.076 [2024-11-26T03:18:03.302Z] busy:2709858778 (cyc) 00:06:24.076 [2024-11-26T03:18:03.302Z] total_run_count: 278000 00:06:24.076 [2024-11-26T03:18:03.302Z] tsc_hz: 2700000000 (cyc) 00:06:24.076 [2024-11-26T03:18:03.302Z] ====================================== 00:06:24.076 [2024-11-26T03:18:03.302Z] poller_cost: 9747 (cyc), 3610 (nsec) 00:06:24.076 00:06:24.076 real 0m1.256s 00:06:24.076 user 0m1.160s 00:06:24.076 sys 0m0.088s 00:06:24.076 04:18:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.076 04:18:02 -- common/autotest_common.sh@10 -- # set +x 00:06:24.076 ************************************ 00:06:24.076 END TEST thread_poller_perf 00:06:24.076 ************************************ 00:06:24.076 04:18:02 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:24.076 04:18:02 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:24.076 04:18:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.076 04:18:02 -- common/autotest_common.sh@10 -- # set +x 00:06:24.076 ************************************ 00:06:24.076 START TEST thread_poller_perf 00:06:24.076 ************************************ 00:06:24.076 04:18:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:24.076 [2024-11-26 04:18:02.954868] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:24.076 [2024-11-26 04:18:02.954946] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2798258 ] 00:06:24.076 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.076 [2024-11-26 04:18:03.015376] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.076 [2024-11-26 04:18:03.104525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.076 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:25.013 [2024-11-26T03:18:04.239Z] ====================================== 00:06:25.013 [2024-11-26T03:18:04.239Z] busy:2703909067 (cyc) 00:06:25.013 [2024-11-26T03:18:04.239Z] total_run_count: 3826000 00:06:25.013 [2024-11-26T03:18:04.239Z] tsc_hz: 2700000000 (cyc) 00:06:25.013 [2024-11-26T03:18:04.239Z] ====================================== 00:06:25.013 [2024-11-26T03:18:04.239Z] poller_cost: 706 (cyc), 261 (nsec) 00:06:25.013 00:06:25.013 real 0m1.244s 00:06:25.013 user 0m1.155s 00:06:25.013 sys 0m0.081s 00:06:25.013 04:18:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.013 04:18:04 -- common/autotest_common.sh@10 -- # set +x 00:06:25.013 ************************************ 00:06:25.013 END TEST thread_poller_perf 00:06:25.013 ************************************ 00:06:25.013 04:18:04 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:25.013 00:06:25.013 real 0m2.694s 00:06:25.013 user 0m2.419s 00:06:25.013 sys 0m0.276s 00:06:25.013 04:18:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.013 04:18:04 -- common/autotest_common.sh@10 -- # set +x 00:06:25.013 ************************************ 00:06:25.013 END TEST thread 00:06:25.013 ************************************ 00:06:25.013 04:18:04 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:25.013 04:18:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.013 04:18:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.013 04:18:04 -- common/autotest_common.sh@10 -- # set +x 00:06:25.013 ************************************ 00:06:25.013 START TEST accel 00:06:25.013 ************************************ 00:06:25.013 04:18:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:25.272 * Looking for test storage... 00:06:25.272 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:25.272 04:18:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:25.272 04:18:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:25.272 04:18:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:25.272 04:18:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:25.272 04:18:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:25.272 04:18:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:25.272 04:18:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:25.272 04:18:04 -- scripts/common.sh@335 -- # IFS=.-: 00:06:25.272 04:18:04 -- scripts/common.sh@335 -- # read -ra ver1 00:06:25.272 04:18:04 -- scripts/common.sh@336 -- # IFS=.-: 00:06:25.272 04:18:04 -- scripts/common.sh@336 -- # read -ra ver2 00:06:25.272 04:18:04 -- scripts/common.sh@337 -- # local 'op=<' 00:06:25.272 04:18:04 -- scripts/common.sh@339 -- # ver1_l=2 00:06:25.272 04:18:04 -- scripts/common.sh@340 -- # ver2_l=1 00:06:25.272 04:18:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:25.272 04:18:04 -- scripts/common.sh@343 -- # case "$op" in 00:06:25.272 04:18:04 -- scripts/common.sh@344 -- # : 1 00:06:25.272 04:18:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:25.272 04:18:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:25.272 04:18:04 -- scripts/common.sh@364 -- # decimal 1 00:06:25.272 04:18:04 -- scripts/common.sh@352 -- # local d=1 00:06:25.272 04:18:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:25.272 04:18:04 -- scripts/common.sh@354 -- # echo 1 00:06:25.272 04:18:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:25.272 04:18:04 -- scripts/common.sh@365 -- # decimal 2 00:06:25.272 04:18:04 -- scripts/common.sh@352 -- # local d=2 00:06:25.272 04:18:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:25.272 04:18:04 -- scripts/common.sh@354 -- # echo 2 00:06:25.272 04:18:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:25.272 04:18:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:25.272 04:18:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:25.272 04:18:04 -- scripts/common.sh@367 -- # return 0 00:06:25.273 04:18:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:25.273 04:18:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:25.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.273 --rc genhtml_branch_coverage=1 00:06:25.273 --rc genhtml_function_coverage=1 00:06:25.273 --rc genhtml_legend=1 00:06:25.273 --rc geninfo_all_blocks=1 00:06:25.273 --rc geninfo_unexecuted_blocks=1 00:06:25.273 00:06:25.273 ' 00:06:25.273 04:18:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:25.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.273 --rc genhtml_branch_coverage=1 00:06:25.273 --rc genhtml_function_coverage=1 00:06:25.273 --rc genhtml_legend=1 00:06:25.273 --rc geninfo_all_blocks=1 00:06:25.273 --rc geninfo_unexecuted_blocks=1 00:06:25.273 00:06:25.273 ' 00:06:25.273 04:18:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:25.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.273 --rc genhtml_branch_coverage=1 00:06:25.273 --rc genhtml_function_coverage=1 00:06:25.273 --rc genhtml_legend=1 00:06:25.273 --rc geninfo_all_blocks=1 00:06:25.273 --rc geninfo_unexecuted_blocks=1 00:06:25.273 00:06:25.273 ' 00:06:25.273 04:18:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:25.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.273 --rc genhtml_branch_coverage=1 00:06:25.273 --rc genhtml_function_coverage=1 00:06:25.273 --rc genhtml_legend=1 00:06:25.273 --rc geninfo_all_blocks=1 00:06:25.273 --rc geninfo_unexecuted_blocks=1 00:06:25.273 00:06:25.273 ' 00:06:25.273 04:18:04 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:25.273 04:18:04 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:25.273 04:18:04 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:25.273 04:18:04 -- accel/accel.sh@59 -- # spdk_tgt_pid=2798461 00:06:25.273 04:18:04 -- accel/accel.sh@60 -- # waitforlisten 2798461 00:06:25.273 04:18:04 -- common/autotest_common.sh@829 -- # '[' -z 2798461 ']' 00:06:25.273 04:18:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:25.273 04:18:04 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:25.273 04:18:04 -- accel/accel.sh@58 -- # build_accel_config 00:06:25.273 04:18:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:25.273 04:18:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:25.273 04:18:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:25.273 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:25.273 04:18:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:25.273 04:18:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:25.273 04:18:04 -- common/autotest_common.sh@10 -- # set +x 00:06:25.273 04:18:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:25.273 04:18:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:25.273 04:18:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:25.273 04:18:04 -- accel/accel.sh@41 -- # local IFS=, 00:06:25.273 04:18:04 -- accel/accel.sh@42 -- # jq -r . 00:06:25.273 [2024-11-26 04:18:04.423842] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:25.273 [2024-11-26 04:18:04.423916] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2798461 ] 00:06:25.273 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.273 [2024-11-26 04:18:04.483449] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.532 [2024-11-26 04:18:04.570457] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:25.532 [2024-11-26 04:18:04.570643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.471 04:18:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:26.471 04:18:05 -- common/autotest_common.sh@862 -- # return 0 00:06:26.471 04:18:05 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:26.471 04:18:05 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:26.471 04:18:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:26.471 04:18:05 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:26.471 04:18:05 -- common/autotest_common.sh@10 -- # set +x 00:06:26.471 04:18:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:26.471 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.471 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.471 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.471 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.471 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.471 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.471 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.471 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.471 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.471 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.471 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.471 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.471 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.471 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.471 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.471 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.471 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.471 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.471 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.471 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.471 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.472 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.472 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.472 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.472 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.472 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.472 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.472 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.472 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.472 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.472 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.472 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.472 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.472 04:18:05 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:26.472 04:18:05 -- accel/accel.sh@64 -- # IFS== 00:06:26.472 04:18:05 -- accel/accel.sh@64 -- # read -r opc module 00:06:26.472 04:18:05 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:26.472 04:18:05 -- accel/accel.sh@67 -- # killprocess 2798461 00:06:26.472 04:18:05 -- common/autotest_common.sh@936 -- # '[' -z 2798461 ']' 00:06:26.472 04:18:05 -- common/autotest_common.sh@940 -- # kill -0 2798461 00:06:26.472 04:18:05 -- common/autotest_common.sh@941 -- # uname 00:06:26.472 04:18:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:26.472 04:18:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2798461 00:06:26.472 04:18:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:26.472 04:18:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:26.472 04:18:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2798461' 00:06:26.472 killing process with pid 2798461 00:06:26.472 04:18:05 -- common/autotest_common.sh@955 -- # kill 2798461 00:06:26.472 04:18:05 -- common/autotest_common.sh@960 -- # wait 2798461 00:06:26.731 04:18:05 -- accel/accel.sh@68 -- # trap - ERR 00:06:26.731 04:18:05 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:26.731 04:18:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:26.731 04:18:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.731 04:18:05 -- common/autotest_common.sh@10 -- # set +x 00:06:26.731 04:18:05 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:26.731 04:18:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:26.731 04:18:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:26.731 04:18:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:26.731 04:18:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:26.731 04:18:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:26.731 04:18:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:26.731 04:18:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:26.731 04:18:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:26.731 04:18:05 -- accel/accel.sh@42 -- # jq -r . 00:06:26.731 04:18:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:26.731 04:18:05 -- common/autotest_common.sh@10 -- # set +x 00:06:26.731 04:18:05 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:26.731 04:18:05 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:26.731 04:18:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.731 04:18:05 -- common/autotest_common.sh@10 -- # set +x 00:06:26.731 ************************************ 00:06:26.731 START TEST accel_missing_filename 00:06:26.731 ************************************ 00:06:26.731 04:18:05 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:26.731 04:18:05 -- common/autotest_common.sh@650 -- # local es=0 00:06:26.731 04:18:05 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:26.731 04:18:05 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:26.731 04:18:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:26.731 04:18:05 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:26.731 04:18:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:26.731 04:18:05 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:26.731 04:18:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:26.731 04:18:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:26.731 04:18:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:26.731 04:18:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:26.731 04:18:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:26.731 04:18:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:26.731 04:18:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:26.731 04:18:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:26.731 04:18:05 -- accel/accel.sh@42 -- # jq -r . 00:06:26.731 [2024-11-26 04:18:05.944471] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:26.731 [2024-11-26 04:18:05.944544] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2798762 ] 00:06:26.992 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.992 [2024-11-26 04:18:06.006718] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.992 [2024-11-26 04:18:06.095504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.992 [2024-11-26 04:18:06.157105] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:27.253 [2024-11-26 04:18:06.245893] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:27.253 A filename is required. 00:06:27.253 04:18:06 -- common/autotest_common.sh@653 -- # es=234 00:06:27.253 04:18:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:27.253 04:18:06 -- common/autotest_common.sh@662 -- # es=106 00:06:27.253 04:18:06 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:27.253 04:18:06 -- common/autotest_common.sh@670 -- # es=1 00:06:27.253 04:18:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:27.253 00:06:27.253 real 0m0.400s 00:06:27.253 user 0m0.288s 00:06:27.253 sys 0m0.142s 00:06:27.253 04:18:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.253 04:18:06 -- common/autotest_common.sh@10 -- # set +x 00:06:27.253 ************************************ 00:06:27.253 END TEST accel_missing_filename 00:06:27.253 ************************************ 00:06:27.253 04:18:06 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:27.253 04:18:06 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:27.253 04:18:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.253 04:18:06 -- common/autotest_common.sh@10 -- # set +x 00:06:27.253 ************************************ 00:06:27.253 START TEST accel_compress_verify 00:06:27.253 ************************************ 00:06:27.253 04:18:06 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:27.253 04:18:06 -- common/autotest_common.sh@650 -- # local es=0 00:06:27.253 04:18:06 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:27.253 04:18:06 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:27.253 04:18:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:27.253 04:18:06 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:27.253 04:18:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:27.253 04:18:06 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:27.253 04:18:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:27.253 04:18:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.253 04:18:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.253 04:18:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.253 04:18:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.253 04:18:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.253 04:18:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.253 04:18:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.253 04:18:06 -- accel/accel.sh@42 -- # jq -r . 00:06:27.253 [2024-11-26 04:18:06.374059] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:27.253 [2024-11-26 04:18:06.374144] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2798782 ] 00:06:27.253 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.253 [2024-11-26 04:18:06.439266] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.514 [2024-11-26 04:18:06.529629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.514 [2024-11-26 04:18:06.589790] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:27.514 [2024-11-26 04:18:06.674584] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:27.774 00:06:27.774 Compression does not support the verify option, aborting. 00:06:27.774 04:18:06 -- common/autotest_common.sh@653 -- # es=161 00:06:27.774 04:18:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:27.774 04:18:06 -- common/autotest_common.sh@662 -- # es=33 00:06:27.774 04:18:06 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:27.774 04:18:06 -- common/autotest_common.sh@670 -- # es=1 00:06:27.774 04:18:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:27.774 00:06:27.774 real 0m0.401s 00:06:27.774 user 0m0.279s 00:06:27.774 sys 0m0.156s 00:06:27.774 04:18:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.774 04:18:06 -- common/autotest_common.sh@10 -- # set +x 00:06:27.774 ************************************ 00:06:27.774 END TEST accel_compress_verify 00:06:27.774 ************************************ 00:06:27.774 04:18:06 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:27.774 04:18:06 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:27.774 04:18:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.774 04:18:06 -- common/autotest_common.sh@10 -- # set +x 00:06:27.774 ************************************ 00:06:27.774 START TEST accel_wrong_workload 00:06:27.774 ************************************ 00:06:27.774 04:18:06 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:27.774 04:18:06 -- common/autotest_common.sh@650 -- # local es=0 00:06:27.774 04:18:06 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:27.774 04:18:06 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:27.774 04:18:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:27.774 04:18:06 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:27.774 04:18:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:27.774 04:18:06 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:27.774 04:18:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:27.774 04:18:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.774 04:18:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.774 04:18:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.774 04:18:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.774 04:18:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.774 04:18:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.774 04:18:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.774 04:18:06 -- accel/accel.sh@42 -- # jq -r . 00:06:27.774 Unsupported workload type: foobar 00:06:27.774 [2024-11-26 04:18:06.800604] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:27.774 accel_perf options: 00:06:27.774 [-h help message] 00:06:27.774 [-q queue depth per core] 00:06:27.774 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:27.774 [-T number of threads per core 00:06:27.774 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:27.774 [-t time in seconds] 00:06:27.774 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:27.774 [ dif_verify, , dif_generate, dif_generate_copy 00:06:27.774 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:27.774 [-l for compress/decompress workloads, name of uncompressed input file 00:06:27.774 [-S for crc32c workload, use this seed value (default 0) 00:06:27.774 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:27.774 [-f for fill workload, use this BYTE value (default 255) 00:06:27.774 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:27.774 [-y verify result if this switch is on] 00:06:27.774 [-a tasks to allocate per core (default: same value as -q)] 00:06:27.774 Can be used to spread operations across a wider range of memory. 00:06:27.774 04:18:06 -- common/autotest_common.sh@653 -- # es=1 00:06:27.774 04:18:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:27.774 04:18:06 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:27.774 04:18:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:27.774 00:06:27.774 real 0m0.021s 00:06:27.774 user 0m0.011s 00:06:27.774 sys 0m0.010s 00:06:27.774 04:18:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.774 04:18:06 -- common/autotest_common.sh@10 -- # set +x 00:06:27.774 ************************************ 00:06:27.774 END TEST accel_wrong_workload 00:06:27.774 ************************************ 00:06:27.774 Error: writing output failed: Broken pipe 00:06:27.774 04:18:06 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:27.774 04:18:06 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:27.774 04:18:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.774 04:18:06 -- common/autotest_common.sh@10 -- # set +x 00:06:27.774 ************************************ 00:06:27.774 START TEST accel_negative_buffers 00:06:27.774 ************************************ 00:06:27.774 04:18:06 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:27.774 04:18:06 -- common/autotest_common.sh@650 -- # local es=0 00:06:27.774 04:18:06 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:27.774 04:18:06 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:27.774 04:18:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:27.774 04:18:06 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:27.774 04:18:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:27.774 04:18:06 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:27.774 04:18:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:27.774 04:18:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.774 04:18:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.774 04:18:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.774 04:18:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.774 04:18:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.774 04:18:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.774 04:18:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.774 04:18:06 -- accel/accel.sh@42 -- # jq -r . 00:06:27.774 -x option must be non-negative. 00:06:27.774 [2024-11-26 04:18:06.846624] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:27.774 accel_perf options: 00:06:27.774 [-h help message] 00:06:27.774 [-q queue depth per core] 00:06:27.774 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:27.774 [-T number of threads per core 00:06:27.774 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:27.774 [-t time in seconds] 00:06:27.774 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:27.774 [ dif_verify, , dif_generate, dif_generate_copy 00:06:27.774 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:27.774 [-l for compress/decompress workloads, name of uncompressed input file 00:06:27.774 [-S for crc32c workload, use this seed value (default 0) 00:06:27.774 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:27.774 [-f for fill workload, use this BYTE value (default 255) 00:06:27.774 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:27.774 [-y verify result if this switch is on] 00:06:27.774 [-a tasks to allocate per core (default: same value as -q)] 00:06:27.774 Can be used to spread operations across a wider range of memory. 00:06:27.774 04:18:06 -- common/autotest_common.sh@653 -- # es=1 00:06:27.774 04:18:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:27.774 04:18:06 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:27.774 04:18:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:27.774 00:06:27.774 real 0m0.021s 00:06:27.774 user 0m0.010s 00:06:27.774 sys 0m0.012s 00:06:27.775 04:18:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.775 04:18:06 -- common/autotest_common.sh@10 -- # set +x 00:06:27.775 ************************************ 00:06:27.775 END TEST accel_negative_buffers 00:06:27.775 ************************************ 00:06:27.775 Error: writing output failed: Broken pipe 00:06:27.775 04:18:06 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:27.775 04:18:06 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:27.775 04:18:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.775 04:18:06 -- common/autotest_common.sh@10 -- # set +x 00:06:27.775 ************************************ 00:06:27.775 START TEST accel_crc32c 00:06:27.775 ************************************ 00:06:27.775 04:18:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:27.775 04:18:06 -- accel/accel.sh@16 -- # local accel_opc 00:06:27.775 04:18:06 -- accel/accel.sh@17 -- # local accel_module 00:06:27.775 04:18:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:27.775 04:18:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:27.775 04:18:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.775 04:18:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.775 04:18:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.775 04:18:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.775 04:18:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.775 04:18:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.775 04:18:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.775 04:18:06 -- accel/accel.sh@42 -- # jq -r . 00:06:27.775 [2024-11-26 04:18:06.895077] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:27.775 [2024-11-26 04:18:06.895151] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2798851 ] 00:06:27.775 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.775 [2024-11-26 04:18:06.959590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:28.035 [2024-11-26 04:18:07.054659] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.415 04:18:08 -- accel/accel.sh@18 -- # out=' 00:06:29.415 SPDK Configuration: 00:06:29.415 Core mask: 0x1 00:06:29.415 00:06:29.415 Accel Perf Configuration: 00:06:29.415 Workload Type: crc32c 00:06:29.415 CRC-32C seed: 32 00:06:29.415 Transfer size: 4096 bytes 00:06:29.415 Vector count 1 00:06:29.415 Module: software 00:06:29.415 Queue depth: 32 00:06:29.415 Allocate depth: 32 00:06:29.415 # threads/core: 1 00:06:29.415 Run time: 1 seconds 00:06:29.415 Verify: Yes 00:06:29.415 00:06:29.415 Running for 1 seconds... 00:06:29.415 00:06:29.415 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:29.415 ------------------------------------------------------------------------------------ 00:06:29.415 0,0 408352/s 1595 MiB/s 0 0 00:06:29.415 ==================================================================================== 00:06:29.415 Total 408352/s 1595 MiB/s 0 0' 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:29.415 04:18:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.415 04:18:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.415 04:18:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.415 04:18:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.415 04:18:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.415 04:18:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.415 04:18:08 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.415 04:18:08 -- accel/accel.sh@42 -- # jq -r . 00:06:29.415 [2024-11-26 04:18:08.293101] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:29.415 [2024-11-26 04:18:08.293186] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2799484 ] 00:06:29.415 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.415 [2024-11-26 04:18:08.354144] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.415 [2024-11-26 04:18:08.443573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val= 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val= 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val=0x1 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val= 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val= 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val=crc32c 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val=32 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val= 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val=software 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@23 -- # accel_module=software 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val=32 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val=32 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val=1 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val=Yes 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val= 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:29.415 04:18:08 -- accel/accel.sh@21 -- # val= 00:06:29.415 04:18:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # IFS=: 00:06:29.415 04:18:08 -- accel/accel.sh@20 -- # read -r var val 00:06:30.792 04:18:09 -- accel/accel.sh@21 -- # val= 00:06:30.792 04:18:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.792 04:18:09 -- accel/accel.sh@20 -- # IFS=: 00:06:30.792 04:18:09 -- accel/accel.sh@20 -- # read -r var val 00:06:30.792 04:18:09 -- accel/accel.sh@21 -- # val= 00:06:30.792 04:18:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.792 04:18:09 -- accel/accel.sh@20 -- # IFS=: 00:06:30.792 04:18:09 -- accel/accel.sh@20 -- # read -r var val 00:06:30.792 04:18:09 -- accel/accel.sh@21 -- # val= 00:06:30.792 04:18:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.792 04:18:09 -- accel/accel.sh@20 -- # IFS=: 00:06:30.792 04:18:09 -- accel/accel.sh@20 -- # read -r var val 00:06:30.792 04:18:09 -- accel/accel.sh@21 -- # val= 00:06:30.792 04:18:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.792 04:18:09 -- accel/accel.sh@20 -- # IFS=: 00:06:30.792 04:18:09 -- accel/accel.sh@20 -- # read -r var val 00:06:30.792 04:18:09 -- accel/accel.sh@21 -- # val= 00:06:30.792 04:18:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.792 04:18:09 -- accel/accel.sh@20 -- # IFS=: 00:06:30.792 04:18:09 -- accel/accel.sh@20 -- # read -r var val 00:06:30.792 04:18:09 -- accel/accel.sh@21 -- # val= 00:06:30.792 04:18:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.792 04:18:09 -- accel/accel.sh@20 -- # IFS=: 00:06:30.792 04:18:09 -- accel/accel.sh@20 -- # read -r var val 00:06:30.792 04:18:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:30.792 04:18:09 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:30.792 04:18:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:30.792 00:06:30.792 real 0m2.799s 00:06:30.792 user 0m2.506s 00:06:30.792 sys 0m0.285s 00:06:30.792 04:18:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.792 04:18:09 -- common/autotest_common.sh@10 -- # set +x 00:06:30.792 ************************************ 00:06:30.792 END TEST accel_crc32c 00:06:30.792 ************************************ 00:06:30.792 04:18:09 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:30.792 04:18:09 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:30.792 04:18:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.792 04:18:09 -- common/autotest_common.sh@10 -- # set +x 00:06:30.792 ************************************ 00:06:30.792 START TEST accel_crc32c_C2 00:06:30.792 ************************************ 00:06:30.792 04:18:09 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:30.792 04:18:09 -- accel/accel.sh@16 -- # local accel_opc 00:06:30.792 04:18:09 -- accel/accel.sh@17 -- # local accel_module 00:06:30.792 04:18:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:30.792 04:18:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:30.792 04:18:09 -- accel/accel.sh@12 -- # build_accel_config 00:06:30.792 04:18:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:30.792 04:18:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:30.792 04:18:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:30.792 04:18:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:30.792 04:18:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:30.792 04:18:09 -- accel/accel.sh@41 -- # local IFS=, 00:06:30.792 04:18:09 -- accel/accel.sh@42 -- # jq -r . 00:06:30.792 [2024-11-26 04:18:09.719004] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:30.792 [2024-11-26 04:18:09.719092] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2799783 ] 00:06:30.792 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.792 [2024-11-26 04:18:09.779795] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.792 [2024-11-26 04:18:09.871175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.169 04:18:11 -- accel/accel.sh@18 -- # out=' 00:06:32.170 SPDK Configuration: 00:06:32.170 Core mask: 0x1 00:06:32.170 00:06:32.170 Accel Perf Configuration: 00:06:32.170 Workload Type: crc32c 00:06:32.170 CRC-32C seed: 0 00:06:32.170 Transfer size: 4096 bytes 00:06:32.170 Vector count 2 00:06:32.170 Module: software 00:06:32.170 Queue depth: 32 00:06:32.170 Allocate depth: 32 00:06:32.170 # threads/core: 1 00:06:32.170 Run time: 1 seconds 00:06:32.170 Verify: Yes 00:06:32.170 00:06:32.170 Running for 1 seconds... 00:06:32.170 00:06:32.170 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:32.170 ------------------------------------------------------------------------------------ 00:06:32.170 0,0 316608/s 2473 MiB/s 0 0 00:06:32.170 ==================================================================================== 00:06:32.170 Total 316608/s 1236 MiB/s 0 0' 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:32.170 04:18:11 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.170 04:18:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:32.170 04:18:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.170 04:18:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.170 04:18:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:32.170 04:18:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:32.170 04:18:11 -- accel/accel.sh@41 -- # local IFS=, 00:06:32.170 04:18:11 -- accel/accel.sh@42 -- # jq -r . 00:06:32.170 [2024-11-26 04:18:11.127024] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:32.170 [2024-11-26 04:18:11.127116] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2799929 ] 00:06:32.170 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.170 [2024-11-26 04:18:11.189803] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.170 [2024-11-26 04:18:11.278045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val= 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val= 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val=0x1 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val= 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val= 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val=crc32c 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val=0 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val= 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val=software 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@23 -- # accel_module=software 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val=32 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val=32 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val=1 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val=Yes 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val= 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:32.170 04:18:11 -- accel/accel.sh@21 -- # val= 00:06:32.170 04:18:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # IFS=: 00:06:32.170 04:18:11 -- accel/accel.sh@20 -- # read -r var val 00:06:33.549 04:18:12 -- accel/accel.sh@21 -- # val= 00:06:33.549 04:18:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.549 04:18:12 -- accel/accel.sh@20 -- # IFS=: 00:06:33.549 04:18:12 -- accel/accel.sh@20 -- # read -r var val 00:06:33.549 04:18:12 -- accel/accel.sh@21 -- # val= 00:06:33.550 04:18:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.550 04:18:12 -- accel/accel.sh@20 -- # IFS=: 00:06:33.550 04:18:12 -- accel/accel.sh@20 -- # read -r var val 00:06:33.550 04:18:12 -- accel/accel.sh@21 -- # val= 00:06:33.550 04:18:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.550 04:18:12 -- accel/accel.sh@20 -- # IFS=: 00:06:33.550 04:18:12 -- accel/accel.sh@20 -- # read -r var val 00:06:33.550 04:18:12 -- accel/accel.sh@21 -- # val= 00:06:33.550 04:18:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.550 04:18:12 -- accel/accel.sh@20 -- # IFS=: 00:06:33.550 04:18:12 -- accel/accel.sh@20 -- # read -r var val 00:06:33.550 04:18:12 -- accel/accel.sh@21 -- # val= 00:06:33.550 04:18:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.550 04:18:12 -- accel/accel.sh@20 -- # IFS=: 00:06:33.550 04:18:12 -- accel/accel.sh@20 -- # read -r var val 00:06:33.550 04:18:12 -- accel/accel.sh@21 -- # val= 00:06:33.550 04:18:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.550 04:18:12 -- accel/accel.sh@20 -- # IFS=: 00:06:33.550 04:18:12 -- accel/accel.sh@20 -- # read -r var val 00:06:33.550 04:18:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:33.550 04:18:12 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:33.550 04:18:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:33.550 00:06:33.550 real 0m2.810s 00:06:33.550 user 0m2.523s 00:06:33.550 sys 0m0.279s 00:06:33.550 04:18:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.550 04:18:12 -- common/autotest_common.sh@10 -- # set +x 00:06:33.550 ************************************ 00:06:33.550 END TEST accel_crc32c_C2 00:06:33.550 ************************************ 00:06:33.550 04:18:12 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:33.550 04:18:12 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:33.550 04:18:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.550 04:18:12 -- common/autotest_common.sh@10 -- # set +x 00:06:33.550 ************************************ 00:06:33.550 START TEST accel_copy 00:06:33.550 ************************************ 00:06:33.550 04:18:12 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:06:33.550 04:18:12 -- accel/accel.sh@16 -- # local accel_opc 00:06:33.550 04:18:12 -- accel/accel.sh@17 -- # local accel_module 00:06:33.550 04:18:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:33.550 04:18:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:33.550 04:18:12 -- accel/accel.sh@12 -- # build_accel_config 00:06:33.550 04:18:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.550 04:18:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.550 04:18:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.550 04:18:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.550 04:18:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.550 04:18:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.550 04:18:12 -- accel/accel.sh@42 -- # jq -r . 00:06:33.550 [2024-11-26 04:18:12.557301] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:33.550 [2024-11-26 04:18:12.557391] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2800102 ] 00:06:33.550 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.550 [2024-11-26 04:18:12.618484] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.550 [2024-11-26 04:18:12.707936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.932 04:18:13 -- accel/accel.sh@18 -- # out=' 00:06:34.932 SPDK Configuration: 00:06:34.932 Core mask: 0x1 00:06:34.932 00:06:34.932 Accel Perf Configuration: 00:06:34.932 Workload Type: copy 00:06:34.932 Transfer size: 4096 bytes 00:06:34.932 Vector count 1 00:06:34.932 Module: software 00:06:34.932 Queue depth: 32 00:06:34.932 Allocate depth: 32 00:06:34.932 # threads/core: 1 00:06:34.932 Run time: 1 seconds 00:06:34.932 Verify: Yes 00:06:34.932 00:06:34.932 Running for 1 seconds... 00:06:34.932 00:06:34.932 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:34.932 ------------------------------------------------------------------------------------ 00:06:34.932 0,0 276576/s 1080 MiB/s 0 0 00:06:34.932 ==================================================================================== 00:06:34.932 Total 276576/s 1080 MiB/s 0 0' 00:06:34.932 04:18:13 -- accel/accel.sh@20 -- # IFS=: 00:06:34.932 04:18:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:34.932 04:18:13 -- accel/accel.sh@20 -- # read -r var val 00:06:34.932 04:18:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:34.932 04:18:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:34.932 04:18:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:34.932 04:18:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:34.932 04:18:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:34.932 04:18:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:34.932 04:18:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:34.932 04:18:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:34.932 04:18:13 -- accel/accel.sh@42 -- # jq -r . 00:06:34.932 [2024-11-26 04:18:13.959100] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:34.932 [2024-11-26 04:18:13.959181] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2800354 ] 00:06:34.932 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.932 [2024-11-26 04:18:14.020152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.932 [2024-11-26 04:18:14.109335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val= 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val= 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val=0x1 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val= 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val= 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val=copy 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val= 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val=software 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@23 -- # accel_module=software 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val=32 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val=32 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val=1 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val=Yes 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val= 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:35.193 04:18:14 -- accel/accel.sh@21 -- # val= 00:06:35.193 04:18:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:35.193 04:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:36.133 04:18:15 -- accel/accel.sh@21 -- # val= 00:06:36.133 04:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.133 04:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:36.133 04:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:36.133 04:18:15 -- accel/accel.sh@21 -- # val= 00:06:36.133 04:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.133 04:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:36.133 04:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:36.133 04:18:15 -- accel/accel.sh@21 -- # val= 00:06:36.133 04:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.133 04:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:36.133 04:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:36.133 04:18:15 -- accel/accel.sh@21 -- # val= 00:06:36.133 04:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.133 04:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:36.133 04:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:36.133 04:18:15 -- accel/accel.sh@21 -- # val= 00:06:36.133 04:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.133 04:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:36.133 04:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:36.133 04:18:15 -- accel/accel.sh@21 -- # val= 00:06:36.133 04:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.133 04:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:36.133 04:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:36.133 04:18:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:36.133 04:18:15 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:36.133 04:18:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:36.133 00:06:36.133 real 0m2.810s 00:06:36.133 user 0m2.516s 00:06:36.133 sys 0m0.285s 00:06:36.133 04:18:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.133 04:18:15 -- common/autotest_common.sh@10 -- # set +x 00:06:36.133 ************************************ 00:06:36.133 END TEST accel_copy 00:06:36.133 ************************************ 00:06:36.393 04:18:15 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:36.393 04:18:15 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:36.393 04:18:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.393 04:18:15 -- common/autotest_common.sh@10 -- # set +x 00:06:36.393 ************************************ 00:06:36.393 START TEST accel_fill 00:06:36.394 ************************************ 00:06:36.394 04:18:15 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:36.394 04:18:15 -- accel/accel.sh@16 -- # local accel_opc 00:06:36.394 04:18:15 -- accel/accel.sh@17 -- # local accel_module 00:06:36.394 04:18:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:36.394 04:18:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:36.394 04:18:15 -- accel/accel.sh@12 -- # build_accel_config 00:06:36.394 04:18:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.394 04:18:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.394 04:18:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.394 04:18:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.394 04:18:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.394 04:18:15 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.394 04:18:15 -- accel/accel.sh@42 -- # jq -r . 00:06:36.394 [2024-11-26 04:18:15.394171] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:36.394 [2024-11-26 04:18:15.394260] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2800510 ] 00:06:36.394 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.394 [2024-11-26 04:18:15.456529] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.394 [2024-11-26 04:18:15.546982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.776 04:18:16 -- accel/accel.sh@18 -- # out=' 00:06:37.776 SPDK Configuration: 00:06:37.776 Core mask: 0x1 00:06:37.776 00:06:37.776 Accel Perf Configuration: 00:06:37.776 Workload Type: fill 00:06:37.776 Fill pattern: 0x80 00:06:37.776 Transfer size: 4096 bytes 00:06:37.776 Vector count 1 00:06:37.776 Module: software 00:06:37.776 Queue depth: 64 00:06:37.776 Allocate depth: 64 00:06:37.776 # threads/core: 1 00:06:37.776 Run time: 1 seconds 00:06:37.776 Verify: Yes 00:06:37.776 00:06:37.776 Running for 1 seconds... 00:06:37.776 00:06:37.776 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:37.776 ------------------------------------------------------------------------------------ 00:06:37.776 0,0 404992/s 1582 MiB/s 0 0 00:06:37.776 ==================================================================================== 00:06:37.776 Total 404992/s 1582 MiB/s 0 0' 00:06:37.776 04:18:16 -- accel/accel.sh@20 -- # IFS=: 00:06:37.776 04:18:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:37.776 04:18:16 -- accel/accel.sh@20 -- # read -r var val 00:06:37.776 04:18:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:37.776 04:18:16 -- accel/accel.sh@12 -- # build_accel_config 00:06:37.776 04:18:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:37.776 04:18:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:37.776 04:18:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:37.776 04:18:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:37.776 04:18:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:37.776 04:18:16 -- accel/accel.sh@41 -- # local IFS=, 00:06:37.776 04:18:16 -- accel/accel.sh@42 -- # jq -r . 00:06:37.776 [2024-11-26 04:18:16.803453] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:37.776 [2024-11-26 04:18:16.803542] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2800648 ] 00:06:37.776 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.776 [2024-11-26 04:18:16.864147] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.776 [2024-11-26 04:18:16.953489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val= 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val= 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val=0x1 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val= 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val= 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val=fill 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@24 -- # accel_opc=fill 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val=0x80 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val= 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val=software 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@23 -- # accel_module=software 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val=64 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val=64 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val=1 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val=Yes 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val= 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:38.037 04:18:17 -- accel/accel.sh@21 -- # val= 00:06:38.037 04:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:38.037 04:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:39.047 04:18:18 -- accel/accel.sh@21 -- # val= 00:06:39.047 04:18:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.047 04:18:18 -- accel/accel.sh@20 -- # IFS=: 00:06:39.047 04:18:18 -- accel/accel.sh@20 -- # read -r var val 00:06:39.047 04:18:18 -- accel/accel.sh@21 -- # val= 00:06:39.047 04:18:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.047 04:18:18 -- accel/accel.sh@20 -- # IFS=: 00:06:39.047 04:18:18 -- accel/accel.sh@20 -- # read -r var val 00:06:39.047 04:18:18 -- accel/accel.sh@21 -- # val= 00:06:39.047 04:18:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.047 04:18:18 -- accel/accel.sh@20 -- # IFS=: 00:06:39.047 04:18:18 -- accel/accel.sh@20 -- # read -r var val 00:06:39.047 04:18:18 -- accel/accel.sh@21 -- # val= 00:06:39.047 04:18:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.047 04:18:18 -- accel/accel.sh@20 -- # IFS=: 00:06:39.047 04:18:18 -- accel/accel.sh@20 -- # read -r var val 00:06:39.047 04:18:18 -- accel/accel.sh@21 -- # val= 00:06:39.047 04:18:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.047 04:18:18 -- accel/accel.sh@20 -- # IFS=: 00:06:39.047 04:18:18 -- accel/accel.sh@20 -- # read -r var val 00:06:39.047 04:18:18 -- accel/accel.sh@21 -- # val= 00:06:39.047 04:18:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.047 04:18:18 -- accel/accel.sh@20 -- # IFS=: 00:06:39.047 04:18:18 -- accel/accel.sh@20 -- # read -r var val 00:06:39.047 04:18:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:39.047 04:18:18 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:06:39.047 04:18:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:39.047 00:06:39.047 real 0m2.806s 00:06:39.047 user 0m2.510s 00:06:39.047 sys 0m0.288s 00:06:39.047 04:18:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.047 04:18:18 -- common/autotest_common.sh@10 -- # set +x 00:06:39.047 ************************************ 00:06:39.047 END TEST accel_fill 00:06:39.047 ************************************ 00:06:39.047 04:18:18 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:06:39.047 04:18:18 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:39.047 04:18:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.047 04:18:18 -- common/autotest_common.sh@10 -- # set +x 00:06:39.047 ************************************ 00:06:39.047 START TEST accel_copy_crc32c 00:06:39.047 ************************************ 00:06:39.047 04:18:18 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:06:39.047 04:18:18 -- accel/accel.sh@16 -- # local accel_opc 00:06:39.047 04:18:18 -- accel/accel.sh@17 -- # local accel_module 00:06:39.047 04:18:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:39.047 04:18:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:39.047 04:18:18 -- accel/accel.sh@12 -- # build_accel_config 00:06:39.047 04:18:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:39.047 04:18:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:39.047 04:18:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:39.047 04:18:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:39.047 04:18:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:39.047 04:18:18 -- accel/accel.sh@41 -- # local IFS=, 00:06:39.047 04:18:18 -- accel/accel.sh@42 -- # jq -r . 00:06:39.047 [2024-11-26 04:18:18.225651] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:39.047 [2024-11-26 04:18:18.225775] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2800821 ] 00:06:39.047 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.304 [2024-11-26 04:18:18.282153] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.304 [2024-11-26 04:18:18.369706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.681 04:18:19 -- accel/accel.sh@18 -- # out=' 00:06:40.681 SPDK Configuration: 00:06:40.681 Core mask: 0x1 00:06:40.681 00:06:40.681 Accel Perf Configuration: 00:06:40.681 Workload Type: copy_crc32c 00:06:40.681 CRC-32C seed: 0 00:06:40.681 Vector size: 4096 bytes 00:06:40.681 Transfer size: 4096 bytes 00:06:40.681 Vector count 1 00:06:40.681 Module: software 00:06:40.681 Queue depth: 32 00:06:40.681 Allocate depth: 32 00:06:40.681 # threads/core: 1 00:06:40.681 Run time: 1 seconds 00:06:40.681 Verify: Yes 00:06:40.681 00:06:40.681 Running for 1 seconds... 00:06:40.681 00:06:40.681 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:40.681 ------------------------------------------------------------------------------------ 00:06:40.681 0,0 218208/s 852 MiB/s 0 0 00:06:40.681 ==================================================================================== 00:06:40.681 Total 218208/s 852 MiB/s 0 0' 00:06:40.681 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.681 04:18:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:40.682 04:18:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:40.682 04:18:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:40.682 04:18:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:40.682 04:18:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:40.682 04:18:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:40.682 04:18:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:40.682 04:18:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:40.682 04:18:19 -- accel/accel.sh@42 -- # jq -r . 00:06:40.682 [2024-11-26 04:18:19.617138] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:40.682 [2024-11-26 04:18:19.617221] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2801082 ] 00:06:40.682 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.682 [2024-11-26 04:18:19.679730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:40.682 [2024-11-26 04:18:19.768165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val= 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val= 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val=0x1 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val= 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val= 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val=0 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val= 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val=software 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@23 -- # accel_module=software 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val=32 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val=32 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val=1 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val=Yes 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val= 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:40.682 04:18:19 -- accel/accel.sh@21 -- # val= 00:06:40.682 04:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:40.682 04:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:42.065 04:18:21 -- accel/accel.sh@21 -- # val= 00:06:42.065 04:18:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.065 04:18:21 -- accel/accel.sh@20 -- # IFS=: 00:06:42.065 04:18:21 -- accel/accel.sh@20 -- # read -r var val 00:06:42.065 04:18:21 -- accel/accel.sh@21 -- # val= 00:06:42.065 04:18:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.065 04:18:21 -- accel/accel.sh@20 -- # IFS=: 00:06:42.065 04:18:21 -- accel/accel.sh@20 -- # read -r var val 00:06:42.065 04:18:21 -- accel/accel.sh@21 -- # val= 00:06:42.065 04:18:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.065 04:18:21 -- accel/accel.sh@20 -- # IFS=: 00:06:42.065 04:18:21 -- accel/accel.sh@20 -- # read -r var val 00:06:42.065 04:18:21 -- accel/accel.sh@21 -- # val= 00:06:42.065 04:18:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.065 04:18:21 -- accel/accel.sh@20 -- # IFS=: 00:06:42.065 04:18:21 -- accel/accel.sh@20 -- # read -r var val 00:06:42.065 04:18:21 -- accel/accel.sh@21 -- # val= 00:06:42.065 04:18:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.065 04:18:21 -- accel/accel.sh@20 -- # IFS=: 00:06:42.065 04:18:21 -- accel/accel.sh@20 -- # read -r var val 00:06:42.065 04:18:21 -- accel/accel.sh@21 -- # val= 00:06:42.065 04:18:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.065 04:18:21 -- accel/accel.sh@20 -- # IFS=: 00:06:42.065 04:18:21 -- accel/accel.sh@20 -- # read -r var val 00:06:42.065 04:18:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:42.065 04:18:21 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:42.065 04:18:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:42.065 00:06:42.065 real 0m2.799s 00:06:42.065 user 0m2.509s 00:06:42.065 sys 0m0.282s 00:06:42.065 04:18:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:42.065 04:18:21 -- common/autotest_common.sh@10 -- # set +x 00:06:42.065 ************************************ 00:06:42.065 END TEST accel_copy_crc32c 00:06:42.065 ************************************ 00:06:42.065 04:18:21 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:06:42.065 04:18:21 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:42.065 04:18:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.065 04:18:21 -- common/autotest_common.sh@10 -- # set +x 00:06:42.065 ************************************ 00:06:42.065 START TEST accel_copy_crc32c_C2 00:06:42.065 ************************************ 00:06:42.065 04:18:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:06:42.065 04:18:21 -- accel/accel.sh@16 -- # local accel_opc 00:06:42.065 04:18:21 -- accel/accel.sh@17 -- # local accel_module 00:06:42.065 04:18:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:42.065 04:18:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:42.065 04:18:21 -- accel/accel.sh@12 -- # build_accel_config 00:06:42.065 04:18:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:42.065 04:18:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:42.065 04:18:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:42.065 04:18:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:42.065 04:18:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:42.065 04:18:21 -- accel/accel.sh@41 -- # local IFS=, 00:06:42.065 04:18:21 -- accel/accel.sh@42 -- # jq -r . 00:06:42.065 [2024-11-26 04:18:21.049068] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:42.065 [2024-11-26 04:18:21.049158] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2801244 ] 00:06:42.065 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.065 [2024-11-26 04:18:21.110434] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.065 [2024-11-26 04:18:21.200898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.443 04:18:22 -- accel/accel.sh@18 -- # out=' 00:06:43.443 SPDK Configuration: 00:06:43.443 Core mask: 0x1 00:06:43.443 00:06:43.443 Accel Perf Configuration: 00:06:43.443 Workload Type: copy_crc32c 00:06:43.443 CRC-32C seed: 0 00:06:43.443 Vector size: 4096 bytes 00:06:43.443 Transfer size: 8192 bytes 00:06:43.443 Vector count 2 00:06:43.443 Module: software 00:06:43.443 Queue depth: 32 00:06:43.443 Allocate depth: 32 00:06:43.443 # threads/core: 1 00:06:43.443 Run time: 1 seconds 00:06:43.443 Verify: Yes 00:06:43.443 00:06:43.443 Running for 1 seconds... 00:06:43.443 00:06:43.443 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:43.443 ------------------------------------------------------------------------------------ 00:06:43.443 0,0 155104/s 1211 MiB/s 0 0 00:06:43.443 ==================================================================================== 00:06:43.443 Total 155104/s 605 MiB/s 0 0' 00:06:43.443 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.443 04:18:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:43.443 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.443 04:18:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:43.443 04:18:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:43.443 04:18:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:43.443 04:18:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:43.443 04:18:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:43.443 04:18:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:43.443 04:18:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:43.443 04:18:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:43.443 04:18:22 -- accel/accel.sh@42 -- # jq -r . 00:06:43.443 [2024-11-26 04:18:22.457094] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:43.443 [2024-11-26 04:18:22.457191] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2801382 ] 00:06:43.443 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.443 [2024-11-26 04:18:22.518416] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:43.443 [2024-11-26 04:18:22.606582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.443 04:18:22 -- accel/accel.sh@21 -- # val= 00:06:43.443 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.443 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.443 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.443 04:18:22 -- accel/accel.sh@21 -- # val= 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val=0x1 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val= 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val= 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val=0 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val='8192 bytes' 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val= 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val=software 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@23 -- # accel_module=software 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val=32 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val=32 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val=1 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val=Yes 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val= 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:43.703 04:18:22 -- accel/accel.sh@21 -- # val= 00:06:43.703 04:18:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # IFS=: 00:06:43.703 04:18:22 -- accel/accel.sh@20 -- # read -r var val 00:06:44.644 04:18:23 -- accel/accel.sh@21 -- # val= 00:06:44.644 04:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.644 04:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:44.644 04:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:44.644 04:18:23 -- accel/accel.sh@21 -- # val= 00:06:44.644 04:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.644 04:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:44.644 04:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:44.644 04:18:23 -- accel/accel.sh@21 -- # val= 00:06:44.644 04:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.644 04:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:44.644 04:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:44.644 04:18:23 -- accel/accel.sh@21 -- # val= 00:06:44.644 04:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.644 04:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:44.644 04:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:44.644 04:18:23 -- accel/accel.sh@21 -- # val= 00:06:44.644 04:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.644 04:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:44.644 04:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:44.644 04:18:23 -- accel/accel.sh@21 -- # val= 00:06:44.644 04:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.644 04:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:44.644 04:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:44.644 04:18:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:44.644 04:18:23 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:44.644 04:18:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:44.644 00:06:44.644 real 0m2.802s 00:06:44.644 user 0m2.508s 00:06:44.644 sys 0m0.287s 00:06:44.644 04:18:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.644 04:18:23 -- common/autotest_common.sh@10 -- # set +x 00:06:44.644 ************************************ 00:06:44.644 END TEST accel_copy_crc32c_C2 00:06:44.644 ************************************ 00:06:44.644 04:18:23 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:06:44.644 04:18:23 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:44.644 04:18:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.644 04:18:23 -- common/autotest_common.sh@10 -- # set +x 00:06:44.644 ************************************ 00:06:44.644 START TEST accel_dualcast 00:06:44.644 ************************************ 00:06:44.644 04:18:23 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:06:44.644 04:18:23 -- accel/accel.sh@16 -- # local accel_opc 00:06:44.644 04:18:23 -- accel/accel.sh@17 -- # local accel_module 00:06:44.644 04:18:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:06:44.644 04:18:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:44.644 04:18:23 -- accel/accel.sh@12 -- # build_accel_config 00:06:44.644 04:18:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:44.644 04:18:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:44.644 04:18:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:44.644 04:18:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:44.644 04:18:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:44.644 04:18:23 -- accel/accel.sh@41 -- # local IFS=, 00:06:44.644 04:18:23 -- accel/accel.sh@42 -- # jq -r . 00:06:44.902 [2024-11-26 04:18:23.880245] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:44.902 [2024-11-26 04:18:23.880324] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2801542 ] 00:06:44.902 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.902 [2024-11-26 04:18:23.938849] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:44.902 [2024-11-26 04:18:24.019650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.284 04:18:25 -- accel/accel.sh@18 -- # out=' 00:06:46.284 SPDK Configuration: 00:06:46.284 Core mask: 0x1 00:06:46.284 00:06:46.284 Accel Perf Configuration: 00:06:46.284 Workload Type: dualcast 00:06:46.284 Transfer size: 4096 bytes 00:06:46.284 Vector count 1 00:06:46.284 Module: software 00:06:46.284 Queue depth: 32 00:06:46.284 Allocate depth: 32 00:06:46.284 # threads/core: 1 00:06:46.284 Run time: 1 seconds 00:06:46.284 Verify: Yes 00:06:46.284 00:06:46.284 Running for 1 seconds... 00:06:46.284 00:06:46.284 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:46.284 ------------------------------------------------------------------------------------ 00:06:46.284 0,0 298688/s 1166 MiB/s 0 0 00:06:46.284 ==================================================================================== 00:06:46.284 Total 298688/s 1166 MiB/s 0 0' 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:46.284 04:18:25 -- accel/accel.sh@12 -- # build_accel_config 00:06:46.284 04:18:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:46.284 04:18:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:46.284 04:18:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:46.284 04:18:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:46.284 04:18:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:46.284 04:18:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:46.284 04:18:25 -- accel/accel.sh@42 -- # jq -r . 00:06:46.284 [2024-11-26 04:18:25.264416] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:46.284 [2024-11-26 04:18:25.264499] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2801809 ] 00:06:46.284 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.284 [2024-11-26 04:18:25.326748] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.284 [2024-11-26 04:18:25.415261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val= 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val= 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val=0x1 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val= 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val= 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val=dualcast 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val= 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val=software 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@23 -- # accel_module=software 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val=32 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val=32 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val=1 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val=Yes 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val= 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:46.284 04:18:25 -- accel/accel.sh@21 -- # val= 00:06:46.284 04:18:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # IFS=: 00:06:46.284 04:18:25 -- accel/accel.sh@20 -- # read -r var val 00:06:47.663 04:18:26 -- accel/accel.sh@21 -- # val= 00:06:47.663 04:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.663 04:18:26 -- accel/accel.sh@20 -- # IFS=: 00:06:47.663 04:18:26 -- accel/accel.sh@20 -- # read -r var val 00:06:47.663 04:18:26 -- accel/accel.sh@21 -- # val= 00:06:47.663 04:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.663 04:18:26 -- accel/accel.sh@20 -- # IFS=: 00:06:47.663 04:18:26 -- accel/accel.sh@20 -- # read -r var val 00:06:47.663 04:18:26 -- accel/accel.sh@21 -- # val= 00:06:47.663 04:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.663 04:18:26 -- accel/accel.sh@20 -- # IFS=: 00:06:47.663 04:18:26 -- accel/accel.sh@20 -- # read -r var val 00:06:47.663 04:18:26 -- accel/accel.sh@21 -- # val= 00:06:47.663 04:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.663 04:18:26 -- accel/accel.sh@20 -- # IFS=: 00:06:47.663 04:18:26 -- accel/accel.sh@20 -- # read -r var val 00:06:47.663 04:18:26 -- accel/accel.sh@21 -- # val= 00:06:47.663 04:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.663 04:18:26 -- accel/accel.sh@20 -- # IFS=: 00:06:47.663 04:18:26 -- accel/accel.sh@20 -- # read -r var val 00:06:47.663 04:18:26 -- accel/accel.sh@21 -- # val= 00:06:47.663 04:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.663 04:18:26 -- accel/accel.sh@20 -- # IFS=: 00:06:47.663 04:18:26 -- accel/accel.sh@20 -- # read -r var val 00:06:47.663 04:18:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:47.663 04:18:26 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:06:47.663 04:18:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:47.663 00:06:47.663 real 0m2.788s 00:06:47.663 user 0m2.492s 00:06:47.663 sys 0m0.288s 00:06:47.663 04:18:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:47.663 04:18:26 -- common/autotest_common.sh@10 -- # set +x 00:06:47.663 ************************************ 00:06:47.663 END TEST accel_dualcast 00:06:47.663 ************************************ 00:06:47.663 04:18:26 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:47.663 04:18:26 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:47.663 04:18:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.663 04:18:26 -- common/autotest_common.sh@10 -- # set +x 00:06:47.663 ************************************ 00:06:47.663 START TEST accel_compare 00:06:47.663 ************************************ 00:06:47.663 04:18:26 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:06:47.663 04:18:26 -- accel/accel.sh@16 -- # local accel_opc 00:06:47.663 04:18:26 -- accel/accel.sh@17 -- # local accel_module 00:06:47.663 04:18:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:06:47.663 04:18:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:47.663 04:18:26 -- accel/accel.sh@12 -- # build_accel_config 00:06:47.663 04:18:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:47.663 04:18:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:47.663 04:18:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:47.663 04:18:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:47.663 04:18:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:47.663 04:18:26 -- accel/accel.sh@41 -- # local IFS=, 00:06:47.663 04:18:26 -- accel/accel.sh@42 -- # jq -r . 00:06:47.663 [2024-11-26 04:18:26.692331] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:47.663 [2024-11-26 04:18:26.692421] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2801965 ] 00:06:47.663 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.663 [2024-11-26 04:18:26.756512] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:47.663 [2024-11-26 04:18:26.846882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.044 04:18:28 -- accel/accel.sh@18 -- # out=' 00:06:49.044 SPDK Configuration: 00:06:49.044 Core mask: 0x1 00:06:49.044 00:06:49.044 Accel Perf Configuration: 00:06:49.044 Workload Type: compare 00:06:49.044 Transfer size: 4096 bytes 00:06:49.044 Vector count 1 00:06:49.044 Module: software 00:06:49.044 Queue depth: 32 00:06:49.044 Allocate depth: 32 00:06:49.044 # threads/core: 1 00:06:49.044 Run time: 1 seconds 00:06:49.044 Verify: Yes 00:06:49.044 00:06:49.044 Running for 1 seconds... 00:06:49.044 00:06:49.044 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:49.044 ------------------------------------------------------------------------------------ 00:06:49.044 0,0 398976/s 1558 MiB/s 0 0 00:06:49.044 ==================================================================================== 00:06:49.044 Total 398976/s 1558 MiB/s 0 0' 00:06:49.044 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.044 04:18:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:49.044 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.044 04:18:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:49.044 04:18:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.044 04:18:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.044 04:18:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.045 04:18:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.045 04:18:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.045 04:18:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.045 04:18:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.045 04:18:28 -- accel/accel.sh@42 -- # jq -r . 00:06:49.045 [2024-11-26 04:18:28.101805] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:49.045 [2024-11-26 04:18:28.101887] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2802109 ] 00:06:49.045 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.045 [2024-11-26 04:18:28.163175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.045 [2024-11-26 04:18:28.252616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val= 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val= 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val=0x1 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val= 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val= 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val=compare 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@24 -- # accel_opc=compare 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val= 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val=software 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@23 -- # accel_module=software 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val=32 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val=32 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val=1 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val=Yes 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val= 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:49.305 04:18:28 -- accel/accel.sh@21 -- # val= 00:06:49.305 04:18:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # IFS=: 00:06:49.305 04:18:28 -- accel/accel.sh@20 -- # read -r var val 00:06:50.681 04:18:29 -- accel/accel.sh@21 -- # val= 00:06:50.681 04:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.681 04:18:29 -- accel/accel.sh@20 -- # IFS=: 00:06:50.681 04:18:29 -- accel/accel.sh@20 -- # read -r var val 00:06:50.681 04:18:29 -- accel/accel.sh@21 -- # val= 00:06:50.681 04:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.681 04:18:29 -- accel/accel.sh@20 -- # IFS=: 00:06:50.681 04:18:29 -- accel/accel.sh@20 -- # read -r var val 00:06:50.681 04:18:29 -- accel/accel.sh@21 -- # val= 00:06:50.681 04:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.681 04:18:29 -- accel/accel.sh@20 -- # IFS=: 00:06:50.681 04:18:29 -- accel/accel.sh@20 -- # read -r var val 00:06:50.681 04:18:29 -- accel/accel.sh@21 -- # val= 00:06:50.681 04:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.681 04:18:29 -- accel/accel.sh@20 -- # IFS=: 00:06:50.681 04:18:29 -- accel/accel.sh@20 -- # read -r var val 00:06:50.681 04:18:29 -- accel/accel.sh@21 -- # val= 00:06:50.681 04:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.681 04:18:29 -- accel/accel.sh@20 -- # IFS=: 00:06:50.681 04:18:29 -- accel/accel.sh@20 -- # read -r var val 00:06:50.681 04:18:29 -- accel/accel.sh@21 -- # val= 00:06:50.681 04:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.681 04:18:29 -- accel/accel.sh@20 -- # IFS=: 00:06:50.681 04:18:29 -- accel/accel.sh@20 -- # read -r var val 00:06:50.681 04:18:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:50.681 04:18:29 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:06:50.681 04:18:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:50.681 00:06:50.681 real 0m2.811s 00:06:50.681 user 0m2.509s 00:06:50.681 sys 0m0.294s 00:06:50.681 04:18:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.681 04:18:29 -- common/autotest_common.sh@10 -- # set +x 00:06:50.681 ************************************ 00:06:50.681 END TEST accel_compare 00:06:50.681 ************************************ 00:06:50.681 04:18:29 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:50.681 04:18:29 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:50.681 04:18:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.681 04:18:29 -- common/autotest_common.sh@10 -- # set +x 00:06:50.681 ************************************ 00:06:50.681 START TEST accel_xor 00:06:50.681 ************************************ 00:06:50.681 04:18:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:06:50.681 04:18:29 -- accel/accel.sh@16 -- # local accel_opc 00:06:50.681 04:18:29 -- accel/accel.sh@17 -- # local accel_module 00:06:50.681 04:18:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:06:50.681 04:18:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:50.681 04:18:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.681 04:18:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.681 04:18:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.681 04:18:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.681 04:18:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.681 04:18:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.681 04:18:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.681 04:18:29 -- accel/accel.sh@42 -- # jq -r . 00:06:50.681 [2024-11-26 04:18:29.529530] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:50.681 [2024-11-26 04:18:29.529606] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2802275 ] 00:06:50.681 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.681 [2024-11-26 04:18:29.593584] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.681 [2024-11-26 04:18:29.684989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.065 04:18:30 -- accel/accel.sh@18 -- # out=' 00:06:52.065 SPDK Configuration: 00:06:52.065 Core mask: 0x1 00:06:52.065 00:06:52.065 Accel Perf Configuration: 00:06:52.065 Workload Type: xor 00:06:52.065 Source buffers: 2 00:06:52.065 Transfer size: 4096 bytes 00:06:52.065 Vector count 1 00:06:52.065 Module: software 00:06:52.065 Queue depth: 32 00:06:52.065 Allocate depth: 32 00:06:52.065 # threads/core: 1 00:06:52.065 Run time: 1 seconds 00:06:52.065 Verify: Yes 00:06:52.065 00:06:52.065 Running for 1 seconds... 00:06:52.065 00:06:52.065 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:52.065 ------------------------------------------------------------------------------------ 00:06:52.065 0,0 193216/s 754 MiB/s 0 0 00:06:52.065 ==================================================================================== 00:06:52.065 Total 193216/s 754 MiB/s 0 0' 00:06:52.065 04:18:30 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:52.065 04:18:30 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:52.065 04:18:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:52.065 04:18:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:52.065 04:18:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:52.065 04:18:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:52.065 04:18:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:52.065 04:18:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:52.065 04:18:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:52.065 04:18:30 -- accel/accel.sh@42 -- # jq -r . 00:06:52.065 [2024-11-26 04:18:30.934947] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:52.065 [2024-11-26 04:18:30.935041] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2802526 ] 00:06:52.065 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.065 [2024-11-26 04:18:30.996453] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:52.065 [2024-11-26 04:18:31.083733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val= 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val= 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val=0x1 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val= 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val= 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val=xor 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val=2 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val= 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val=software 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@23 -- # accel_module=software 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val=32 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val=32 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val=1 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val=Yes 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val= 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:52.065 04:18:31 -- accel/accel.sh@21 -- # val= 00:06:52.065 04:18:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # IFS=: 00:06:52.065 04:18:31 -- accel/accel.sh@20 -- # read -r var val 00:06:53.444 04:18:32 -- accel/accel.sh@21 -- # val= 00:06:53.444 04:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.444 04:18:32 -- accel/accel.sh@20 -- # IFS=: 00:06:53.444 04:18:32 -- accel/accel.sh@20 -- # read -r var val 00:06:53.444 04:18:32 -- accel/accel.sh@21 -- # val= 00:06:53.444 04:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.444 04:18:32 -- accel/accel.sh@20 -- # IFS=: 00:06:53.444 04:18:32 -- accel/accel.sh@20 -- # read -r var val 00:06:53.444 04:18:32 -- accel/accel.sh@21 -- # val= 00:06:53.444 04:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.444 04:18:32 -- accel/accel.sh@20 -- # IFS=: 00:06:53.444 04:18:32 -- accel/accel.sh@20 -- # read -r var val 00:06:53.444 04:18:32 -- accel/accel.sh@21 -- # val= 00:06:53.444 04:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.444 04:18:32 -- accel/accel.sh@20 -- # IFS=: 00:06:53.444 04:18:32 -- accel/accel.sh@20 -- # read -r var val 00:06:53.444 04:18:32 -- accel/accel.sh@21 -- # val= 00:06:53.444 04:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.444 04:18:32 -- accel/accel.sh@20 -- # IFS=: 00:06:53.444 04:18:32 -- accel/accel.sh@20 -- # read -r var val 00:06:53.444 04:18:32 -- accel/accel.sh@21 -- # val= 00:06:53.444 04:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.444 04:18:32 -- accel/accel.sh@20 -- # IFS=: 00:06:53.444 04:18:32 -- accel/accel.sh@20 -- # read -r var val 00:06:53.444 04:18:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:53.444 04:18:32 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:53.444 04:18:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:53.444 00:06:53.444 real 0m2.798s 00:06:53.444 user 0m2.504s 00:06:53.444 sys 0m0.286s 00:06:53.444 04:18:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:53.444 04:18:32 -- common/autotest_common.sh@10 -- # set +x 00:06:53.444 ************************************ 00:06:53.444 END TEST accel_xor 00:06:53.444 ************************************ 00:06:53.444 04:18:32 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:53.444 04:18:32 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:53.444 04:18:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.444 04:18:32 -- common/autotest_common.sh@10 -- # set +x 00:06:53.444 ************************************ 00:06:53.444 START TEST accel_xor 00:06:53.444 ************************************ 00:06:53.444 04:18:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:06:53.444 04:18:32 -- accel/accel.sh@16 -- # local accel_opc 00:06:53.444 04:18:32 -- accel/accel.sh@17 -- # local accel_module 00:06:53.444 04:18:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:53.444 04:18:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:53.444 04:18:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.444 04:18:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.444 04:18:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.444 04:18:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.444 04:18:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.444 04:18:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.444 04:18:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.444 04:18:32 -- accel/accel.sh@42 -- # jq -r . 00:06:53.444 [2024-11-26 04:18:32.355028] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:53.444 [2024-11-26 04:18:32.355118] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2802692 ] 00:06:53.444 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.444 [2024-11-26 04:18:32.416844] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.444 [2024-11-26 04:18:32.507032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.826 04:18:33 -- accel/accel.sh@18 -- # out=' 00:06:54.826 SPDK Configuration: 00:06:54.826 Core mask: 0x1 00:06:54.826 00:06:54.826 Accel Perf Configuration: 00:06:54.826 Workload Type: xor 00:06:54.826 Source buffers: 3 00:06:54.826 Transfer size: 4096 bytes 00:06:54.826 Vector count 1 00:06:54.826 Module: software 00:06:54.826 Queue depth: 32 00:06:54.826 Allocate depth: 32 00:06:54.826 # threads/core: 1 00:06:54.826 Run time: 1 seconds 00:06:54.826 Verify: Yes 00:06:54.826 00:06:54.826 Running for 1 seconds... 00:06:54.826 00:06:54.826 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:54.826 ------------------------------------------------------------------------------------ 00:06:54.826 0,0 184832/s 722 MiB/s 0 0 00:06:54.826 ==================================================================================== 00:06:54.826 Total 184832/s 722 MiB/s 0 0' 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.826 04:18:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.826 04:18:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:54.826 04:18:33 -- accel/accel.sh@12 -- # build_accel_config 00:06:54.826 04:18:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:54.826 04:18:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:54.826 04:18:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:54.826 04:18:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:54.826 04:18:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:54.826 04:18:33 -- accel/accel.sh@41 -- # local IFS=, 00:06:54.826 04:18:33 -- accel/accel.sh@42 -- # jq -r . 00:06:54.826 [2024-11-26 04:18:33.762338] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:54.826 [2024-11-26 04:18:33.762426] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2802830 ] 00:06:54.826 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.826 [2024-11-26 04:18:33.822658] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:54.826 [2024-11-26 04:18:33.912126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.826 04:18:33 -- accel/accel.sh@21 -- # val= 00:06:54.826 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.826 04:18:33 -- accel/accel.sh@21 -- # val= 00:06:54.826 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.826 04:18:33 -- accel/accel.sh@21 -- # val=0x1 00:06:54.826 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.826 04:18:33 -- accel/accel.sh@21 -- # val= 00:06:54.826 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.826 04:18:33 -- accel/accel.sh@21 -- # val= 00:06:54.826 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.826 04:18:33 -- accel/accel.sh@21 -- # val=xor 00:06:54.826 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.826 04:18:33 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.826 04:18:33 -- accel/accel.sh@21 -- # val=3 00:06:54.826 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.826 04:18:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:54.826 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.826 04:18:33 -- accel/accel.sh@21 -- # val= 00:06:54.826 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.826 04:18:33 -- accel/accel.sh@21 -- # val=software 00:06:54.826 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.826 04:18:33 -- accel/accel.sh@23 -- # accel_module=software 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.826 04:18:33 -- accel/accel.sh@21 -- # val=32 00:06:54.826 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.826 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.827 04:18:33 -- accel/accel.sh@21 -- # val=32 00:06:54.827 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.827 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.827 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.827 04:18:33 -- accel/accel.sh@21 -- # val=1 00:06:54.827 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.827 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.827 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.827 04:18:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:54.827 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.827 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.827 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.827 04:18:33 -- accel/accel.sh@21 -- # val=Yes 00:06:54.827 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.827 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.827 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.827 04:18:33 -- accel/accel.sh@21 -- # val= 00:06:54.827 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.827 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.827 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:54.827 04:18:33 -- accel/accel.sh@21 -- # val= 00:06:54.827 04:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.827 04:18:33 -- accel/accel.sh@20 -- # IFS=: 00:06:54.827 04:18:33 -- accel/accel.sh@20 -- # read -r var val 00:06:56.208 04:18:35 -- accel/accel.sh@21 -- # val= 00:06:56.208 04:18:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.209 04:18:35 -- accel/accel.sh@20 -- # IFS=: 00:06:56.209 04:18:35 -- accel/accel.sh@20 -- # read -r var val 00:06:56.209 04:18:35 -- accel/accel.sh@21 -- # val= 00:06:56.209 04:18:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.209 04:18:35 -- accel/accel.sh@20 -- # IFS=: 00:06:56.209 04:18:35 -- accel/accel.sh@20 -- # read -r var val 00:06:56.209 04:18:35 -- accel/accel.sh@21 -- # val= 00:06:56.209 04:18:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.209 04:18:35 -- accel/accel.sh@20 -- # IFS=: 00:06:56.209 04:18:35 -- accel/accel.sh@20 -- # read -r var val 00:06:56.209 04:18:35 -- accel/accel.sh@21 -- # val= 00:06:56.209 04:18:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.209 04:18:35 -- accel/accel.sh@20 -- # IFS=: 00:06:56.209 04:18:35 -- accel/accel.sh@20 -- # read -r var val 00:06:56.209 04:18:35 -- accel/accel.sh@21 -- # val= 00:06:56.209 04:18:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.209 04:18:35 -- accel/accel.sh@20 -- # IFS=: 00:06:56.209 04:18:35 -- accel/accel.sh@20 -- # read -r var val 00:06:56.209 04:18:35 -- accel/accel.sh@21 -- # val= 00:06:56.209 04:18:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.209 04:18:35 -- accel/accel.sh@20 -- # IFS=: 00:06:56.209 04:18:35 -- accel/accel.sh@20 -- # read -r var val 00:06:56.209 04:18:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:56.209 04:18:35 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:56.209 04:18:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:56.209 00:06:56.209 real 0m2.814s 00:06:56.209 user 0m2.519s 00:06:56.209 sys 0m0.288s 00:06:56.209 04:18:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.209 04:18:35 -- common/autotest_common.sh@10 -- # set +x 00:06:56.209 ************************************ 00:06:56.209 END TEST accel_xor 00:06:56.209 ************************************ 00:06:56.209 04:18:35 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:56.209 04:18:35 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:56.209 04:18:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.209 04:18:35 -- common/autotest_common.sh@10 -- # set +x 00:06:56.209 ************************************ 00:06:56.209 START TEST accel_dif_verify 00:06:56.209 ************************************ 00:06:56.209 04:18:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:06:56.209 04:18:35 -- accel/accel.sh@16 -- # local accel_opc 00:06:56.209 04:18:35 -- accel/accel.sh@17 -- # local accel_module 00:06:56.209 04:18:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:56.209 04:18:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:56.209 04:18:35 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.209 04:18:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.209 04:18:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.209 04:18:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.209 04:18:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.209 04:18:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.209 04:18:35 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.209 04:18:35 -- accel/accel.sh@42 -- # jq -r . 00:06:56.209 [2024-11-26 04:18:35.192024] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:56.209 [2024-11-26 04:18:35.192123] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2803033 ] 00:06:56.209 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.209 [2024-11-26 04:18:35.257982] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.209 [2024-11-26 04:18:35.347224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.590 04:18:36 -- accel/accel.sh@18 -- # out=' 00:06:57.590 SPDK Configuration: 00:06:57.590 Core mask: 0x1 00:06:57.591 00:06:57.591 Accel Perf Configuration: 00:06:57.591 Workload Type: dif_verify 00:06:57.591 Vector size: 4096 bytes 00:06:57.591 Transfer size: 4096 bytes 00:06:57.591 Block size: 512 bytes 00:06:57.591 Metadata size: 8 bytes 00:06:57.591 Vector count 1 00:06:57.591 Module: software 00:06:57.591 Queue depth: 32 00:06:57.591 Allocate depth: 32 00:06:57.591 # threads/core: 1 00:06:57.591 Run time: 1 seconds 00:06:57.591 Verify: No 00:06:57.591 00:06:57.591 Running for 1 seconds... 00:06:57.591 00:06:57.591 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:57.591 ------------------------------------------------------------------------------------ 00:06:57.591 0,0 82016/s 325 MiB/s 0 0 00:06:57.591 ==================================================================================== 00:06:57.591 Total 82016/s 320 MiB/s 0 0' 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:57.591 04:18:36 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.591 04:18:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:57.591 04:18:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.591 04:18:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.591 04:18:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:57.591 04:18:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:57.591 04:18:36 -- accel/accel.sh@41 -- # local IFS=, 00:06:57.591 04:18:36 -- accel/accel.sh@42 -- # jq -r . 00:06:57.591 [2024-11-26 04:18:36.595875] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:57.591 [2024-11-26 04:18:36.595964] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2803253 ] 00:06:57.591 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.591 [2024-11-26 04:18:36.657412] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.591 [2024-11-26 04:18:36.745012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val= 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val= 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val=0x1 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val= 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val= 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val=dif_verify 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val= 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val=software 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@23 -- # accel_module=software 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val=32 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val=32 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val=1 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val=No 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val= 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:57.591 04:18:36 -- accel/accel.sh@21 -- # val= 00:06:57.591 04:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # IFS=: 00:06:57.591 04:18:36 -- accel/accel.sh@20 -- # read -r var val 00:06:58.971 04:18:37 -- accel/accel.sh@21 -- # val= 00:06:58.971 04:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.971 04:18:37 -- accel/accel.sh@20 -- # IFS=: 00:06:58.971 04:18:37 -- accel/accel.sh@20 -- # read -r var val 00:06:58.971 04:18:37 -- accel/accel.sh@21 -- # val= 00:06:58.971 04:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.971 04:18:37 -- accel/accel.sh@20 -- # IFS=: 00:06:58.971 04:18:37 -- accel/accel.sh@20 -- # read -r var val 00:06:58.971 04:18:37 -- accel/accel.sh@21 -- # val= 00:06:58.971 04:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.971 04:18:37 -- accel/accel.sh@20 -- # IFS=: 00:06:58.971 04:18:37 -- accel/accel.sh@20 -- # read -r var val 00:06:58.971 04:18:37 -- accel/accel.sh@21 -- # val= 00:06:58.971 04:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.971 04:18:37 -- accel/accel.sh@20 -- # IFS=: 00:06:58.971 04:18:37 -- accel/accel.sh@20 -- # read -r var val 00:06:58.971 04:18:37 -- accel/accel.sh@21 -- # val= 00:06:58.971 04:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.971 04:18:37 -- accel/accel.sh@20 -- # IFS=: 00:06:58.971 04:18:37 -- accel/accel.sh@20 -- # read -r var val 00:06:58.972 04:18:37 -- accel/accel.sh@21 -- # val= 00:06:58.972 04:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.972 04:18:37 -- accel/accel.sh@20 -- # IFS=: 00:06:58.972 04:18:37 -- accel/accel.sh@20 -- # read -r var val 00:06:58.972 04:18:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:58.972 04:18:37 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:58.972 04:18:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:58.972 00:06:58.972 real 0m2.789s 00:06:58.972 user 0m2.497s 00:06:58.972 sys 0m0.287s 00:06:58.972 04:18:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:58.972 04:18:37 -- common/autotest_common.sh@10 -- # set +x 00:06:58.972 ************************************ 00:06:58.972 END TEST accel_dif_verify 00:06:58.972 ************************************ 00:06:58.972 04:18:37 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:58.972 04:18:37 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:58.972 04:18:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.972 04:18:37 -- common/autotest_common.sh@10 -- # set +x 00:06:58.972 ************************************ 00:06:58.972 START TEST accel_dif_generate 00:06:58.972 ************************************ 00:06:58.972 04:18:37 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:58.972 04:18:37 -- accel/accel.sh@16 -- # local accel_opc 00:06:58.972 04:18:37 -- accel/accel.sh@17 -- # local accel_module 00:06:58.972 04:18:37 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:58.972 04:18:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:58.972 04:18:37 -- accel/accel.sh@12 -- # build_accel_config 00:06:58.972 04:18:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:58.972 04:18:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:58.972 04:18:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:58.972 04:18:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:58.972 04:18:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:58.972 04:18:37 -- accel/accel.sh@41 -- # local IFS=, 00:06:58.972 04:18:37 -- accel/accel.sh@42 -- # jq -r . 00:06:58.972 [2024-11-26 04:18:38.007230] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:58.972 [2024-11-26 04:18:38.007318] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2803411 ] 00:06:58.972 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.972 [2024-11-26 04:18:38.068137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.972 [2024-11-26 04:18:38.158853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.350 04:18:39 -- accel/accel.sh@18 -- # out=' 00:07:00.350 SPDK Configuration: 00:07:00.350 Core mask: 0x1 00:07:00.350 00:07:00.350 Accel Perf Configuration: 00:07:00.350 Workload Type: dif_generate 00:07:00.350 Vector size: 4096 bytes 00:07:00.350 Transfer size: 4096 bytes 00:07:00.350 Block size: 512 bytes 00:07:00.350 Metadata size: 8 bytes 00:07:00.350 Vector count 1 00:07:00.350 Module: software 00:07:00.350 Queue depth: 32 00:07:00.350 Allocate depth: 32 00:07:00.350 # threads/core: 1 00:07:00.350 Run time: 1 seconds 00:07:00.350 Verify: No 00:07:00.350 00:07:00.350 Running for 1 seconds... 00:07:00.350 00:07:00.350 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:00.350 ------------------------------------------------------------------------------------ 00:07:00.350 0,0 96320/s 382 MiB/s 0 0 00:07:00.350 ==================================================================================== 00:07:00.350 Total 96320/s 376 MiB/s 0 0' 00:07:00.350 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.350 04:18:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:00.350 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.350 04:18:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:00.350 04:18:39 -- accel/accel.sh@12 -- # build_accel_config 00:07:00.350 04:18:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:00.350 04:18:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:00.350 04:18:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:00.350 04:18:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:00.350 04:18:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:00.350 04:18:39 -- accel/accel.sh@41 -- # local IFS=, 00:07:00.350 04:18:39 -- accel/accel.sh@42 -- # jq -r . 00:07:00.350 [2024-11-26 04:18:39.404320] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:00.350 [2024-11-26 04:18:39.404410] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2803557 ] 00:07:00.350 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.350 [2024-11-26 04:18:39.465904] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.350 [2024-11-26 04:18:39.555462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val= 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val= 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val=0x1 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val= 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val= 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val=dif_generate 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val= 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val=software 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@23 -- # accel_module=software 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val=32 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val=32 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val=1 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val=No 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val= 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:00.609 04:18:39 -- accel/accel.sh@21 -- # val= 00:07:00.609 04:18:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # IFS=: 00:07:00.609 04:18:39 -- accel/accel.sh@20 -- # read -r var val 00:07:01.990 04:18:40 -- accel/accel.sh@21 -- # val= 00:07:01.990 04:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.990 04:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:01.990 04:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:01.990 04:18:40 -- accel/accel.sh@21 -- # val= 00:07:01.990 04:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.990 04:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:01.990 04:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:01.990 04:18:40 -- accel/accel.sh@21 -- # val= 00:07:01.990 04:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.990 04:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:01.990 04:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:01.990 04:18:40 -- accel/accel.sh@21 -- # val= 00:07:01.990 04:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.990 04:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:01.990 04:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:01.990 04:18:40 -- accel/accel.sh@21 -- # val= 00:07:01.990 04:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.990 04:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:01.990 04:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:01.990 04:18:40 -- accel/accel.sh@21 -- # val= 00:07:01.990 04:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.990 04:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:01.990 04:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:01.990 04:18:40 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:01.990 04:18:40 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:01.990 04:18:40 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:01.990 00:07:01.990 real 0m2.797s 00:07:01.990 user 0m2.510s 00:07:01.990 sys 0m0.282s 00:07:01.990 04:18:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:01.990 04:18:40 -- common/autotest_common.sh@10 -- # set +x 00:07:01.990 ************************************ 00:07:01.990 END TEST accel_dif_generate 00:07:01.990 ************************************ 00:07:01.990 04:18:40 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:01.990 04:18:40 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:01.990 04:18:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.990 04:18:40 -- common/autotest_common.sh@10 -- # set +x 00:07:01.990 ************************************ 00:07:01.990 START TEST accel_dif_generate_copy 00:07:01.990 ************************************ 00:07:01.990 04:18:40 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:01.990 04:18:40 -- accel/accel.sh@16 -- # local accel_opc 00:07:01.990 04:18:40 -- accel/accel.sh@17 -- # local accel_module 00:07:01.990 04:18:40 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:01.990 04:18:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:01.990 04:18:40 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.990 04:18:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:01.990 04:18:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.990 04:18:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.990 04:18:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:01.990 04:18:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:01.990 04:18:40 -- accel/accel.sh@41 -- # local IFS=, 00:07:01.990 04:18:40 -- accel/accel.sh@42 -- # jq -r . 00:07:01.990 [2024-11-26 04:18:40.831608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:01.990 [2024-11-26 04:18:40.831693] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2803721 ] 00:07:01.990 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.990 [2024-11-26 04:18:40.893103] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.990 [2024-11-26 04:18:40.982787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.372 04:18:42 -- accel/accel.sh@18 -- # out=' 00:07:03.372 SPDK Configuration: 00:07:03.372 Core mask: 0x1 00:07:03.372 00:07:03.372 Accel Perf Configuration: 00:07:03.372 Workload Type: dif_generate_copy 00:07:03.372 Vector size: 4096 bytes 00:07:03.372 Transfer size: 4096 bytes 00:07:03.372 Vector count 1 00:07:03.372 Module: software 00:07:03.372 Queue depth: 32 00:07:03.372 Allocate depth: 32 00:07:03.372 # threads/core: 1 00:07:03.372 Run time: 1 seconds 00:07:03.372 Verify: No 00:07:03.372 00:07:03.372 Running for 1 seconds... 00:07:03.372 00:07:03.372 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:03.372 ------------------------------------------------------------------------------------ 00:07:03.372 0,0 76128/s 302 MiB/s 0 0 00:07:03.372 ==================================================================================== 00:07:03.372 Total 76128/s 297 MiB/s 0 0' 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.372 04:18:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.372 04:18:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:03.372 04:18:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.372 04:18:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.372 04:18:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.372 04:18:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.372 04:18:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.372 04:18:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.372 04:18:42 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.372 04:18:42 -- accel/accel.sh@42 -- # jq -r . 00:07:03.372 [2024-11-26 04:18:42.219154] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:03.372 [2024-11-26 04:18:42.219243] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2803974 ] 00:07:03.372 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.372 [2024-11-26 04:18:42.281328] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.372 [2024-11-26 04:18:42.371786] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.372 04:18:42 -- accel/accel.sh@21 -- # val= 00:07:03.372 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.372 04:18:42 -- accel/accel.sh@21 -- # val= 00:07:03.372 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.372 04:18:42 -- accel/accel.sh@21 -- # val=0x1 00:07:03.372 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.372 04:18:42 -- accel/accel.sh@21 -- # val= 00:07:03.372 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.372 04:18:42 -- accel/accel.sh@21 -- # val= 00:07:03.372 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.372 04:18:42 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:03.372 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.372 04:18:42 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.372 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.373 04:18:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.373 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.373 04:18:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.373 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.373 04:18:42 -- accel/accel.sh@21 -- # val= 00:07:03.373 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.373 04:18:42 -- accel/accel.sh@21 -- # val=software 00:07:03.373 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.373 04:18:42 -- accel/accel.sh@23 -- # accel_module=software 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.373 04:18:42 -- accel/accel.sh@21 -- # val=32 00:07:03.373 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.373 04:18:42 -- accel/accel.sh@21 -- # val=32 00:07:03.373 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.373 04:18:42 -- accel/accel.sh@21 -- # val=1 00:07:03.373 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.373 04:18:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:03.373 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.373 04:18:42 -- accel/accel.sh@21 -- # val=No 00:07:03.373 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.373 04:18:42 -- accel/accel.sh@21 -- # val= 00:07:03.373 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:03.373 04:18:42 -- accel/accel.sh@21 -- # val= 00:07:03.373 04:18:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # IFS=: 00:07:03.373 04:18:42 -- accel/accel.sh@20 -- # read -r var val 00:07:04.751 04:18:43 -- accel/accel.sh@21 -- # val= 00:07:04.751 04:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.751 04:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:04.751 04:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:04.751 04:18:43 -- accel/accel.sh@21 -- # val= 00:07:04.751 04:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.751 04:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:04.751 04:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:04.751 04:18:43 -- accel/accel.sh@21 -- # val= 00:07:04.751 04:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.751 04:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:04.751 04:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:04.751 04:18:43 -- accel/accel.sh@21 -- # val= 00:07:04.751 04:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.751 04:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:04.751 04:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:04.751 04:18:43 -- accel/accel.sh@21 -- # val= 00:07:04.751 04:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.751 04:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:04.751 04:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:04.751 04:18:43 -- accel/accel.sh@21 -- # val= 00:07:04.751 04:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.751 04:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:04.751 04:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:04.751 04:18:43 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:04.751 04:18:43 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:04.751 04:18:43 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:04.751 00:07:04.751 real 0m2.778s 00:07:04.751 user 0m2.492s 00:07:04.751 sys 0m0.278s 00:07:04.751 04:18:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.751 04:18:43 -- common/autotest_common.sh@10 -- # set +x 00:07:04.751 ************************************ 00:07:04.751 END TEST accel_dif_generate_copy 00:07:04.751 ************************************ 00:07:04.751 04:18:43 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:04.751 04:18:43 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:04.751 04:18:43 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:04.751 04:18:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.751 04:18:43 -- common/autotest_common.sh@10 -- # set +x 00:07:04.752 ************************************ 00:07:04.752 START TEST accel_comp 00:07:04.752 ************************************ 00:07:04.752 04:18:43 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:04.752 04:18:43 -- accel/accel.sh@16 -- # local accel_opc 00:07:04.752 04:18:43 -- accel/accel.sh@17 -- # local accel_module 00:07:04.752 04:18:43 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:04.752 04:18:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:04.752 04:18:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.752 04:18:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:04.752 04:18:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.752 04:18:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.752 04:18:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:04.752 04:18:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:04.752 04:18:43 -- accel/accel.sh@41 -- # local IFS=, 00:07:04.752 04:18:43 -- accel/accel.sh@42 -- # jq -r . 00:07:04.752 [2024-11-26 04:18:43.633308] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:04.752 [2024-11-26 04:18:43.633378] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2804138 ] 00:07:04.752 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.752 [2024-11-26 04:18:43.694034] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.752 [2024-11-26 04:18:43.784437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.129 04:18:45 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:06.129 00:07:06.129 SPDK Configuration: 00:07:06.129 Core mask: 0x1 00:07:06.129 00:07:06.129 Accel Perf Configuration: 00:07:06.129 Workload Type: compress 00:07:06.129 Transfer size: 4096 bytes 00:07:06.129 Vector count 1 00:07:06.129 Module: software 00:07:06.129 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:06.129 Queue depth: 32 00:07:06.129 Allocate depth: 32 00:07:06.129 # threads/core: 1 00:07:06.129 Run time: 1 seconds 00:07:06.129 Verify: No 00:07:06.129 00:07:06.129 Running for 1 seconds... 00:07:06.129 00:07:06.129 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:06.129 ------------------------------------------------------------------------------------ 00:07:06.129 0,0 31584/s 131 MiB/s 0 0 00:07:06.129 ==================================================================================== 00:07:06.129 Total 31584/s 123 MiB/s 0 0' 00:07:06.129 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.129 04:18:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:06.129 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.129 04:18:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:06.129 04:18:45 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.129 04:18:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.129 04:18:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.129 04:18:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.129 04:18:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.129 04:18:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.129 04:18:45 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.129 04:18:45 -- accel/accel.sh@42 -- # jq -r . 00:07:06.129 [2024-11-26 04:18:45.041208] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:06.129 [2024-11-26 04:18:45.041298] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2804279 ] 00:07:06.129 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.129 [2024-11-26 04:18:45.102592] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.129 [2024-11-26 04:18:45.193090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.129 04:18:45 -- accel/accel.sh@21 -- # val= 00:07:06.129 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.129 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.129 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.129 04:18:45 -- accel/accel.sh@21 -- # val= 00:07:06.129 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.129 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.129 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.129 04:18:45 -- accel/accel.sh@21 -- # val= 00:07:06.129 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.129 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.129 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.129 04:18:45 -- accel/accel.sh@21 -- # val=0x1 00:07:06.129 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.129 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.129 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.129 04:18:45 -- accel/accel.sh@21 -- # val= 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val= 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val=compress 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val= 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val=software 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@23 -- # accel_module=software 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val=32 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val=32 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val=1 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val=No 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val= 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:06.130 04:18:45 -- accel/accel.sh@21 -- # val= 00:07:06.130 04:18:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:06.130 04:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:07.507 04:18:46 -- accel/accel.sh@21 -- # val= 00:07:07.507 04:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.508 04:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:07.508 04:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:07.508 04:18:46 -- accel/accel.sh@21 -- # val= 00:07:07.508 04:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.508 04:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:07.508 04:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:07.508 04:18:46 -- accel/accel.sh@21 -- # val= 00:07:07.508 04:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.508 04:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:07.508 04:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:07.508 04:18:46 -- accel/accel.sh@21 -- # val= 00:07:07.508 04:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.508 04:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:07.508 04:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:07.508 04:18:46 -- accel/accel.sh@21 -- # val= 00:07:07.508 04:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.508 04:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:07.508 04:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:07.508 04:18:46 -- accel/accel.sh@21 -- # val= 00:07:07.508 04:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.508 04:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:07.508 04:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:07.508 04:18:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:07.508 04:18:46 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:07.508 04:18:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:07.508 00:07:07.508 real 0m2.815s 00:07:07.508 user 0m2.525s 00:07:07.508 sys 0m0.284s 00:07:07.508 04:18:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.508 04:18:46 -- common/autotest_common.sh@10 -- # set +x 00:07:07.508 ************************************ 00:07:07.508 END TEST accel_comp 00:07:07.508 ************************************ 00:07:07.508 04:18:46 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:07.508 04:18:46 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:07.508 04:18:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.508 04:18:46 -- common/autotest_common.sh@10 -- # set +x 00:07:07.508 ************************************ 00:07:07.508 START TEST accel_decomp 00:07:07.508 ************************************ 00:07:07.508 04:18:46 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:07.508 04:18:46 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.508 04:18:46 -- accel/accel.sh@17 -- # local accel_module 00:07:07.508 04:18:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:07.508 04:18:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:07.508 04:18:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.508 04:18:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.508 04:18:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.508 04:18:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.508 04:18:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.508 04:18:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.508 04:18:46 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.508 04:18:46 -- accel/accel.sh@42 -- # jq -r . 00:07:07.508 [2024-11-26 04:18:46.477637] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:07.508 [2024-11-26 04:18:46.477732] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2804438 ] 00:07:07.508 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.508 [2024-11-26 04:18:46.538184] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.508 [2024-11-26 04:18:46.631018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.929 04:18:47 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:08.929 00:07:08.929 SPDK Configuration: 00:07:08.929 Core mask: 0x1 00:07:08.929 00:07:08.929 Accel Perf Configuration: 00:07:08.929 Workload Type: decompress 00:07:08.929 Transfer size: 4096 bytes 00:07:08.929 Vector count 1 00:07:08.929 Module: software 00:07:08.929 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:08.929 Queue depth: 32 00:07:08.929 Allocate depth: 32 00:07:08.930 # threads/core: 1 00:07:08.930 Run time: 1 seconds 00:07:08.930 Verify: Yes 00:07:08.930 00:07:08.930 Running for 1 seconds... 00:07:08.930 00:07:08.930 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:08.930 ------------------------------------------------------------------------------------ 00:07:08.930 0,0 55328/s 101 MiB/s 0 0 00:07:08.930 ==================================================================================== 00:07:08.930 Total 55328/s 216 MiB/s 0 0' 00:07:08.930 04:18:47 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:08.930 04:18:47 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:08.930 04:18:47 -- accel/accel.sh@12 -- # build_accel_config 00:07:08.930 04:18:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:08.930 04:18:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:08.930 04:18:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:08.930 04:18:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:08.930 04:18:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:08.930 04:18:47 -- accel/accel.sh@41 -- # local IFS=, 00:07:08.930 04:18:47 -- accel/accel.sh@42 -- # jq -r . 00:07:08.930 [2024-11-26 04:18:47.879108] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:08.930 [2024-11-26 04:18:47.879192] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2804697 ] 00:07:08.930 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.930 [2024-11-26 04:18:47.940652] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:08.930 [2024-11-26 04:18:48.029615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val= 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val= 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val= 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val=0x1 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val= 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val= 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val=decompress 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val= 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val=software 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@23 -- # accel_module=software 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val=32 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val=32 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val=1 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val=Yes 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val= 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:08.930 04:18:48 -- accel/accel.sh@21 -- # val= 00:07:08.930 04:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:08.930 04:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:10.336 04:18:49 -- accel/accel.sh@21 -- # val= 00:07:10.336 04:18:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.336 04:18:49 -- accel/accel.sh@20 -- # IFS=: 00:07:10.336 04:18:49 -- accel/accel.sh@20 -- # read -r var val 00:07:10.336 04:18:49 -- accel/accel.sh@21 -- # val= 00:07:10.336 04:18:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.336 04:18:49 -- accel/accel.sh@20 -- # IFS=: 00:07:10.336 04:18:49 -- accel/accel.sh@20 -- # read -r var val 00:07:10.336 04:18:49 -- accel/accel.sh@21 -- # val= 00:07:10.336 04:18:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.336 04:18:49 -- accel/accel.sh@20 -- # IFS=: 00:07:10.336 04:18:49 -- accel/accel.sh@20 -- # read -r var val 00:07:10.336 04:18:49 -- accel/accel.sh@21 -- # val= 00:07:10.336 04:18:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.337 04:18:49 -- accel/accel.sh@20 -- # IFS=: 00:07:10.337 04:18:49 -- accel/accel.sh@20 -- # read -r var val 00:07:10.337 04:18:49 -- accel/accel.sh@21 -- # val= 00:07:10.337 04:18:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.337 04:18:49 -- accel/accel.sh@20 -- # IFS=: 00:07:10.337 04:18:49 -- accel/accel.sh@20 -- # read -r var val 00:07:10.337 04:18:49 -- accel/accel.sh@21 -- # val= 00:07:10.337 04:18:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.337 04:18:49 -- accel/accel.sh@20 -- # IFS=: 00:07:10.337 04:18:49 -- accel/accel.sh@20 -- # read -r var val 00:07:10.337 04:18:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:10.337 04:18:49 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:10.337 04:18:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:10.337 00:07:10.337 real 0m2.802s 00:07:10.337 user 0m2.505s 00:07:10.337 sys 0m0.290s 00:07:10.337 04:18:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:10.337 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:07:10.337 ************************************ 00:07:10.337 END TEST accel_decomp 00:07:10.337 ************************************ 00:07:10.337 04:18:49 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:10.337 04:18:49 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:10.337 04:18:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.337 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:07:10.337 ************************************ 00:07:10.337 START TEST accel_decmop_full 00:07:10.337 ************************************ 00:07:10.337 04:18:49 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:10.337 04:18:49 -- accel/accel.sh@16 -- # local accel_opc 00:07:10.337 04:18:49 -- accel/accel.sh@17 -- # local accel_module 00:07:10.337 04:18:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:10.337 04:18:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:10.337 04:18:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.337 04:18:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.337 04:18:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.337 04:18:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.337 04:18:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.337 04:18:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.337 04:18:49 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.337 04:18:49 -- accel/accel.sh@42 -- # jq -r . 00:07:10.337 [2024-11-26 04:18:49.306763] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:10.337 [2024-11-26 04:18:49.306840] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2804862 ] 00:07:10.337 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.337 [2024-11-26 04:18:49.364128] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.337 [2024-11-26 04:18:49.452431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.717 04:18:50 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:11.717 00:07:11.717 SPDK Configuration: 00:07:11.717 Core mask: 0x1 00:07:11.717 00:07:11.717 Accel Perf Configuration: 00:07:11.717 Workload Type: decompress 00:07:11.717 Transfer size: 111250 bytes 00:07:11.717 Vector count 1 00:07:11.717 Module: software 00:07:11.717 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:11.717 Queue depth: 32 00:07:11.717 Allocate depth: 32 00:07:11.717 # threads/core: 1 00:07:11.717 Run time: 1 seconds 00:07:11.717 Verify: Yes 00:07:11.717 00:07:11.717 Running for 1 seconds... 00:07:11.717 00:07:11.717 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:11.717 ------------------------------------------------------------------------------------ 00:07:11.717 0,0 3808/s 157 MiB/s 0 0 00:07:11.717 ==================================================================================== 00:07:11.717 Total 3808/s 404 MiB/s 0 0' 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.717 04:18:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.717 04:18:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:11.717 04:18:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.717 04:18:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.717 04:18:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.717 04:18:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.717 04:18:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.717 04:18:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.717 04:18:50 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.717 04:18:50 -- accel/accel.sh@42 -- # jq -r . 00:07:11.717 [2024-11-26 04:18:50.715997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:11.717 [2024-11-26 04:18:50.716090] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2805009 ] 00:07:11.717 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.717 [2024-11-26 04:18:50.777197] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.717 [2024-11-26 04:18:50.870285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.717 04:18:50 -- accel/accel.sh@21 -- # val= 00:07:11.717 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.717 04:18:50 -- accel/accel.sh@21 -- # val= 00:07:11.717 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.717 04:18:50 -- accel/accel.sh@21 -- # val= 00:07:11.717 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.717 04:18:50 -- accel/accel.sh@21 -- # val=0x1 00:07:11.717 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.717 04:18:50 -- accel/accel.sh@21 -- # val= 00:07:11.717 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.717 04:18:50 -- accel/accel.sh@21 -- # val= 00:07:11.717 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.717 04:18:50 -- accel/accel.sh@21 -- # val=decompress 00:07:11.717 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.717 04:18:50 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.717 04:18:50 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:11.717 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.717 04:18:50 -- accel/accel.sh@21 -- # val= 00:07:11.717 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.717 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.977 04:18:50 -- accel/accel.sh@21 -- # val=software 00:07:11.977 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.977 04:18:50 -- accel/accel.sh@23 -- # accel_module=software 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.977 04:18:50 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:11.977 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.977 04:18:50 -- accel/accel.sh@21 -- # val=32 00:07:11.977 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.977 04:18:50 -- accel/accel.sh@21 -- # val=32 00:07:11.977 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.977 04:18:50 -- accel/accel.sh@21 -- # val=1 00:07:11.977 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.977 04:18:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:11.977 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.977 04:18:50 -- accel/accel.sh@21 -- # val=Yes 00:07:11.977 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.977 04:18:50 -- accel/accel.sh@21 -- # val= 00:07:11.977 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:11.977 04:18:50 -- accel/accel.sh@21 -- # val= 00:07:11.977 04:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:11.977 04:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:12.917 04:18:52 -- accel/accel.sh@21 -- # val= 00:07:12.917 04:18:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.917 04:18:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.917 04:18:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.917 04:18:52 -- accel/accel.sh@21 -- # val= 00:07:12.917 04:18:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.917 04:18:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.917 04:18:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.917 04:18:52 -- accel/accel.sh@21 -- # val= 00:07:12.917 04:18:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.917 04:18:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.917 04:18:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.917 04:18:52 -- accel/accel.sh@21 -- # val= 00:07:12.917 04:18:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.917 04:18:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.917 04:18:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.917 04:18:52 -- accel/accel.sh@21 -- # val= 00:07:12.917 04:18:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.917 04:18:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.917 04:18:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.917 04:18:52 -- accel/accel.sh@21 -- # val= 00:07:12.917 04:18:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.917 04:18:52 -- accel/accel.sh@20 -- # IFS=: 00:07:12.917 04:18:52 -- accel/accel.sh@20 -- # read -r var val 00:07:12.917 04:18:52 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:12.917 04:18:52 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:12.917 04:18:52 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:12.917 00:07:12.917 real 0m2.840s 00:07:12.917 user 0m2.540s 00:07:12.917 sys 0m0.294s 00:07:12.917 04:18:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:12.917 04:18:52 -- common/autotest_common.sh@10 -- # set +x 00:07:12.917 ************************************ 00:07:12.917 END TEST accel_decmop_full 00:07:12.917 ************************************ 00:07:13.176 04:18:52 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:13.176 04:18:52 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:13.176 04:18:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.176 04:18:52 -- common/autotest_common.sh@10 -- # set +x 00:07:13.176 ************************************ 00:07:13.176 START TEST accel_decomp_mcore 00:07:13.176 ************************************ 00:07:13.176 04:18:52 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:13.176 04:18:52 -- accel/accel.sh@16 -- # local accel_opc 00:07:13.176 04:18:52 -- accel/accel.sh@17 -- # local accel_module 00:07:13.176 04:18:52 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:13.176 04:18:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:13.176 04:18:52 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.176 04:18:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.176 04:18:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.176 04:18:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.176 04:18:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.176 04:18:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.176 04:18:52 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.176 04:18:52 -- accel/accel.sh@42 -- # jq -r . 00:07:13.176 [2024-11-26 04:18:52.177504] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:13.176 [2024-11-26 04:18:52.177584] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2805162 ] 00:07:13.176 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.176 [2024-11-26 04:18:52.241895] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:13.176 [2024-11-26 04:18:52.339655] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:13.176 [2024-11-26 04:18:52.339724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:13.176 [2024-11-26 04:18:52.339763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:13.176 [2024-11-26 04:18:52.339766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.555 04:18:53 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:14.555 00:07:14.555 SPDK Configuration: 00:07:14.555 Core mask: 0xf 00:07:14.555 00:07:14.555 Accel Perf Configuration: 00:07:14.555 Workload Type: decompress 00:07:14.555 Transfer size: 4096 bytes 00:07:14.555 Vector count 1 00:07:14.555 Module: software 00:07:14.555 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:14.555 Queue depth: 32 00:07:14.555 Allocate depth: 32 00:07:14.555 # threads/core: 1 00:07:14.555 Run time: 1 seconds 00:07:14.555 Verify: Yes 00:07:14.555 00:07:14.555 Running for 1 seconds... 00:07:14.555 00:07:14.555 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:14.555 ------------------------------------------------------------------------------------ 00:07:14.555 0,0 50176/s 92 MiB/s 0 0 00:07:14.555 3,0 50560/s 93 MiB/s 0 0 00:07:14.555 2,0 50560/s 93 MiB/s 0 0 00:07:14.555 1,0 50336/s 92 MiB/s 0 0 00:07:14.555 ==================================================================================== 00:07:14.555 Total 201632/s 787 MiB/s 0 0' 00:07:14.555 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.555 04:18:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:14.555 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.555 04:18:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:14.555 04:18:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.555 04:18:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.555 04:18:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.555 04:18:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.555 04:18:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.555 04:18:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.555 04:18:53 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.555 04:18:53 -- accel/accel.sh@42 -- # jq -r . 00:07:14.555 [2024-11-26 04:18:53.605594] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:14.555 [2024-11-26 04:18:53.605694] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2805430 ] 00:07:14.555 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.555 [2024-11-26 04:18:53.667446] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:14.555 [2024-11-26 04:18:53.762144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:14.555 [2024-11-26 04:18:53.762200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:14.555 [2024-11-26 04:18:53.762254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:14.556 [2024-11-26 04:18:53.762258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val= 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val= 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val= 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val=0xf 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val= 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val= 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val=decompress 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val= 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val=software 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@23 -- # accel_module=software 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val=32 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val=32 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val=1 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.816 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.816 04:18:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:14.816 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.817 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.817 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.817 04:18:53 -- accel/accel.sh@21 -- # val=Yes 00:07:14.817 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.817 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.817 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.817 04:18:53 -- accel/accel.sh@21 -- # val= 00:07:14.817 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.817 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.817 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:14.817 04:18:53 -- accel/accel.sh@21 -- # val= 00:07:14.817 04:18:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.817 04:18:53 -- accel/accel.sh@20 -- # IFS=: 00:07:14.817 04:18:53 -- accel/accel.sh@20 -- # read -r var val 00:07:16.201 04:18:55 -- accel/accel.sh@21 -- # val= 00:07:16.201 04:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:16.201 04:18:55 -- accel/accel.sh@21 -- # val= 00:07:16.201 04:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:16.201 04:18:55 -- accel/accel.sh@21 -- # val= 00:07:16.201 04:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:16.201 04:18:55 -- accel/accel.sh@21 -- # val= 00:07:16.201 04:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:16.201 04:18:55 -- accel/accel.sh@21 -- # val= 00:07:16.201 04:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:16.201 04:18:55 -- accel/accel.sh@21 -- # val= 00:07:16.201 04:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:16.201 04:18:55 -- accel/accel.sh@21 -- # val= 00:07:16.201 04:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:16.201 04:18:55 -- accel/accel.sh@21 -- # val= 00:07:16.201 04:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:16.201 04:18:55 -- accel/accel.sh@21 -- # val= 00:07:16.201 04:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:16.201 04:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:16.201 04:18:55 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:16.201 04:18:55 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:16.201 04:18:55 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:16.201 00:07:16.201 real 0m2.850s 00:07:16.201 user 0m9.459s 00:07:16.201 sys 0m0.306s 00:07:16.201 04:18:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.201 04:18:55 -- common/autotest_common.sh@10 -- # set +x 00:07:16.201 ************************************ 00:07:16.201 END TEST accel_decomp_mcore 00:07:16.201 ************************************ 00:07:16.201 04:18:55 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:16.201 04:18:55 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:16.201 04:18:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.201 04:18:55 -- common/autotest_common.sh@10 -- # set +x 00:07:16.201 ************************************ 00:07:16.201 START TEST accel_decomp_full_mcore 00:07:16.201 ************************************ 00:07:16.201 04:18:55 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:16.201 04:18:55 -- accel/accel.sh@16 -- # local accel_opc 00:07:16.201 04:18:55 -- accel/accel.sh@17 -- # local accel_module 00:07:16.201 04:18:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:16.202 04:18:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:16.202 04:18:55 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.202 04:18:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.202 04:18:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.202 04:18:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.202 04:18:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.202 04:18:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.202 04:18:55 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.202 04:18:55 -- accel/accel.sh@42 -- # jq -r . 00:07:16.202 [2024-11-26 04:18:55.053543] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:16.202 [2024-11-26 04:18:55.053628] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2805595 ] 00:07:16.202 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.202 [2024-11-26 04:18:55.118737] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:16.202 [2024-11-26 04:18:55.214488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:16.202 [2024-11-26 04:18:55.214547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:16.202 [2024-11-26 04:18:55.214601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:16.202 [2024-11-26 04:18:55.214604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.580 04:18:56 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:17.580 00:07:17.580 SPDK Configuration: 00:07:17.580 Core mask: 0xf 00:07:17.580 00:07:17.580 Accel Perf Configuration: 00:07:17.580 Workload Type: decompress 00:07:17.580 Transfer size: 111250 bytes 00:07:17.581 Vector count 1 00:07:17.581 Module: software 00:07:17.581 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:17.581 Queue depth: 32 00:07:17.581 Allocate depth: 32 00:07:17.581 # threads/core: 1 00:07:17.581 Run time: 1 seconds 00:07:17.581 Verify: Yes 00:07:17.581 00:07:17.581 Running for 1 seconds... 00:07:17.581 00:07:17.581 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:17.581 ------------------------------------------------------------------------------------ 00:07:17.581 0,0 3776/s 155 MiB/s 0 0 00:07:17.581 3,0 3776/s 155 MiB/s 0 0 00:07:17.581 2,0 3776/s 155 MiB/s 0 0 00:07:17.581 1,0 3776/s 155 MiB/s 0 0 00:07:17.581 ==================================================================================== 00:07:17.581 Total 15104/s 1602 MiB/s 0 0' 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:17.581 04:18:56 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.581 04:18:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.581 04:18:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.581 04:18:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.581 04:18:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.581 04:18:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.581 04:18:56 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.581 04:18:56 -- accel/accel.sh@42 -- # jq -r . 00:07:17.581 [2024-11-26 04:18:56.490332] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:17.581 [2024-11-26 04:18:56.490422] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2805745 ] 00:07:17.581 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.581 [2024-11-26 04:18:56.551809] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:17.581 [2024-11-26 04:18:56.648417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:17.581 [2024-11-26 04:18:56.648474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:17.581 [2024-11-26 04:18:56.648526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:17.581 [2024-11-26 04:18:56.648529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val= 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val= 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val= 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val=0xf 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val= 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val= 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val=decompress 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val= 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val=software 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@23 -- # accel_module=software 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val=32 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val=32 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val=1 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val=Yes 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val= 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:17.581 04:18:56 -- accel/accel.sh@21 -- # val= 00:07:17.581 04:18:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # IFS=: 00:07:17.581 04:18:56 -- accel/accel.sh@20 -- # read -r var val 00:07:18.962 04:18:57 -- accel/accel.sh@21 -- # val= 00:07:18.962 04:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:18.962 04:18:57 -- accel/accel.sh@21 -- # val= 00:07:18.962 04:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:18.962 04:18:57 -- accel/accel.sh@21 -- # val= 00:07:18.962 04:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:18.962 04:18:57 -- accel/accel.sh@21 -- # val= 00:07:18.962 04:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:18.962 04:18:57 -- accel/accel.sh@21 -- # val= 00:07:18.962 04:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:18.962 04:18:57 -- accel/accel.sh@21 -- # val= 00:07:18.962 04:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:18.962 04:18:57 -- accel/accel.sh@21 -- # val= 00:07:18.962 04:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:18.962 04:18:57 -- accel/accel.sh@21 -- # val= 00:07:18.962 04:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:18.962 04:18:57 -- accel/accel.sh@21 -- # val= 00:07:18.962 04:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:18.962 04:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:18.962 04:18:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:18.962 04:18:57 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:18.962 04:18:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:18.962 00:07:18.963 real 0m2.872s 00:07:18.963 user 0m9.561s 00:07:18.963 sys 0m0.308s 00:07:18.963 04:18:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:18.963 04:18:57 -- common/autotest_common.sh@10 -- # set +x 00:07:18.963 ************************************ 00:07:18.963 END TEST accel_decomp_full_mcore 00:07:18.963 ************************************ 00:07:18.963 04:18:57 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:18.963 04:18:57 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:18.963 04:18:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:18.963 04:18:57 -- common/autotest_common.sh@10 -- # set +x 00:07:18.963 ************************************ 00:07:18.963 START TEST accel_decomp_mthread 00:07:18.963 ************************************ 00:07:18.963 04:18:57 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:18.963 04:18:57 -- accel/accel.sh@16 -- # local accel_opc 00:07:18.963 04:18:57 -- accel/accel.sh@17 -- # local accel_module 00:07:18.963 04:18:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:18.963 04:18:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:18.963 04:18:57 -- accel/accel.sh@12 -- # build_accel_config 00:07:18.963 04:18:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:18.963 04:18:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:18.963 04:18:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:18.963 04:18:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:18.963 04:18:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:18.963 04:18:57 -- accel/accel.sh@41 -- # local IFS=, 00:07:18.963 04:18:57 -- accel/accel.sh@42 -- # jq -r . 00:07:18.963 [2024-11-26 04:18:57.955008] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:18.963 [2024-11-26 04:18:57.955106] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2805956 ] 00:07:18.963 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.963 [2024-11-26 04:18:58.017942] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.963 [2024-11-26 04:18:58.112404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.346 04:18:59 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:20.346 00:07:20.346 SPDK Configuration: 00:07:20.346 Core mask: 0x1 00:07:20.346 00:07:20.346 Accel Perf Configuration: 00:07:20.346 Workload Type: decompress 00:07:20.346 Transfer size: 4096 bytes 00:07:20.346 Vector count 1 00:07:20.346 Module: software 00:07:20.346 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:20.346 Queue depth: 32 00:07:20.346 Allocate depth: 32 00:07:20.346 # threads/core: 2 00:07:20.346 Run time: 1 seconds 00:07:20.346 Verify: Yes 00:07:20.346 00:07:20.346 Running for 1 seconds... 00:07:20.346 00:07:20.346 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:20.346 ------------------------------------------------------------------------------------ 00:07:20.346 0,1 28064/s 51 MiB/s 0 0 00:07:20.346 0,0 27936/s 51 MiB/s 0 0 00:07:20.346 ==================================================================================== 00:07:20.346 Total 56000/s 218 MiB/s 0 0' 00:07:20.346 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.346 04:18:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:20.346 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.346 04:18:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:20.346 04:18:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.346 04:18:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:20.346 04:18:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.346 04:18:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.346 04:18:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:20.346 04:18:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:20.346 04:18:59 -- accel/accel.sh@41 -- # local IFS=, 00:07:20.346 04:18:59 -- accel/accel.sh@42 -- # jq -r . 00:07:20.346 [2024-11-26 04:18:59.377735] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:20.346 [2024-11-26 04:18:59.377820] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2806162 ] 00:07:20.346 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.346 [2024-11-26 04:18:59.438862] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.346 [2024-11-26 04:18:59.531733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.606 04:18:59 -- accel/accel.sh@21 -- # val= 00:07:20.606 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.606 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.606 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.606 04:18:59 -- accel/accel.sh@21 -- # val= 00:07:20.606 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.606 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.606 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.606 04:18:59 -- accel/accel.sh@21 -- # val= 00:07:20.606 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.606 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.606 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.606 04:18:59 -- accel/accel.sh@21 -- # val=0x1 00:07:20.606 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.606 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.606 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.606 04:18:59 -- accel/accel.sh@21 -- # val= 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val= 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val=decompress 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val= 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val=software 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@23 -- # accel_module=software 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val=32 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val=32 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val=2 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val=Yes 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val= 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:20.607 04:18:59 -- accel/accel.sh@21 -- # val= 00:07:20.607 04:18:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # IFS=: 00:07:20.607 04:18:59 -- accel/accel.sh@20 -- # read -r var val 00:07:21.986 04:19:00 -- accel/accel.sh@21 -- # val= 00:07:21.986 04:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:21.986 04:19:00 -- accel/accel.sh@21 -- # val= 00:07:21.986 04:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:21.986 04:19:00 -- accel/accel.sh@21 -- # val= 00:07:21.986 04:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:21.986 04:19:00 -- accel/accel.sh@21 -- # val= 00:07:21.986 04:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:21.986 04:19:00 -- accel/accel.sh@21 -- # val= 00:07:21.986 04:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:21.986 04:19:00 -- accel/accel.sh@21 -- # val= 00:07:21.986 04:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:21.986 04:19:00 -- accel/accel.sh@21 -- # val= 00:07:21.986 04:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:21.986 04:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:21.986 04:19:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:21.986 04:19:00 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:21.986 04:19:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:21.986 00:07:21.986 real 0m2.840s 00:07:21.986 user 0m2.534s 00:07:21.986 sys 0m0.299s 00:07:21.986 04:19:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:21.986 04:19:00 -- common/autotest_common.sh@10 -- # set +x 00:07:21.986 ************************************ 00:07:21.986 END TEST accel_decomp_mthread 00:07:21.986 ************************************ 00:07:21.986 04:19:00 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:21.986 04:19:00 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:21.986 04:19:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.986 04:19:00 -- common/autotest_common.sh@10 -- # set +x 00:07:21.986 ************************************ 00:07:21.986 START TEST accel_deomp_full_mthread 00:07:21.986 ************************************ 00:07:21.986 04:19:00 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:21.986 04:19:00 -- accel/accel.sh@16 -- # local accel_opc 00:07:21.986 04:19:00 -- accel/accel.sh@17 -- # local accel_module 00:07:21.986 04:19:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:21.986 04:19:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:21.986 04:19:00 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.986 04:19:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:21.986 04:19:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.986 04:19:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.986 04:19:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:21.986 04:19:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:21.986 04:19:00 -- accel/accel.sh@41 -- # local IFS=, 00:07:21.986 04:19:00 -- accel/accel.sh@42 -- # jq -r . 00:07:21.986 [2024-11-26 04:19:00.819440] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:21.986 [2024-11-26 04:19:00.819522] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2806328 ] 00:07:21.986 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.986 [2024-11-26 04:19:00.883562] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.986 [2024-11-26 04:19:00.976334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.367 04:19:02 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:23.367 00:07:23.367 SPDK Configuration: 00:07:23.367 Core mask: 0x1 00:07:23.367 00:07:23.367 Accel Perf Configuration: 00:07:23.367 Workload Type: decompress 00:07:23.367 Transfer size: 111250 bytes 00:07:23.367 Vector count 1 00:07:23.367 Module: software 00:07:23.367 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:23.367 Queue depth: 32 00:07:23.367 Allocate depth: 32 00:07:23.367 # threads/core: 2 00:07:23.367 Run time: 1 seconds 00:07:23.367 Verify: Yes 00:07:23.367 00:07:23.367 Running for 1 seconds... 00:07:23.367 00:07:23.367 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:23.367 ------------------------------------------------------------------------------------ 00:07:23.367 0,1 1952/s 80 MiB/s 0 0 00:07:23.367 0,0 1920/s 79 MiB/s 0 0 00:07:23.367 ==================================================================================== 00:07:23.367 Total 3872/s 410 MiB/s 0 0' 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:23.367 04:19:02 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.367 04:19:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.367 04:19:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.367 04:19:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.367 04:19:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.367 04:19:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.367 04:19:02 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.367 04:19:02 -- accel/accel.sh@42 -- # jq -r . 00:07:23.367 [2024-11-26 04:19:02.270803] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:23.367 [2024-11-26 04:19:02.270894] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2806469 ] 00:07:23.367 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.367 [2024-11-26 04:19:02.331718] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.367 [2024-11-26 04:19:02.425255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val= 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val= 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val= 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val=0x1 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val= 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val= 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val=decompress 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val= 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val=software 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@23 -- # accel_module=software 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val=32 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val=32 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val=2 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:23.367 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.367 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.367 04:19:02 -- accel/accel.sh@21 -- # val=Yes 00:07:23.368 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.368 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.368 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.368 04:19:02 -- accel/accel.sh@21 -- # val= 00:07:23.368 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.368 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.368 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:23.368 04:19:02 -- accel/accel.sh@21 -- # val= 00:07:23.368 04:19:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.368 04:19:02 -- accel/accel.sh@20 -- # IFS=: 00:07:23.368 04:19:02 -- accel/accel.sh@20 -- # read -r var val 00:07:24.747 04:19:03 -- accel/accel.sh@21 -- # val= 00:07:24.747 04:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:24.747 04:19:03 -- accel/accel.sh@21 -- # val= 00:07:24.747 04:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:24.747 04:19:03 -- accel/accel.sh@21 -- # val= 00:07:24.747 04:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:24.747 04:19:03 -- accel/accel.sh@21 -- # val= 00:07:24.747 04:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:24.747 04:19:03 -- accel/accel.sh@21 -- # val= 00:07:24.747 04:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:24.747 04:19:03 -- accel/accel.sh@21 -- # val= 00:07:24.747 04:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:24.747 04:19:03 -- accel/accel.sh@21 -- # val= 00:07:24.747 04:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:24.747 04:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:24.747 04:19:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:24.747 04:19:03 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:24.747 04:19:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:24.747 00:07:24.747 real 0m2.888s 00:07:24.747 user 0m2.581s 00:07:24.747 sys 0m0.301s 00:07:24.748 04:19:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.748 04:19:03 -- common/autotest_common.sh@10 -- # set +x 00:07:24.748 ************************************ 00:07:24.748 END TEST accel_deomp_full_mthread 00:07:24.748 ************************************ 00:07:24.748 04:19:03 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:24.748 04:19:03 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:24.748 04:19:03 -- accel/accel.sh@129 -- # build_accel_config 00:07:24.748 04:19:03 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:24.748 04:19:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.748 04:19:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.748 04:19:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.748 04:19:03 -- common/autotest_common.sh@10 -- # set +x 00:07:24.748 04:19:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.748 04:19:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.748 04:19:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.748 04:19:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.748 04:19:03 -- accel/accel.sh@42 -- # jq -r . 00:07:24.748 ************************************ 00:07:24.748 START TEST accel_dif_functional_tests 00:07:24.748 ************************************ 00:07:24.748 04:19:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:24.748 [2024-11-26 04:19:03.757048] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:24.748 [2024-11-26 04:19:03.757123] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2806748 ] 00:07:24.748 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.748 [2024-11-26 04:19:03.818824] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:24.748 [2024-11-26 04:19:03.912464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:24.748 [2024-11-26 04:19:03.912521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:24.748 [2024-11-26 04:19:03.912525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.007 00:07:25.007 00:07:25.007 CUnit - A unit testing framework for C - Version 2.1-3 00:07:25.007 http://cunit.sourceforge.net/ 00:07:25.007 00:07:25.007 00:07:25.007 Suite: accel_dif 00:07:25.007 Test: verify: DIF generated, GUARD check ...passed 00:07:25.007 Test: verify: DIF generated, APPTAG check ...passed 00:07:25.007 Test: verify: DIF generated, REFTAG check ...passed 00:07:25.007 Test: verify: DIF not generated, GUARD check ...[2024-11-26 04:19:04.008633] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:25.007 [2024-11-26 04:19:04.008717] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:25.007 passed 00:07:25.007 Test: verify: DIF not generated, APPTAG check ...[2024-11-26 04:19:04.008762] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:25.007 [2024-11-26 04:19:04.008794] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:25.007 passed 00:07:25.007 Test: verify: DIF not generated, REFTAG check ...[2024-11-26 04:19:04.008827] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:25.007 [2024-11-26 04:19:04.008855] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:25.007 passed 00:07:25.007 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:25.007 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-26 04:19:04.008923] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:25.007 passed 00:07:25.007 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:25.007 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:25.007 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:25.007 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-26 04:19:04.009081] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:25.007 passed 00:07:25.007 Test: generate copy: DIF generated, GUARD check ...passed 00:07:25.007 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:25.007 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:25.007 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:25.007 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:25.007 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:25.007 Test: generate copy: iovecs-len validate ...[2024-11-26 04:19:04.009334] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:25.007 passed 00:07:25.007 Test: generate copy: buffer alignment validate ...passed 00:07:25.007 00:07:25.007 Run Summary: Type Total Ran Passed Failed Inactive 00:07:25.007 suites 1 1 n/a 0 0 00:07:25.007 tests 20 20 20 0 0 00:07:25.007 asserts 204 204 204 0 n/a 00:07:25.007 00:07:25.007 Elapsed time = 0.003 seconds 00:07:25.007 00:07:25.007 real 0m0.509s 00:07:25.007 user 0m0.792s 00:07:25.007 sys 0m0.186s 00:07:25.007 04:19:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:25.007 04:19:04 -- common/autotest_common.sh@10 -- # set +x 00:07:25.007 ************************************ 00:07:25.007 END TEST accel_dif_functional_tests 00:07:25.007 ************************************ 00:07:25.266 00:07:25.266 real 1m0.020s 00:07:25.266 user 1m7.834s 00:07:25.266 sys 0m7.289s 00:07:25.266 04:19:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:25.266 04:19:04 -- common/autotest_common.sh@10 -- # set +x 00:07:25.266 ************************************ 00:07:25.266 END TEST accel 00:07:25.266 ************************************ 00:07:25.266 04:19:04 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:25.266 04:19:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:25.266 04:19:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.266 04:19:04 -- common/autotest_common.sh@10 -- # set +x 00:07:25.266 ************************************ 00:07:25.266 START TEST accel_rpc 00:07:25.266 ************************************ 00:07:25.266 04:19:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:25.266 * Looking for test storage... 00:07:25.266 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:25.266 04:19:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:25.266 04:19:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:25.266 04:19:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:25.266 04:19:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:25.266 04:19:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:25.266 04:19:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:25.266 04:19:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:25.266 04:19:04 -- scripts/common.sh@335 -- # IFS=.-: 00:07:25.266 04:19:04 -- scripts/common.sh@335 -- # read -ra ver1 00:07:25.266 04:19:04 -- scripts/common.sh@336 -- # IFS=.-: 00:07:25.266 04:19:04 -- scripts/common.sh@336 -- # read -ra ver2 00:07:25.266 04:19:04 -- scripts/common.sh@337 -- # local 'op=<' 00:07:25.266 04:19:04 -- scripts/common.sh@339 -- # ver1_l=2 00:07:25.266 04:19:04 -- scripts/common.sh@340 -- # ver2_l=1 00:07:25.266 04:19:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:25.266 04:19:04 -- scripts/common.sh@343 -- # case "$op" in 00:07:25.266 04:19:04 -- scripts/common.sh@344 -- # : 1 00:07:25.266 04:19:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:25.266 04:19:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:25.266 04:19:04 -- scripts/common.sh@364 -- # decimal 1 00:07:25.266 04:19:04 -- scripts/common.sh@352 -- # local d=1 00:07:25.266 04:19:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:25.266 04:19:04 -- scripts/common.sh@354 -- # echo 1 00:07:25.266 04:19:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:25.266 04:19:04 -- scripts/common.sh@365 -- # decimal 2 00:07:25.266 04:19:04 -- scripts/common.sh@352 -- # local d=2 00:07:25.266 04:19:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:25.266 04:19:04 -- scripts/common.sh@354 -- # echo 2 00:07:25.266 04:19:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:25.266 04:19:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:25.266 04:19:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:25.266 04:19:04 -- scripts/common.sh@367 -- # return 0 00:07:25.266 04:19:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:25.266 04:19:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:25.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:25.266 --rc genhtml_branch_coverage=1 00:07:25.266 --rc genhtml_function_coverage=1 00:07:25.266 --rc genhtml_legend=1 00:07:25.266 --rc geninfo_all_blocks=1 00:07:25.266 --rc geninfo_unexecuted_blocks=1 00:07:25.266 00:07:25.266 ' 00:07:25.266 04:19:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:25.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:25.266 --rc genhtml_branch_coverage=1 00:07:25.266 --rc genhtml_function_coverage=1 00:07:25.266 --rc genhtml_legend=1 00:07:25.266 --rc geninfo_all_blocks=1 00:07:25.266 --rc geninfo_unexecuted_blocks=1 00:07:25.266 00:07:25.266 ' 00:07:25.266 04:19:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:25.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:25.266 --rc genhtml_branch_coverage=1 00:07:25.266 --rc genhtml_function_coverage=1 00:07:25.266 --rc genhtml_legend=1 00:07:25.266 --rc geninfo_all_blocks=1 00:07:25.266 --rc geninfo_unexecuted_blocks=1 00:07:25.266 00:07:25.266 ' 00:07:25.266 04:19:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:25.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:25.266 --rc genhtml_branch_coverage=1 00:07:25.266 --rc genhtml_function_coverage=1 00:07:25.266 --rc genhtml_legend=1 00:07:25.266 --rc geninfo_all_blocks=1 00:07:25.266 --rc geninfo_unexecuted_blocks=1 00:07:25.266 00:07:25.266 ' 00:07:25.266 04:19:04 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:25.266 04:19:04 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2806824 00:07:25.266 04:19:04 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:25.266 04:19:04 -- accel/accel_rpc.sh@15 -- # waitforlisten 2806824 00:07:25.266 04:19:04 -- common/autotest_common.sh@829 -- # '[' -z 2806824 ']' 00:07:25.266 04:19:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:25.266 04:19:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:25.266 04:19:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:25.266 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:25.266 04:19:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:25.266 04:19:04 -- common/autotest_common.sh@10 -- # set +x 00:07:25.266 [2024-11-26 04:19:04.476456] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:25.267 [2024-11-26 04:19:04.476554] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2806824 ] 00:07:25.525 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.525 [2024-11-26 04:19:04.542385] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:25.525 [2024-11-26 04:19:04.634558] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:25.525 [2024-11-26 04:19:04.634753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.525 04:19:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:25.525 04:19:04 -- common/autotest_common.sh@862 -- # return 0 00:07:25.525 04:19:04 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:25.525 04:19:04 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:25.525 04:19:04 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:25.525 04:19:04 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:25.525 04:19:04 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:25.525 04:19:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:25.525 04:19:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.525 04:19:04 -- common/autotest_common.sh@10 -- # set +x 00:07:25.525 ************************************ 00:07:25.525 START TEST accel_assign_opcode 00:07:25.525 ************************************ 00:07:25.525 04:19:04 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:25.525 04:19:04 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:25.525 04:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:25.525 04:19:04 -- common/autotest_common.sh@10 -- # set +x 00:07:25.525 [2024-11-26 04:19:04.683290] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:25.525 04:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:25.525 04:19:04 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:25.525 04:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:25.525 04:19:04 -- common/autotest_common.sh@10 -- # set +x 00:07:25.525 [2024-11-26 04:19:04.691304] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:25.525 04:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:25.525 04:19:04 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:25.525 04:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:25.525 04:19:04 -- common/autotest_common.sh@10 -- # set +x 00:07:25.783 04:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:25.783 04:19:04 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:25.783 04:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:25.783 04:19:04 -- common/autotest_common.sh@10 -- # set +x 00:07:25.783 04:19:04 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:25.783 04:19:04 -- accel/accel_rpc.sh@42 -- # grep software 00:07:25.783 04:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:25.783 software 00:07:25.783 00:07:25.783 real 0m0.295s 00:07:25.783 user 0m0.046s 00:07:25.783 sys 0m0.001s 00:07:25.783 04:19:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:25.783 04:19:04 -- common/autotest_common.sh@10 -- # set +x 00:07:25.783 ************************************ 00:07:25.783 END TEST accel_assign_opcode 00:07:25.783 ************************************ 00:07:25.783 04:19:04 -- accel/accel_rpc.sh@55 -- # killprocess 2806824 00:07:25.783 04:19:04 -- common/autotest_common.sh@936 -- # '[' -z 2806824 ']' 00:07:25.783 04:19:04 -- common/autotest_common.sh@940 -- # kill -0 2806824 00:07:25.783 04:19:04 -- common/autotest_common.sh@941 -- # uname 00:07:25.783 04:19:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:25.783 04:19:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2806824 00:07:26.042 04:19:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:26.042 04:19:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:26.042 04:19:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2806824' 00:07:26.042 killing process with pid 2806824 00:07:26.042 04:19:05 -- common/autotest_common.sh@955 -- # kill 2806824 00:07:26.042 04:19:05 -- common/autotest_common.sh@960 -- # wait 2806824 00:07:26.300 00:07:26.300 real 0m1.169s 00:07:26.300 user 0m1.077s 00:07:26.300 sys 0m0.442s 00:07:26.300 04:19:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:26.300 04:19:05 -- common/autotest_common.sh@10 -- # set +x 00:07:26.300 ************************************ 00:07:26.300 END TEST accel_rpc 00:07:26.300 ************************************ 00:07:26.300 04:19:05 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:26.300 04:19:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:26.300 04:19:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:26.300 04:19:05 -- common/autotest_common.sh@10 -- # set +x 00:07:26.300 ************************************ 00:07:26.300 START TEST app_cmdline 00:07:26.300 ************************************ 00:07:26.300 04:19:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:26.300 * Looking for test storage... 00:07:26.300 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:26.300 04:19:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:26.300 04:19:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:26.300 04:19:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:26.558 04:19:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:26.558 04:19:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:26.558 04:19:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:26.558 04:19:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:26.558 04:19:05 -- scripts/common.sh@335 -- # IFS=.-: 00:07:26.558 04:19:05 -- scripts/common.sh@335 -- # read -ra ver1 00:07:26.558 04:19:05 -- scripts/common.sh@336 -- # IFS=.-: 00:07:26.558 04:19:05 -- scripts/common.sh@336 -- # read -ra ver2 00:07:26.558 04:19:05 -- scripts/common.sh@337 -- # local 'op=<' 00:07:26.558 04:19:05 -- scripts/common.sh@339 -- # ver1_l=2 00:07:26.558 04:19:05 -- scripts/common.sh@340 -- # ver2_l=1 00:07:26.558 04:19:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:26.558 04:19:05 -- scripts/common.sh@343 -- # case "$op" in 00:07:26.558 04:19:05 -- scripts/common.sh@344 -- # : 1 00:07:26.558 04:19:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:26.558 04:19:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:26.558 04:19:05 -- scripts/common.sh@364 -- # decimal 1 00:07:26.558 04:19:05 -- scripts/common.sh@352 -- # local d=1 00:07:26.558 04:19:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:26.558 04:19:05 -- scripts/common.sh@354 -- # echo 1 00:07:26.558 04:19:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:26.558 04:19:05 -- scripts/common.sh@365 -- # decimal 2 00:07:26.558 04:19:05 -- scripts/common.sh@352 -- # local d=2 00:07:26.558 04:19:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:26.558 04:19:05 -- scripts/common.sh@354 -- # echo 2 00:07:26.558 04:19:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:26.558 04:19:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:26.558 04:19:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:26.558 04:19:05 -- scripts/common.sh@367 -- # return 0 00:07:26.558 04:19:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:26.558 04:19:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:26.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:26.558 --rc genhtml_branch_coverage=1 00:07:26.558 --rc genhtml_function_coverage=1 00:07:26.558 --rc genhtml_legend=1 00:07:26.558 --rc geninfo_all_blocks=1 00:07:26.558 --rc geninfo_unexecuted_blocks=1 00:07:26.558 00:07:26.558 ' 00:07:26.558 04:19:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:26.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:26.558 --rc genhtml_branch_coverage=1 00:07:26.558 --rc genhtml_function_coverage=1 00:07:26.558 --rc genhtml_legend=1 00:07:26.558 --rc geninfo_all_blocks=1 00:07:26.558 --rc geninfo_unexecuted_blocks=1 00:07:26.558 00:07:26.558 ' 00:07:26.558 04:19:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:26.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:26.558 --rc genhtml_branch_coverage=1 00:07:26.558 --rc genhtml_function_coverage=1 00:07:26.558 --rc genhtml_legend=1 00:07:26.558 --rc geninfo_all_blocks=1 00:07:26.558 --rc geninfo_unexecuted_blocks=1 00:07:26.558 00:07:26.558 ' 00:07:26.558 04:19:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:26.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:26.558 --rc genhtml_branch_coverage=1 00:07:26.558 --rc genhtml_function_coverage=1 00:07:26.558 --rc genhtml_legend=1 00:07:26.558 --rc geninfo_all_blocks=1 00:07:26.558 --rc geninfo_unexecuted_blocks=1 00:07:26.558 00:07:26.558 ' 00:07:26.558 04:19:05 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:26.558 04:19:05 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2807044 00:07:26.559 04:19:05 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:26.559 04:19:05 -- app/cmdline.sh@18 -- # waitforlisten 2807044 00:07:26.559 04:19:05 -- common/autotest_common.sh@829 -- # '[' -z 2807044 ']' 00:07:26.559 04:19:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:26.559 04:19:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:26.559 04:19:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:26.559 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:26.559 04:19:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:26.559 04:19:05 -- common/autotest_common.sh@10 -- # set +x 00:07:26.559 [2024-11-26 04:19:05.653942] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:26.559 [2024-11-26 04:19:05.654033] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2807044 ] 00:07:26.559 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.559 [2024-11-26 04:19:05.709655] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.819 [2024-11-26 04:19:05.797266] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:26.819 [2024-11-26 04:19:05.797442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.755 04:19:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:27.755 04:19:06 -- common/autotest_common.sh@862 -- # return 0 00:07:27.755 04:19:06 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:27.755 { 00:07:27.755 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:27.755 "fields": { 00:07:27.755 "major": 24, 00:07:27.755 "minor": 1, 00:07:27.755 "patch": 1, 00:07:27.755 "suffix": "-pre", 00:07:27.755 "commit": "c13c99a5e" 00:07:27.755 } 00:07:27.755 } 00:07:27.755 04:19:06 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:27.755 04:19:06 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:27.755 04:19:06 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:27.755 04:19:06 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:27.755 04:19:06 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:27.755 04:19:06 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:27.755 04:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.755 04:19:06 -- common/autotest_common.sh@10 -- # set +x 00:07:27.755 04:19:06 -- app/cmdline.sh@26 -- # sort 00:07:27.755 04:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.755 04:19:06 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:27.755 04:19:06 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:27.755 04:19:06 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:27.755 04:19:06 -- common/autotest_common.sh@650 -- # local es=0 00:07:27.755 04:19:06 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:27.755 04:19:06 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:27.755 04:19:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:27.755 04:19:06 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:27.755 04:19:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:27.755 04:19:06 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:27.755 04:19:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:27.755 04:19:06 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:27.755 04:19:06 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:27.755 04:19:06 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:28.013 request: 00:07:28.013 { 00:07:28.013 "method": "env_dpdk_get_mem_stats", 00:07:28.013 "req_id": 1 00:07:28.013 } 00:07:28.013 Got JSON-RPC error response 00:07:28.013 response: 00:07:28.013 { 00:07:28.013 "code": -32601, 00:07:28.013 "message": "Method not found" 00:07:28.013 } 00:07:28.013 04:19:07 -- common/autotest_common.sh@653 -- # es=1 00:07:28.013 04:19:07 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:28.013 04:19:07 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:28.013 04:19:07 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:28.013 04:19:07 -- app/cmdline.sh@1 -- # killprocess 2807044 00:07:28.013 04:19:07 -- common/autotest_common.sh@936 -- # '[' -z 2807044 ']' 00:07:28.013 04:19:07 -- common/autotest_common.sh@940 -- # kill -0 2807044 00:07:28.013 04:19:07 -- common/autotest_common.sh@941 -- # uname 00:07:28.013 04:19:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:28.013 04:19:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2807044 00:07:28.271 04:19:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:28.271 04:19:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:28.271 04:19:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2807044' 00:07:28.271 killing process with pid 2807044 00:07:28.271 04:19:07 -- common/autotest_common.sh@955 -- # kill 2807044 00:07:28.271 04:19:07 -- common/autotest_common.sh@960 -- # wait 2807044 00:07:28.529 00:07:28.529 real 0m2.183s 00:07:28.529 user 0m2.775s 00:07:28.529 sys 0m0.498s 00:07:28.529 04:19:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:28.529 04:19:07 -- common/autotest_common.sh@10 -- # set +x 00:07:28.529 ************************************ 00:07:28.529 END TEST app_cmdline 00:07:28.529 ************************************ 00:07:28.529 04:19:07 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:28.529 04:19:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:28.529 04:19:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.529 04:19:07 -- common/autotest_common.sh@10 -- # set +x 00:07:28.529 ************************************ 00:07:28.529 START TEST version 00:07:28.529 ************************************ 00:07:28.529 04:19:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:28.529 * Looking for test storage... 00:07:28.529 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:28.529 04:19:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:28.529 04:19:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:28.529 04:19:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:28.787 04:19:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:28.787 04:19:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:28.787 04:19:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:28.787 04:19:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:28.787 04:19:07 -- scripts/common.sh@335 -- # IFS=.-: 00:07:28.787 04:19:07 -- scripts/common.sh@335 -- # read -ra ver1 00:07:28.787 04:19:07 -- scripts/common.sh@336 -- # IFS=.-: 00:07:28.787 04:19:07 -- scripts/common.sh@336 -- # read -ra ver2 00:07:28.787 04:19:07 -- scripts/common.sh@337 -- # local 'op=<' 00:07:28.787 04:19:07 -- scripts/common.sh@339 -- # ver1_l=2 00:07:28.787 04:19:07 -- scripts/common.sh@340 -- # ver2_l=1 00:07:28.787 04:19:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:28.787 04:19:07 -- scripts/common.sh@343 -- # case "$op" in 00:07:28.787 04:19:07 -- scripts/common.sh@344 -- # : 1 00:07:28.788 04:19:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:28.788 04:19:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:28.788 04:19:07 -- scripts/common.sh@364 -- # decimal 1 00:07:28.788 04:19:07 -- scripts/common.sh@352 -- # local d=1 00:07:28.788 04:19:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:28.788 04:19:07 -- scripts/common.sh@354 -- # echo 1 00:07:28.788 04:19:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:28.788 04:19:07 -- scripts/common.sh@365 -- # decimal 2 00:07:28.788 04:19:07 -- scripts/common.sh@352 -- # local d=2 00:07:28.788 04:19:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:28.788 04:19:07 -- scripts/common.sh@354 -- # echo 2 00:07:28.788 04:19:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:28.788 04:19:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:28.788 04:19:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:28.788 04:19:07 -- scripts/common.sh@367 -- # return 0 00:07:28.788 04:19:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:28.788 04:19:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:28.788 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.788 --rc genhtml_branch_coverage=1 00:07:28.788 --rc genhtml_function_coverage=1 00:07:28.788 --rc genhtml_legend=1 00:07:28.788 --rc geninfo_all_blocks=1 00:07:28.788 --rc geninfo_unexecuted_blocks=1 00:07:28.788 00:07:28.788 ' 00:07:28.788 04:19:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:28.788 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.788 --rc genhtml_branch_coverage=1 00:07:28.788 --rc genhtml_function_coverage=1 00:07:28.788 --rc genhtml_legend=1 00:07:28.788 --rc geninfo_all_blocks=1 00:07:28.788 --rc geninfo_unexecuted_blocks=1 00:07:28.788 00:07:28.788 ' 00:07:28.788 04:19:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:28.788 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.788 --rc genhtml_branch_coverage=1 00:07:28.788 --rc genhtml_function_coverage=1 00:07:28.788 --rc genhtml_legend=1 00:07:28.788 --rc geninfo_all_blocks=1 00:07:28.788 --rc geninfo_unexecuted_blocks=1 00:07:28.788 00:07:28.788 ' 00:07:28.788 04:19:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:28.788 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.788 --rc genhtml_branch_coverage=1 00:07:28.788 --rc genhtml_function_coverage=1 00:07:28.788 --rc genhtml_legend=1 00:07:28.788 --rc geninfo_all_blocks=1 00:07:28.788 --rc geninfo_unexecuted_blocks=1 00:07:28.788 00:07:28.788 ' 00:07:28.788 04:19:07 -- app/version.sh@17 -- # get_header_version major 00:07:28.788 04:19:07 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:28.788 04:19:07 -- app/version.sh@14 -- # cut -f2 00:07:28.788 04:19:07 -- app/version.sh@14 -- # tr -d '"' 00:07:28.788 04:19:07 -- app/version.sh@17 -- # major=24 00:07:28.788 04:19:07 -- app/version.sh@18 -- # get_header_version minor 00:07:28.788 04:19:07 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:28.788 04:19:07 -- app/version.sh@14 -- # cut -f2 00:07:28.788 04:19:07 -- app/version.sh@14 -- # tr -d '"' 00:07:28.788 04:19:07 -- app/version.sh@18 -- # minor=1 00:07:28.788 04:19:07 -- app/version.sh@19 -- # get_header_version patch 00:07:28.788 04:19:07 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:28.788 04:19:07 -- app/version.sh@14 -- # cut -f2 00:07:28.788 04:19:07 -- app/version.sh@14 -- # tr -d '"' 00:07:28.788 04:19:07 -- app/version.sh@19 -- # patch=1 00:07:28.788 04:19:07 -- app/version.sh@20 -- # get_header_version suffix 00:07:28.788 04:19:07 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:28.788 04:19:07 -- app/version.sh@14 -- # cut -f2 00:07:28.788 04:19:07 -- app/version.sh@14 -- # tr -d '"' 00:07:28.788 04:19:07 -- app/version.sh@20 -- # suffix=-pre 00:07:28.788 04:19:07 -- app/version.sh@22 -- # version=24.1 00:07:28.788 04:19:07 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:28.788 04:19:07 -- app/version.sh@25 -- # version=24.1.1 00:07:28.788 04:19:07 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:28.788 04:19:07 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:28.788 04:19:07 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:28.788 04:19:07 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:28.788 04:19:07 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:28.788 00:07:28.788 real 0m0.189s 00:07:28.788 user 0m0.126s 00:07:28.788 sys 0m0.088s 00:07:28.788 04:19:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:28.788 04:19:07 -- common/autotest_common.sh@10 -- # set +x 00:07:28.788 ************************************ 00:07:28.788 END TEST version 00:07:28.788 ************************************ 00:07:28.788 04:19:07 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:07:28.788 04:19:07 -- spdk/autotest.sh@191 -- # uname -s 00:07:28.788 04:19:07 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:07:28.788 04:19:07 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:28.788 04:19:07 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:28.788 04:19:07 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:07:28.788 04:19:07 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:07:28.788 04:19:07 -- spdk/autotest.sh@255 -- # timing_exit lib 00:07:28.788 04:19:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:28.788 04:19:07 -- common/autotest_common.sh@10 -- # set +x 00:07:28.788 04:19:07 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:07:28.788 04:19:07 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:07:28.788 04:19:07 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:07:28.788 04:19:07 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:07:28.788 04:19:07 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:07:28.788 04:19:07 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:07:28.788 04:19:07 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:28.788 04:19:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:28.788 04:19:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.788 04:19:07 -- common/autotest_common.sh@10 -- # set +x 00:07:28.788 ************************************ 00:07:28.788 START TEST nvmf_tcp 00:07:28.788 ************************************ 00:07:28.788 04:19:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:28.788 * Looking for test storage... 00:07:28.788 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:28.788 04:19:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:28.788 04:19:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:28.788 04:19:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:29.048 04:19:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:29.048 04:19:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:29.048 04:19:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:29.048 04:19:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:29.048 04:19:08 -- scripts/common.sh@335 -- # IFS=.-: 00:07:29.048 04:19:08 -- scripts/common.sh@335 -- # read -ra ver1 00:07:29.048 04:19:08 -- scripts/common.sh@336 -- # IFS=.-: 00:07:29.048 04:19:08 -- scripts/common.sh@336 -- # read -ra ver2 00:07:29.048 04:19:08 -- scripts/common.sh@337 -- # local 'op=<' 00:07:29.048 04:19:08 -- scripts/common.sh@339 -- # ver1_l=2 00:07:29.048 04:19:08 -- scripts/common.sh@340 -- # ver2_l=1 00:07:29.048 04:19:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:29.048 04:19:08 -- scripts/common.sh@343 -- # case "$op" in 00:07:29.048 04:19:08 -- scripts/common.sh@344 -- # : 1 00:07:29.048 04:19:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:29.048 04:19:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:29.048 04:19:08 -- scripts/common.sh@364 -- # decimal 1 00:07:29.048 04:19:08 -- scripts/common.sh@352 -- # local d=1 00:07:29.048 04:19:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:29.048 04:19:08 -- scripts/common.sh@354 -- # echo 1 00:07:29.048 04:19:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:29.048 04:19:08 -- scripts/common.sh@365 -- # decimal 2 00:07:29.048 04:19:08 -- scripts/common.sh@352 -- # local d=2 00:07:29.048 04:19:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:29.048 04:19:08 -- scripts/common.sh@354 -- # echo 2 00:07:29.048 04:19:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:29.048 04:19:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:29.048 04:19:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:29.048 04:19:08 -- scripts/common.sh@367 -- # return 0 00:07:29.048 04:19:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:29.048 04:19:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:29.048 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.048 --rc genhtml_branch_coverage=1 00:07:29.048 --rc genhtml_function_coverage=1 00:07:29.048 --rc genhtml_legend=1 00:07:29.048 --rc geninfo_all_blocks=1 00:07:29.048 --rc geninfo_unexecuted_blocks=1 00:07:29.048 00:07:29.048 ' 00:07:29.048 04:19:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:29.048 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.048 --rc genhtml_branch_coverage=1 00:07:29.048 --rc genhtml_function_coverage=1 00:07:29.048 --rc genhtml_legend=1 00:07:29.048 --rc geninfo_all_blocks=1 00:07:29.048 --rc geninfo_unexecuted_blocks=1 00:07:29.048 00:07:29.048 ' 00:07:29.048 04:19:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:29.048 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.048 --rc genhtml_branch_coverage=1 00:07:29.048 --rc genhtml_function_coverage=1 00:07:29.048 --rc genhtml_legend=1 00:07:29.048 --rc geninfo_all_blocks=1 00:07:29.048 --rc geninfo_unexecuted_blocks=1 00:07:29.048 00:07:29.048 ' 00:07:29.048 04:19:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:29.048 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.048 --rc genhtml_branch_coverage=1 00:07:29.048 --rc genhtml_function_coverage=1 00:07:29.048 --rc genhtml_legend=1 00:07:29.048 --rc geninfo_all_blocks=1 00:07:29.048 --rc geninfo_unexecuted_blocks=1 00:07:29.048 00:07:29.048 ' 00:07:29.048 04:19:08 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:29.048 04:19:08 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:29.048 04:19:08 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:29.048 04:19:08 -- nvmf/common.sh@7 -- # uname -s 00:07:29.048 04:19:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:29.048 04:19:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:29.048 04:19:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:29.048 04:19:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:29.048 04:19:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:29.048 04:19:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:29.048 04:19:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:29.048 04:19:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:29.048 04:19:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:29.048 04:19:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:29.048 04:19:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:29.048 04:19:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:29.048 04:19:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:29.048 04:19:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:29.048 04:19:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:29.048 04:19:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:29.048 04:19:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:29.048 04:19:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:29.048 04:19:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:29.048 04:19:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.048 04:19:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.048 04:19:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.048 04:19:08 -- paths/export.sh@5 -- # export PATH 00:07:29.049 04:19:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.049 04:19:08 -- nvmf/common.sh@46 -- # : 0 00:07:29.049 04:19:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:29.049 04:19:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:29.049 04:19:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:29.049 04:19:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:29.049 04:19:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:29.049 04:19:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:29.049 04:19:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:29.049 04:19:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:29.049 04:19:08 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:29.049 04:19:08 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:29.049 04:19:08 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:29.049 04:19:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:29.049 04:19:08 -- common/autotest_common.sh@10 -- # set +x 00:07:29.049 04:19:08 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:29.049 04:19:08 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:29.049 04:19:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:29.049 04:19:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:29.049 04:19:08 -- common/autotest_common.sh@10 -- # set +x 00:07:29.049 ************************************ 00:07:29.049 START TEST nvmf_example 00:07:29.049 ************************************ 00:07:29.049 04:19:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:29.049 * Looking for test storage... 00:07:29.049 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:29.049 04:19:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:29.049 04:19:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:29.049 04:19:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:29.049 04:19:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:29.049 04:19:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:29.049 04:19:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:29.049 04:19:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:29.049 04:19:08 -- scripts/common.sh@335 -- # IFS=.-: 00:07:29.049 04:19:08 -- scripts/common.sh@335 -- # read -ra ver1 00:07:29.049 04:19:08 -- scripts/common.sh@336 -- # IFS=.-: 00:07:29.049 04:19:08 -- scripts/common.sh@336 -- # read -ra ver2 00:07:29.049 04:19:08 -- scripts/common.sh@337 -- # local 'op=<' 00:07:29.049 04:19:08 -- scripts/common.sh@339 -- # ver1_l=2 00:07:29.049 04:19:08 -- scripts/common.sh@340 -- # ver2_l=1 00:07:29.049 04:19:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:29.049 04:19:08 -- scripts/common.sh@343 -- # case "$op" in 00:07:29.049 04:19:08 -- scripts/common.sh@344 -- # : 1 00:07:29.049 04:19:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:29.049 04:19:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:29.049 04:19:08 -- scripts/common.sh@364 -- # decimal 1 00:07:29.049 04:19:08 -- scripts/common.sh@352 -- # local d=1 00:07:29.049 04:19:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:29.049 04:19:08 -- scripts/common.sh@354 -- # echo 1 00:07:29.049 04:19:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:29.049 04:19:08 -- scripts/common.sh@365 -- # decimal 2 00:07:29.049 04:19:08 -- scripts/common.sh@352 -- # local d=2 00:07:29.049 04:19:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:29.049 04:19:08 -- scripts/common.sh@354 -- # echo 2 00:07:29.049 04:19:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:29.049 04:19:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:29.049 04:19:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:29.049 04:19:08 -- scripts/common.sh@367 -- # return 0 00:07:29.049 04:19:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:29.049 04:19:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:29.049 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.049 --rc genhtml_branch_coverage=1 00:07:29.049 --rc genhtml_function_coverage=1 00:07:29.049 --rc genhtml_legend=1 00:07:29.049 --rc geninfo_all_blocks=1 00:07:29.049 --rc geninfo_unexecuted_blocks=1 00:07:29.049 00:07:29.049 ' 00:07:29.049 04:19:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:29.049 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.049 --rc genhtml_branch_coverage=1 00:07:29.049 --rc genhtml_function_coverage=1 00:07:29.049 --rc genhtml_legend=1 00:07:29.049 --rc geninfo_all_blocks=1 00:07:29.049 --rc geninfo_unexecuted_blocks=1 00:07:29.049 00:07:29.049 ' 00:07:29.049 04:19:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:29.049 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.049 --rc genhtml_branch_coverage=1 00:07:29.049 --rc genhtml_function_coverage=1 00:07:29.049 --rc genhtml_legend=1 00:07:29.049 --rc geninfo_all_blocks=1 00:07:29.049 --rc geninfo_unexecuted_blocks=1 00:07:29.049 00:07:29.049 ' 00:07:29.049 04:19:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:29.049 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.049 --rc genhtml_branch_coverage=1 00:07:29.049 --rc genhtml_function_coverage=1 00:07:29.049 --rc genhtml_legend=1 00:07:29.049 --rc geninfo_all_blocks=1 00:07:29.049 --rc geninfo_unexecuted_blocks=1 00:07:29.049 00:07:29.049 ' 00:07:29.049 04:19:08 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:29.049 04:19:08 -- nvmf/common.sh@7 -- # uname -s 00:07:29.049 04:19:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:29.049 04:19:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:29.049 04:19:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:29.049 04:19:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:29.049 04:19:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:29.049 04:19:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:29.049 04:19:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:29.049 04:19:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:29.049 04:19:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:29.049 04:19:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:29.049 04:19:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:29.049 04:19:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:29.049 04:19:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:29.049 04:19:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:29.049 04:19:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:29.049 04:19:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:29.049 04:19:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:29.049 04:19:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:29.049 04:19:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:29.049 04:19:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.049 04:19:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.049 04:19:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.049 04:19:08 -- paths/export.sh@5 -- # export PATH 00:07:29.049 04:19:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.049 04:19:08 -- nvmf/common.sh@46 -- # : 0 00:07:29.049 04:19:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:29.049 04:19:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:29.049 04:19:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:29.049 04:19:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:29.049 04:19:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:29.049 04:19:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:29.049 04:19:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:29.049 04:19:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:29.049 04:19:08 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:29.049 04:19:08 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:29.049 04:19:08 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:29.049 04:19:08 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:29.049 04:19:08 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:29.049 04:19:08 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:29.049 04:19:08 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:29.049 04:19:08 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:29.049 04:19:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:29.049 04:19:08 -- common/autotest_common.sh@10 -- # set +x 00:07:29.049 04:19:08 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:29.049 04:19:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:29.049 04:19:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:29.049 04:19:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:29.050 04:19:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:29.050 04:19:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:29.050 04:19:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:29.050 04:19:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:29.050 04:19:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:29.050 04:19:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:29.050 04:19:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:29.050 04:19:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:29.050 04:19:08 -- common/autotest_common.sh@10 -- # set +x 00:07:31.585 04:19:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:31.585 04:19:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:31.585 04:19:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:31.585 04:19:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:31.586 04:19:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:31.586 04:19:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:31.586 04:19:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:31.586 04:19:10 -- nvmf/common.sh@294 -- # net_devs=() 00:07:31.586 04:19:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:31.586 04:19:10 -- nvmf/common.sh@295 -- # e810=() 00:07:31.586 04:19:10 -- nvmf/common.sh@295 -- # local -ga e810 00:07:31.586 04:19:10 -- nvmf/common.sh@296 -- # x722=() 00:07:31.586 04:19:10 -- nvmf/common.sh@296 -- # local -ga x722 00:07:31.586 04:19:10 -- nvmf/common.sh@297 -- # mlx=() 00:07:31.586 04:19:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:31.586 04:19:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:31.586 04:19:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:31.586 04:19:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:31.586 04:19:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:31.586 04:19:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:31.586 04:19:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:31.586 04:19:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:31.586 04:19:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:31.586 04:19:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:31.586 04:19:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:31.586 04:19:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:31.586 04:19:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:31.586 04:19:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:31.586 04:19:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:31.586 04:19:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:31.586 04:19:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:31.586 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:31.586 04:19:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:31.586 04:19:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:31.586 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:31.586 04:19:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:31.586 04:19:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:31.586 04:19:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:31.586 04:19:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:31.586 04:19:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:31.586 04:19:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:31.586 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:31.586 04:19:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:31.586 04:19:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:31.586 04:19:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:31.586 04:19:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:31.586 04:19:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:31.586 04:19:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:31.586 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:31.586 04:19:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:31.586 04:19:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:31.586 04:19:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:31.586 04:19:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:31.586 04:19:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:31.586 04:19:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:31.586 04:19:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:31.586 04:19:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:31.586 04:19:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:31.586 04:19:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:31.586 04:19:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:31.586 04:19:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:31.586 04:19:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:31.586 04:19:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:31.586 04:19:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:31.586 04:19:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:31.586 04:19:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:31.586 04:19:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:31.586 04:19:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:31.586 04:19:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:31.586 04:19:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:31.586 04:19:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:31.586 04:19:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:31.586 04:19:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:31.586 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:31.586 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:07:31.586 00:07:31.586 --- 10.0.0.2 ping statistics --- 00:07:31.586 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:31.586 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:07:31.586 04:19:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:31.586 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:31.586 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:07:31.586 00:07:31.586 --- 10.0.0.1 ping statistics --- 00:07:31.586 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:31.586 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:07:31.586 04:19:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:31.586 04:19:10 -- nvmf/common.sh@410 -- # return 0 00:07:31.586 04:19:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:31.586 04:19:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:31.586 04:19:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:31.586 04:19:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:31.586 04:19:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:31.586 04:19:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:31.586 04:19:10 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:31.586 04:19:10 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:31.586 04:19:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:31.586 04:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:31.586 04:19:10 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:31.586 04:19:10 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:31.586 04:19:10 -- target/nvmf_example.sh@34 -- # nvmfpid=2809193 00:07:31.586 04:19:10 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:31.586 04:19:10 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:31.586 04:19:10 -- target/nvmf_example.sh@36 -- # waitforlisten 2809193 00:07:31.586 04:19:10 -- common/autotest_common.sh@829 -- # '[' -z 2809193 ']' 00:07:31.586 04:19:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:31.586 04:19:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:31.586 04:19:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:31.586 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:31.586 04:19:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:31.586 04:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:31.586 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.586 04:19:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:31.586 04:19:10 -- common/autotest_common.sh@862 -- # return 0 00:07:31.586 04:19:10 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:31.586 04:19:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:31.586 04:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:31.586 04:19:10 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:31.586 04:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.586 04:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:31.586 04:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.586 04:19:10 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:31.586 04:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.586 04:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:31.586 04:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.586 04:19:10 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:31.586 04:19:10 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:31.586 04:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.586 04:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:31.586 04:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.586 04:19:10 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:31.586 04:19:10 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:31.586 04:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.586 04:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:31.586 04:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.586 04:19:10 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:31.586 04:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:31.587 04:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:31.848 04:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:31.848 04:19:10 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:31.848 04:19:10 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:31.848 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.068 Initializing NVMe Controllers 00:07:44.068 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:07:44.068 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:07:44.068 Initialization complete. Launching workers. 00:07:44.068 ======================================================== 00:07:44.068 Latency(us) 00:07:44.068 Device Information : IOPS MiB/s Average min max 00:07:44.068 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15442.49 60.32 4144.17 554.95 40919.83 00:07:44.068 ======================================================== 00:07:44.068 Total : 15442.49 60.32 4144.17 554.95 40919.83 00:07:44.068 00:07:44.068 04:19:21 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:07:44.068 04:19:21 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:07:44.068 04:19:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:44.068 04:19:21 -- nvmf/common.sh@116 -- # sync 00:07:44.068 04:19:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:44.068 04:19:21 -- nvmf/common.sh@119 -- # set +e 00:07:44.068 04:19:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:44.068 04:19:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:44.068 rmmod nvme_tcp 00:07:44.068 rmmod nvme_fabrics 00:07:44.068 rmmod nvme_keyring 00:07:44.068 04:19:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:44.068 04:19:21 -- nvmf/common.sh@123 -- # set -e 00:07:44.068 04:19:21 -- nvmf/common.sh@124 -- # return 0 00:07:44.068 04:19:21 -- nvmf/common.sh@477 -- # '[' -n 2809193 ']' 00:07:44.068 04:19:21 -- nvmf/common.sh@478 -- # killprocess 2809193 00:07:44.068 04:19:21 -- common/autotest_common.sh@936 -- # '[' -z 2809193 ']' 00:07:44.068 04:19:21 -- common/autotest_common.sh@940 -- # kill -0 2809193 00:07:44.068 04:19:21 -- common/autotest_common.sh@941 -- # uname 00:07:44.068 04:19:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:44.068 04:19:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2809193 00:07:44.068 04:19:21 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:07:44.068 04:19:21 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:07:44.068 04:19:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2809193' 00:07:44.068 killing process with pid 2809193 00:07:44.068 04:19:21 -- common/autotest_common.sh@955 -- # kill 2809193 00:07:44.068 04:19:21 -- common/autotest_common.sh@960 -- # wait 2809193 00:07:44.068 nvmf threads initialize successfully 00:07:44.068 bdev subsystem init successfully 00:07:44.068 created a nvmf target service 00:07:44.068 create targets's poll groups done 00:07:44.068 all subsystems of target started 00:07:44.068 nvmf target is running 00:07:44.068 all subsystems of target stopped 00:07:44.068 destroy targets's poll groups done 00:07:44.068 destroyed the nvmf target service 00:07:44.068 bdev subsystem finish successfully 00:07:44.068 nvmf threads destroy successfully 00:07:44.068 04:19:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:44.068 04:19:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:44.068 04:19:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:44.068 04:19:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:44.068 04:19:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:44.068 04:19:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:44.068 04:19:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:44.068 04:19:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:44.327 04:19:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:44.587 04:19:23 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:07:44.587 04:19:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:44.587 04:19:23 -- common/autotest_common.sh@10 -- # set +x 00:07:44.587 00:07:44.587 real 0m15.511s 00:07:44.587 user 0m42.953s 00:07:44.587 sys 0m3.276s 00:07:44.587 04:19:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:44.587 04:19:23 -- common/autotest_common.sh@10 -- # set +x 00:07:44.587 ************************************ 00:07:44.587 END TEST nvmf_example 00:07:44.587 ************************************ 00:07:44.587 04:19:23 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:44.587 04:19:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:44.587 04:19:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:44.587 04:19:23 -- common/autotest_common.sh@10 -- # set +x 00:07:44.587 ************************************ 00:07:44.587 START TEST nvmf_filesystem 00:07:44.587 ************************************ 00:07:44.587 04:19:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:44.587 * Looking for test storage... 00:07:44.587 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:44.587 04:19:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:44.587 04:19:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:44.587 04:19:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:44.587 04:19:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:44.587 04:19:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:44.587 04:19:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:44.587 04:19:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:44.587 04:19:23 -- scripts/common.sh@335 -- # IFS=.-: 00:07:44.587 04:19:23 -- scripts/common.sh@335 -- # read -ra ver1 00:07:44.587 04:19:23 -- scripts/common.sh@336 -- # IFS=.-: 00:07:44.587 04:19:23 -- scripts/common.sh@336 -- # read -ra ver2 00:07:44.587 04:19:23 -- scripts/common.sh@337 -- # local 'op=<' 00:07:44.587 04:19:23 -- scripts/common.sh@339 -- # ver1_l=2 00:07:44.587 04:19:23 -- scripts/common.sh@340 -- # ver2_l=1 00:07:44.587 04:19:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:44.587 04:19:23 -- scripts/common.sh@343 -- # case "$op" in 00:07:44.588 04:19:23 -- scripts/common.sh@344 -- # : 1 00:07:44.588 04:19:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:44.588 04:19:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:44.588 04:19:23 -- scripts/common.sh@364 -- # decimal 1 00:07:44.588 04:19:23 -- scripts/common.sh@352 -- # local d=1 00:07:44.588 04:19:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:44.588 04:19:23 -- scripts/common.sh@354 -- # echo 1 00:07:44.588 04:19:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:44.588 04:19:23 -- scripts/common.sh@365 -- # decimal 2 00:07:44.588 04:19:23 -- scripts/common.sh@352 -- # local d=2 00:07:44.588 04:19:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:44.588 04:19:23 -- scripts/common.sh@354 -- # echo 2 00:07:44.588 04:19:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:44.588 04:19:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:44.588 04:19:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:44.588 04:19:23 -- scripts/common.sh@367 -- # return 0 00:07:44.588 04:19:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:44.588 04:19:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:44.588 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:44.588 --rc genhtml_branch_coverage=1 00:07:44.588 --rc genhtml_function_coverage=1 00:07:44.588 --rc genhtml_legend=1 00:07:44.588 --rc geninfo_all_blocks=1 00:07:44.588 --rc geninfo_unexecuted_blocks=1 00:07:44.588 00:07:44.588 ' 00:07:44.588 04:19:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:44.588 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:44.588 --rc genhtml_branch_coverage=1 00:07:44.588 --rc genhtml_function_coverage=1 00:07:44.588 --rc genhtml_legend=1 00:07:44.588 --rc geninfo_all_blocks=1 00:07:44.588 --rc geninfo_unexecuted_blocks=1 00:07:44.588 00:07:44.588 ' 00:07:44.588 04:19:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:44.588 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:44.588 --rc genhtml_branch_coverage=1 00:07:44.588 --rc genhtml_function_coverage=1 00:07:44.588 --rc genhtml_legend=1 00:07:44.588 --rc geninfo_all_blocks=1 00:07:44.588 --rc geninfo_unexecuted_blocks=1 00:07:44.588 00:07:44.588 ' 00:07:44.588 04:19:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:44.588 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:44.588 --rc genhtml_branch_coverage=1 00:07:44.588 --rc genhtml_function_coverage=1 00:07:44.588 --rc genhtml_legend=1 00:07:44.588 --rc geninfo_all_blocks=1 00:07:44.588 --rc geninfo_unexecuted_blocks=1 00:07:44.588 00:07:44.588 ' 00:07:44.588 04:19:23 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:07:44.588 04:19:23 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:07:44.588 04:19:23 -- common/autotest_common.sh@34 -- # set -e 00:07:44.588 04:19:23 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:07:44.588 04:19:23 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:07:44.588 04:19:23 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:07:44.588 04:19:23 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:07:44.588 04:19:23 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:07:44.588 04:19:23 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:07:44.588 04:19:23 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:07:44.588 04:19:23 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:07:44.588 04:19:23 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:07:44.588 04:19:23 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:07:44.588 04:19:23 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:07:44.588 04:19:23 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:07:44.588 04:19:23 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:07:44.588 04:19:23 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:07:44.588 04:19:23 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:07:44.588 04:19:23 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:07:44.588 04:19:23 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:07:44.588 04:19:23 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:07:44.588 04:19:23 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:07:44.588 04:19:23 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:07:44.588 04:19:23 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:07:44.588 04:19:23 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:07:44.588 04:19:23 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:44.588 04:19:23 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:07:44.588 04:19:23 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:07:44.588 04:19:23 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:07:44.588 04:19:23 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:07:44.588 04:19:23 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:07:44.588 04:19:23 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:07:44.588 04:19:23 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:07:44.588 04:19:23 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:07:44.588 04:19:23 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:07:44.588 04:19:23 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:07:44.588 04:19:23 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:07:44.588 04:19:23 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:07:44.588 04:19:23 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:07:44.588 04:19:23 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:07:44.588 04:19:23 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:07:44.588 04:19:23 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:07:44.588 04:19:23 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:44.588 04:19:23 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:07:44.588 04:19:23 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:07:44.588 04:19:23 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:07:44.588 04:19:23 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:07:44.588 04:19:23 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:44.588 04:19:23 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:07:44.588 04:19:23 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:07:44.588 04:19:23 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:07:44.588 04:19:23 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:07:44.588 04:19:23 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:07:44.588 04:19:23 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:07:44.588 04:19:23 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:07:44.588 04:19:23 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:07:44.588 04:19:23 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:07:44.588 04:19:23 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:07:44.588 04:19:23 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:07:44.588 04:19:23 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:07:44.588 04:19:23 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:07:44.588 04:19:23 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:07:44.588 04:19:23 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:07:44.588 04:19:23 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:07:44.588 04:19:23 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:07:44.588 04:19:23 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:07:44.588 04:19:23 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:07:44.588 04:19:23 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:44.588 04:19:23 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:07:44.588 04:19:23 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:07:44.588 04:19:23 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:07:44.588 04:19:23 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:07:44.588 04:19:23 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:07:44.588 04:19:23 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:07:44.588 04:19:23 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:07:44.588 04:19:23 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:07:44.588 04:19:23 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:07:44.588 04:19:23 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:07:44.588 04:19:23 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:07:44.588 04:19:23 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:07:44.588 04:19:23 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:07:44.588 04:19:23 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:07:44.588 04:19:23 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:07:44.588 04:19:23 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:07:44.588 04:19:23 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:07:44.588 04:19:23 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:07:44.588 04:19:23 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:44.588 04:19:23 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:44.588 04:19:23 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:44.588 04:19:23 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:44.588 04:19:23 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:44.588 04:19:23 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:44.588 04:19:23 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:44.588 04:19:23 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:44.588 04:19:23 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:07:44.588 04:19:23 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:07:44.588 04:19:23 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:07:44.588 04:19:23 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:07:44.588 04:19:23 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:07:44.588 04:19:23 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:07:44.588 04:19:23 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:07:44.589 04:19:23 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:07:44.589 #define SPDK_CONFIG_H 00:07:44.589 #define SPDK_CONFIG_APPS 1 00:07:44.589 #define SPDK_CONFIG_ARCH native 00:07:44.589 #undef SPDK_CONFIG_ASAN 00:07:44.589 #undef SPDK_CONFIG_AVAHI 00:07:44.589 #undef SPDK_CONFIG_CET 00:07:44.589 #define SPDK_CONFIG_COVERAGE 1 00:07:44.589 #define SPDK_CONFIG_CROSS_PREFIX 00:07:44.589 #undef SPDK_CONFIG_CRYPTO 00:07:44.589 #undef SPDK_CONFIG_CRYPTO_MLX5 00:07:44.589 #undef SPDK_CONFIG_CUSTOMOCF 00:07:44.589 #undef SPDK_CONFIG_DAOS 00:07:44.589 #define SPDK_CONFIG_DAOS_DIR 00:07:44.589 #define SPDK_CONFIG_DEBUG 1 00:07:44.589 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:07:44.589 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:44.589 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:44.589 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:44.589 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:07:44.589 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:44.589 #define SPDK_CONFIG_EXAMPLES 1 00:07:44.589 #undef SPDK_CONFIG_FC 00:07:44.589 #define SPDK_CONFIG_FC_PATH 00:07:44.589 #define SPDK_CONFIG_FIO_PLUGIN 1 00:07:44.589 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:07:44.589 #undef SPDK_CONFIG_FUSE 00:07:44.589 #undef SPDK_CONFIG_FUZZER 00:07:44.589 #define SPDK_CONFIG_FUZZER_LIB 00:07:44.589 #undef SPDK_CONFIG_GOLANG 00:07:44.589 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:07:44.589 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:07:44.589 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:07:44.589 #undef SPDK_CONFIG_HAVE_LIBBSD 00:07:44.589 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:07:44.589 #define SPDK_CONFIG_IDXD 1 00:07:44.589 #define SPDK_CONFIG_IDXD_KERNEL 1 00:07:44.589 #undef SPDK_CONFIG_IPSEC_MB 00:07:44.589 #define SPDK_CONFIG_IPSEC_MB_DIR 00:07:44.589 #define SPDK_CONFIG_ISAL 1 00:07:44.589 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:07:44.589 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:07:44.589 #define SPDK_CONFIG_LIBDIR 00:07:44.589 #undef SPDK_CONFIG_LTO 00:07:44.589 #define SPDK_CONFIG_MAX_LCORES 00:07:44.589 #define SPDK_CONFIG_NVME_CUSE 1 00:07:44.589 #undef SPDK_CONFIG_OCF 00:07:44.589 #define SPDK_CONFIG_OCF_PATH 00:07:44.589 #define SPDK_CONFIG_OPENSSL_PATH 00:07:44.589 #undef SPDK_CONFIG_PGO_CAPTURE 00:07:44.589 #undef SPDK_CONFIG_PGO_USE 00:07:44.589 #define SPDK_CONFIG_PREFIX /usr/local 00:07:44.589 #undef SPDK_CONFIG_RAID5F 00:07:44.589 #undef SPDK_CONFIG_RBD 00:07:44.589 #define SPDK_CONFIG_RDMA 1 00:07:44.589 #define SPDK_CONFIG_RDMA_PROV verbs 00:07:44.589 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:07:44.589 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:07:44.589 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:07:44.589 #define SPDK_CONFIG_SHARED 1 00:07:44.589 #undef SPDK_CONFIG_SMA 00:07:44.589 #define SPDK_CONFIG_TESTS 1 00:07:44.589 #undef SPDK_CONFIG_TSAN 00:07:44.589 #define SPDK_CONFIG_UBLK 1 00:07:44.589 #define SPDK_CONFIG_UBSAN 1 00:07:44.589 #undef SPDK_CONFIG_UNIT_TESTS 00:07:44.589 #undef SPDK_CONFIG_URING 00:07:44.589 #define SPDK_CONFIG_URING_PATH 00:07:44.589 #undef SPDK_CONFIG_URING_ZNS 00:07:44.589 #undef SPDK_CONFIG_USDT 00:07:44.589 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:07:44.589 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:07:44.589 #define SPDK_CONFIG_VFIO_USER 1 00:07:44.589 #define SPDK_CONFIG_VFIO_USER_DIR 00:07:44.589 #define SPDK_CONFIG_VHOST 1 00:07:44.589 #define SPDK_CONFIG_VIRTIO 1 00:07:44.589 #undef SPDK_CONFIG_VTUNE 00:07:44.589 #define SPDK_CONFIG_VTUNE_DIR 00:07:44.589 #define SPDK_CONFIG_WERROR 1 00:07:44.589 #define SPDK_CONFIG_WPDK_DIR 00:07:44.589 #undef SPDK_CONFIG_XNVME 00:07:44.589 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:07:44.589 04:19:23 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:07:44.589 04:19:23 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:44.589 04:19:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:44.589 04:19:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:44.589 04:19:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:44.589 04:19:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.589 04:19:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.589 04:19:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.589 04:19:23 -- paths/export.sh@5 -- # export PATH 00:07:44.589 04:19:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.589 04:19:23 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:44.589 04:19:23 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:44.589 04:19:23 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:44.589 04:19:23 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:44.589 04:19:23 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:07:44.589 04:19:23 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:44.589 04:19:23 -- pm/common@16 -- # TEST_TAG=N/A 00:07:44.589 04:19:23 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:07:44.589 04:19:23 -- common/autotest_common.sh@52 -- # : 1 00:07:44.589 04:19:23 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:07:44.589 04:19:23 -- common/autotest_common.sh@56 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:07:44.589 04:19:23 -- common/autotest_common.sh@58 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:07:44.589 04:19:23 -- common/autotest_common.sh@60 -- # : 1 00:07:44.589 04:19:23 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:07:44.589 04:19:23 -- common/autotest_common.sh@62 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:07:44.589 04:19:23 -- common/autotest_common.sh@64 -- # : 00:07:44.589 04:19:23 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:07:44.589 04:19:23 -- common/autotest_common.sh@66 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:07:44.589 04:19:23 -- common/autotest_common.sh@68 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:07:44.589 04:19:23 -- common/autotest_common.sh@70 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:07:44.589 04:19:23 -- common/autotest_common.sh@72 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:07:44.589 04:19:23 -- common/autotest_common.sh@74 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:07:44.589 04:19:23 -- common/autotest_common.sh@76 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:07:44.589 04:19:23 -- common/autotest_common.sh@78 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:07:44.589 04:19:23 -- common/autotest_common.sh@80 -- # : 1 00:07:44.589 04:19:23 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:07:44.589 04:19:23 -- common/autotest_common.sh@82 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:07:44.589 04:19:23 -- common/autotest_common.sh@84 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:07:44.589 04:19:23 -- common/autotest_common.sh@86 -- # : 1 00:07:44.589 04:19:23 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:07:44.589 04:19:23 -- common/autotest_common.sh@88 -- # : 1 00:07:44.589 04:19:23 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:07:44.589 04:19:23 -- common/autotest_common.sh@90 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:07:44.589 04:19:23 -- common/autotest_common.sh@92 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:07:44.589 04:19:23 -- common/autotest_common.sh@94 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:07:44.589 04:19:23 -- common/autotest_common.sh@96 -- # : tcp 00:07:44.589 04:19:23 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:07:44.589 04:19:23 -- common/autotest_common.sh@98 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:07:44.589 04:19:23 -- common/autotest_common.sh@100 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:07:44.589 04:19:23 -- common/autotest_common.sh@102 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:07:44.589 04:19:23 -- common/autotest_common.sh@104 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:07:44.589 04:19:23 -- common/autotest_common.sh@106 -- # : 0 00:07:44.589 04:19:23 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:07:44.589 04:19:23 -- common/autotest_common.sh@108 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:07:44.590 04:19:23 -- common/autotest_common.sh@110 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:07:44.590 04:19:23 -- common/autotest_common.sh@112 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:07:44.590 04:19:23 -- common/autotest_common.sh@114 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:07:44.590 04:19:23 -- common/autotest_common.sh@116 -- # : 1 00:07:44.590 04:19:23 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:07:44.590 04:19:23 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:44.590 04:19:23 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:07:44.590 04:19:23 -- common/autotest_common.sh@120 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:07:44.590 04:19:23 -- common/autotest_common.sh@122 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:07:44.590 04:19:23 -- common/autotest_common.sh@124 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:07:44.590 04:19:23 -- common/autotest_common.sh@126 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:07:44.590 04:19:23 -- common/autotest_common.sh@128 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:07:44.590 04:19:23 -- common/autotest_common.sh@130 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:07:44.590 04:19:23 -- common/autotest_common.sh@132 -- # : v22.11.4 00:07:44.590 04:19:23 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:07:44.590 04:19:23 -- common/autotest_common.sh@134 -- # : true 00:07:44.590 04:19:23 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:07:44.590 04:19:23 -- common/autotest_common.sh@136 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:07:44.590 04:19:23 -- common/autotest_common.sh@138 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:07:44.590 04:19:23 -- common/autotest_common.sh@140 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:07:44.590 04:19:23 -- common/autotest_common.sh@142 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:07:44.590 04:19:23 -- common/autotest_common.sh@144 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:07:44.590 04:19:23 -- common/autotest_common.sh@146 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:07:44.590 04:19:23 -- common/autotest_common.sh@148 -- # : e810 00:07:44.590 04:19:23 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:07:44.590 04:19:23 -- common/autotest_common.sh@150 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:07:44.590 04:19:23 -- common/autotest_common.sh@152 -- # : 0 00:07:44.590 04:19:23 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:07:44.852 04:19:23 -- common/autotest_common.sh@154 -- # : 0 00:07:44.852 04:19:23 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:07:44.852 04:19:23 -- common/autotest_common.sh@156 -- # : 0 00:07:44.852 04:19:23 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:07:44.852 04:19:23 -- common/autotest_common.sh@158 -- # : 0 00:07:44.852 04:19:23 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:07:44.852 04:19:23 -- common/autotest_common.sh@160 -- # : 0 00:07:44.852 04:19:23 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:07:44.852 04:19:23 -- common/autotest_common.sh@163 -- # : 00:07:44.852 04:19:23 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:07:44.852 04:19:23 -- common/autotest_common.sh@165 -- # : 0 00:07:44.852 04:19:23 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:07:44.852 04:19:23 -- common/autotest_common.sh@167 -- # : 0 00:07:44.852 04:19:23 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:07:44.852 04:19:23 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:44.852 04:19:23 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:44.852 04:19:23 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:44.852 04:19:23 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:44.852 04:19:23 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:44.852 04:19:23 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:44.852 04:19:23 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:44.852 04:19:23 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:44.852 04:19:23 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:07:44.852 04:19:23 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:07:44.852 04:19:23 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:44.852 04:19:23 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:44.852 04:19:23 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:07:44.852 04:19:23 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:07:44.852 04:19:23 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:44.852 04:19:23 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:44.852 04:19:23 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:44.852 04:19:23 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:44.852 04:19:23 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:07:44.852 04:19:23 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:07:44.852 04:19:23 -- common/autotest_common.sh@196 -- # cat 00:07:44.853 04:19:23 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:07:44.853 04:19:23 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:44.853 04:19:23 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:44.853 04:19:23 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:44.853 04:19:23 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:44.853 04:19:23 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:07:44.853 04:19:23 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:07:44.853 04:19:23 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:44.853 04:19:23 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:44.853 04:19:23 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:44.853 04:19:23 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:44.853 04:19:23 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:44.853 04:19:23 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:44.853 04:19:23 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:44.853 04:19:23 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:44.853 04:19:23 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:44.853 04:19:23 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:44.853 04:19:23 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:44.853 04:19:23 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:44.853 04:19:23 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:07:44.853 04:19:23 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:07:44.853 04:19:23 -- common/autotest_common.sh@249 -- # _LCOV= 00:07:44.853 04:19:23 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:07:44.853 04:19:23 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:07:44.853 04:19:23 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:07:44.853 04:19:23 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:07:44.853 04:19:23 -- common/autotest_common.sh@255 -- # lcov_opt= 00:07:44.853 04:19:23 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:07:44.853 04:19:23 -- common/autotest_common.sh@259 -- # export valgrind= 00:07:44.853 04:19:23 -- common/autotest_common.sh@259 -- # valgrind= 00:07:44.853 04:19:23 -- common/autotest_common.sh@265 -- # uname -s 00:07:44.853 04:19:23 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:07:44.853 04:19:23 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:07:44.853 04:19:23 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:07:44.853 04:19:23 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:07:44.853 04:19:23 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:07:44.853 04:19:23 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:07:44.853 04:19:23 -- common/autotest_common.sh@275 -- # MAKE=make 00:07:44.853 04:19:23 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:07:44.853 04:19:23 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:07:44.853 04:19:23 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:07:44.853 04:19:23 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:07:44.853 04:19:23 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:07:44.853 04:19:23 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:07:44.853 04:19:23 -- common/autotest_common.sh@301 -- # for i in "$@" 00:07:44.853 04:19:23 -- common/autotest_common.sh@302 -- # case "$i" in 00:07:44.853 04:19:23 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:07:44.853 04:19:23 -- common/autotest_common.sh@319 -- # [[ -z 2810839 ]] 00:07:44.853 04:19:23 -- common/autotest_common.sh@319 -- # kill -0 2810839 00:07:44.853 04:19:23 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:07:44.853 04:19:23 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:07:44.853 04:19:23 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:07:44.853 04:19:23 -- common/autotest_common.sh@332 -- # local mount target_dir 00:07:44.853 04:19:23 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:07:44.853 04:19:23 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:07:44.853 04:19:23 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:07:44.853 04:19:23 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:07:44.853 04:19:23 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.5r9C1f 00:07:44.853 04:19:23 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:07:44.853 04:19:23 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:07:44.853 04:19:23 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:07:44.853 04:19:23 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.5r9C1f/tests/target /tmp/spdk.5r9C1f 00:07:44.853 04:19:23 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:07:44.853 04:19:23 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:44.853 04:19:23 -- common/autotest_common.sh@328 -- # df -T 00:07:44.853 04:19:23 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:07:44.853 04:19:23 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:07:44.853 04:19:23 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:07:44.853 04:19:23 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:07:44.853 04:19:23 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # avails["$mount"]=53323902976 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988515840 00:07:44.853 04:19:23 -- common/autotest_common.sh@364 -- # uses["$mount"]=8664612864 00:07:44.853 04:19:23 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991663104 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994255872 00:07:44.853 04:19:23 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:07:44.853 04:19:23 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:07:44.853 04:19:23 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:07:44.853 04:19:23 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993272832 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:07:44.853 04:19:23 -- common/autotest_common.sh@364 -- # uses["$mount"]=987136 00:07:44.853 04:19:23 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:44.853 04:19:23 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:07:44.853 04:19:23 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:07:44.853 04:19:23 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:07:44.853 04:19:23 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:44.853 04:19:23 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:07:44.853 * Looking for test storage... 00:07:44.853 04:19:23 -- common/autotest_common.sh@369 -- # local target_space new_size 00:07:44.853 04:19:23 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:07:44.853 04:19:23 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:44.853 04:19:23 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:07:44.853 04:19:23 -- common/autotest_common.sh@373 -- # mount=/ 00:07:44.853 04:19:23 -- common/autotest_common.sh@375 -- # target_space=53323902976 00:07:44.853 04:19:23 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:07:44.853 04:19:23 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:07:44.853 04:19:23 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:07:44.853 04:19:23 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:07:44.853 04:19:23 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:07:44.853 04:19:23 -- common/autotest_common.sh@382 -- # new_size=10879205376 00:07:44.853 04:19:23 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:07:44.853 04:19:23 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:44.853 04:19:23 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:44.853 04:19:23 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:44.853 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:44.853 04:19:23 -- common/autotest_common.sh@390 -- # return 0 00:07:44.853 04:19:23 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:07:44.853 04:19:23 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:07:44.853 04:19:23 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:07:44.854 04:19:23 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:07:44.854 04:19:23 -- common/autotest_common.sh@1682 -- # true 00:07:44.854 04:19:23 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:07:44.854 04:19:23 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:07:44.854 04:19:23 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:07:44.854 04:19:23 -- common/autotest_common.sh@27 -- # exec 00:07:44.854 04:19:23 -- common/autotest_common.sh@29 -- # exec 00:07:44.854 04:19:23 -- common/autotest_common.sh@31 -- # xtrace_restore 00:07:44.854 04:19:23 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:07:44.854 04:19:23 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:07:44.854 04:19:23 -- common/autotest_common.sh@18 -- # set -x 00:07:44.854 04:19:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:44.854 04:19:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:44.854 04:19:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:44.854 04:19:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:44.854 04:19:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:44.854 04:19:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:44.854 04:19:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:44.854 04:19:23 -- scripts/common.sh@335 -- # IFS=.-: 00:07:44.854 04:19:23 -- scripts/common.sh@335 -- # read -ra ver1 00:07:44.854 04:19:23 -- scripts/common.sh@336 -- # IFS=.-: 00:07:44.854 04:19:23 -- scripts/common.sh@336 -- # read -ra ver2 00:07:44.854 04:19:23 -- scripts/common.sh@337 -- # local 'op=<' 00:07:44.854 04:19:23 -- scripts/common.sh@339 -- # ver1_l=2 00:07:44.854 04:19:23 -- scripts/common.sh@340 -- # ver2_l=1 00:07:44.854 04:19:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:44.854 04:19:23 -- scripts/common.sh@343 -- # case "$op" in 00:07:44.854 04:19:23 -- scripts/common.sh@344 -- # : 1 00:07:44.854 04:19:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:44.854 04:19:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:44.854 04:19:23 -- scripts/common.sh@364 -- # decimal 1 00:07:44.854 04:19:23 -- scripts/common.sh@352 -- # local d=1 00:07:44.854 04:19:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:44.854 04:19:23 -- scripts/common.sh@354 -- # echo 1 00:07:44.854 04:19:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:44.854 04:19:23 -- scripts/common.sh@365 -- # decimal 2 00:07:44.854 04:19:23 -- scripts/common.sh@352 -- # local d=2 00:07:44.854 04:19:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:44.854 04:19:23 -- scripts/common.sh@354 -- # echo 2 00:07:44.854 04:19:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:44.854 04:19:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:44.854 04:19:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:44.854 04:19:23 -- scripts/common.sh@367 -- # return 0 00:07:44.854 04:19:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:44.854 04:19:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:44.854 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:44.854 --rc genhtml_branch_coverage=1 00:07:44.854 --rc genhtml_function_coverage=1 00:07:44.854 --rc genhtml_legend=1 00:07:44.854 --rc geninfo_all_blocks=1 00:07:44.854 --rc geninfo_unexecuted_blocks=1 00:07:44.854 00:07:44.854 ' 00:07:44.854 04:19:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:44.854 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:44.854 --rc genhtml_branch_coverage=1 00:07:44.854 --rc genhtml_function_coverage=1 00:07:44.854 --rc genhtml_legend=1 00:07:44.854 --rc geninfo_all_blocks=1 00:07:44.854 --rc geninfo_unexecuted_blocks=1 00:07:44.854 00:07:44.854 ' 00:07:44.854 04:19:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:44.854 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:44.854 --rc genhtml_branch_coverage=1 00:07:44.854 --rc genhtml_function_coverage=1 00:07:44.854 --rc genhtml_legend=1 00:07:44.854 --rc geninfo_all_blocks=1 00:07:44.854 --rc geninfo_unexecuted_blocks=1 00:07:44.854 00:07:44.854 ' 00:07:44.854 04:19:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:44.854 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:44.854 --rc genhtml_branch_coverage=1 00:07:44.854 --rc genhtml_function_coverage=1 00:07:44.854 --rc genhtml_legend=1 00:07:44.854 --rc geninfo_all_blocks=1 00:07:44.854 --rc geninfo_unexecuted_blocks=1 00:07:44.854 00:07:44.854 ' 00:07:44.854 04:19:23 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:44.854 04:19:23 -- nvmf/common.sh@7 -- # uname -s 00:07:44.854 04:19:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:44.854 04:19:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:44.854 04:19:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:44.854 04:19:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:44.854 04:19:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:44.854 04:19:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:44.854 04:19:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:44.854 04:19:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:44.854 04:19:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:44.854 04:19:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:44.854 04:19:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:44.854 04:19:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:44.854 04:19:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:44.854 04:19:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:44.854 04:19:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:44.854 04:19:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:44.854 04:19:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:44.854 04:19:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:44.854 04:19:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:44.854 04:19:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.854 04:19:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.854 04:19:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.854 04:19:23 -- paths/export.sh@5 -- # export PATH 00:07:44.854 04:19:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.854 04:19:23 -- nvmf/common.sh@46 -- # : 0 00:07:44.854 04:19:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:44.854 04:19:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:44.854 04:19:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:44.854 04:19:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:44.854 04:19:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:44.854 04:19:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:44.854 04:19:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:44.854 04:19:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:44.854 04:19:23 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:07:44.854 04:19:23 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:07:44.854 04:19:23 -- target/filesystem.sh@15 -- # nvmftestinit 00:07:44.854 04:19:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:44.854 04:19:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:44.854 04:19:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:44.854 04:19:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:44.854 04:19:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:44.854 04:19:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:44.854 04:19:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:44.854 04:19:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:44.854 04:19:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:44.854 04:19:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:44.854 04:19:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:44.854 04:19:23 -- common/autotest_common.sh@10 -- # set +x 00:07:47.459 04:19:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:47.459 04:19:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:47.459 04:19:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:47.459 04:19:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:47.459 04:19:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:47.459 04:19:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:47.459 04:19:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:47.459 04:19:26 -- nvmf/common.sh@294 -- # net_devs=() 00:07:47.459 04:19:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:47.459 04:19:26 -- nvmf/common.sh@295 -- # e810=() 00:07:47.459 04:19:26 -- nvmf/common.sh@295 -- # local -ga e810 00:07:47.459 04:19:26 -- nvmf/common.sh@296 -- # x722=() 00:07:47.459 04:19:26 -- nvmf/common.sh@296 -- # local -ga x722 00:07:47.459 04:19:26 -- nvmf/common.sh@297 -- # mlx=() 00:07:47.459 04:19:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:47.459 04:19:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:47.459 04:19:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:47.459 04:19:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:47.459 04:19:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:47.459 04:19:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:47.459 04:19:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:47.459 04:19:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:47.459 04:19:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:47.459 04:19:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:47.459 04:19:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:47.459 04:19:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:47.459 04:19:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:47.459 04:19:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:47.459 04:19:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:47.459 04:19:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:47.459 04:19:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:47.459 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:47.459 04:19:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:47.459 04:19:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:47.459 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:47.459 04:19:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:47.459 04:19:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:47.459 04:19:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:47.459 04:19:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:47.459 04:19:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:47.459 04:19:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:47.459 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:47.459 04:19:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:47.459 04:19:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:47.459 04:19:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:47.459 04:19:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:47.459 04:19:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:47.459 04:19:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:47.459 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:47.459 04:19:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:47.459 04:19:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:47.459 04:19:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:47.459 04:19:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:47.459 04:19:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:47.459 04:19:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:47.459 04:19:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:47.459 04:19:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:47.459 04:19:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:47.459 04:19:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:47.459 04:19:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:47.459 04:19:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:47.459 04:19:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:47.459 04:19:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:47.459 04:19:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:47.459 04:19:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:47.459 04:19:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:47.459 04:19:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:47.459 04:19:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:47.459 04:19:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:47.459 04:19:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:47.459 04:19:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:47.459 04:19:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:47.459 04:19:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:47.459 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:47.459 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.199 ms 00:07:47.459 00:07:47.459 --- 10.0.0.2 ping statistics --- 00:07:47.459 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:47.459 rtt min/avg/max/mdev = 0.199/0.199/0.199/0.000 ms 00:07:47.459 04:19:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:47.459 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:47.459 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:07:47.459 00:07:47.459 --- 10.0.0.1 ping statistics --- 00:07:47.459 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:47.459 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:07:47.459 04:19:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:47.459 04:19:26 -- nvmf/common.sh@410 -- # return 0 00:07:47.459 04:19:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:47.459 04:19:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:47.459 04:19:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:47.459 04:19:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:47.459 04:19:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:47.459 04:19:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:47.459 04:19:26 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:47.459 04:19:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:47.459 04:19:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.459 04:19:26 -- common/autotest_common.sh@10 -- # set +x 00:07:47.459 ************************************ 00:07:47.459 START TEST nvmf_filesystem_no_in_capsule 00:07:47.459 ************************************ 00:07:47.459 04:19:26 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:07:47.459 04:19:26 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:47.459 04:19:26 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:47.459 04:19:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:47.459 04:19:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:47.459 04:19:26 -- common/autotest_common.sh@10 -- # set +x 00:07:47.459 04:19:26 -- nvmf/common.sh@469 -- # nvmfpid=2812525 00:07:47.459 04:19:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:47.459 04:19:26 -- nvmf/common.sh@470 -- # waitforlisten 2812525 00:07:47.459 04:19:26 -- common/autotest_common.sh@829 -- # '[' -z 2812525 ']' 00:07:47.459 04:19:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:47.459 04:19:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:47.459 04:19:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:47.459 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:47.459 04:19:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:47.459 04:19:26 -- common/autotest_common.sh@10 -- # set +x 00:07:47.459 [2024-11-26 04:19:26.305557] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:47.459 [2024-11-26 04:19:26.305635] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:47.459 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.459 [2024-11-26 04:19:26.381231] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:47.460 [2024-11-26 04:19:26.480098] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:47.460 [2024-11-26 04:19:26.480276] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:47.460 [2024-11-26 04:19:26.480295] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:47.460 [2024-11-26 04:19:26.480309] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:47.460 [2024-11-26 04:19:26.480368] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:47.460 [2024-11-26 04:19:26.480424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:47.460 [2024-11-26 04:19:26.480478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:47.460 [2024-11-26 04:19:26.480480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.394 04:19:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:48.394 04:19:27 -- common/autotest_common.sh@862 -- # return 0 00:07:48.394 04:19:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:48.394 04:19:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:48.394 04:19:27 -- common/autotest_common.sh@10 -- # set +x 00:07:48.394 04:19:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:48.394 04:19:27 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:48.394 04:19:27 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:48.394 04:19:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.394 04:19:27 -- common/autotest_common.sh@10 -- # set +x 00:07:48.394 [2024-11-26 04:19:27.344437] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:48.394 04:19:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.394 04:19:27 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:48.394 04:19:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.394 04:19:27 -- common/autotest_common.sh@10 -- # set +x 00:07:48.394 Malloc1 00:07:48.394 04:19:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.394 04:19:27 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:48.394 04:19:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.394 04:19:27 -- common/autotest_common.sh@10 -- # set +x 00:07:48.394 04:19:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.394 04:19:27 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:48.394 04:19:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.394 04:19:27 -- common/autotest_common.sh@10 -- # set +x 00:07:48.394 04:19:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.394 04:19:27 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:48.394 04:19:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.394 04:19:27 -- common/autotest_common.sh@10 -- # set +x 00:07:48.394 [2024-11-26 04:19:27.525314] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:48.394 04:19:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.394 04:19:27 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:48.394 04:19:27 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:48.394 04:19:27 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:48.394 04:19:27 -- common/autotest_common.sh@1369 -- # local bs 00:07:48.394 04:19:27 -- common/autotest_common.sh@1370 -- # local nb 00:07:48.394 04:19:27 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:48.394 04:19:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.394 04:19:27 -- common/autotest_common.sh@10 -- # set +x 00:07:48.394 04:19:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.394 04:19:27 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:48.394 { 00:07:48.394 "name": "Malloc1", 00:07:48.394 "aliases": [ 00:07:48.394 "d9a7122c-ad19-4ba5-af38-b2a08850c0d6" 00:07:48.394 ], 00:07:48.394 "product_name": "Malloc disk", 00:07:48.394 "block_size": 512, 00:07:48.394 "num_blocks": 1048576, 00:07:48.394 "uuid": "d9a7122c-ad19-4ba5-af38-b2a08850c0d6", 00:07:48.394 "assigned_rate_limits": { 00:07:48.394 "rw_ios_per_sec": 0, 00:07:48.394 "rw_mbytes_per_sec": 0, 00:07:48.394 "r_mbytes_per_sec": 0, 00:07:48.394 "w_mbytes_per_sec": 0 00:07:48.394 }, 00:07:48.394 "claimed": true, 00:07:48.394 "claim_type": "exclusive_write", 00:07:48.394 "zoned": false, 00:07:48.394 "supported_io_types": { 00:07:48.394 "read": true, 00:07:48.394 "write": true, 00:07:48.394 "unmap": true, 00:07:48.394 "write_zeroes": true, 00:07:48.394 "flush": true, 00:07:48.394 "reset": true, 00:07:48.394 "compare": false, 00:07:48.394 "compare_and_write": false, 00:07:48.394 "abort": true, 00:07:48.394 "nvme_admin": false, 00:07:48.394 "nvme_io": false 00:07:48.394 }, 00:07:48.394 "memory_domains": [ 00:07:48.394 { 00:07:48.394 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:48.394 "dma_device_type": 2 00:07:48.394 } 00:07:48.394 ], 00:07:48.394 "driver_specific": {} 00:07:48.394 } 00:07:48.394 ]' 00:07:48.394 04:19:27 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:48.394 04:19:27 -- common/autotest_common.sh@1372 -- # bs=512 00:07:48.394 04:19:27 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:48.653 04:19:27 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:48.653 04:19:27 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:48.653 04:19:27 -- common/autotest_common.sh@1377 -- # echo 512 00:07:48.653 04:19:27 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:48.653 04:19:27 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:49.222 04:19:28 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:49.222 04:19:28 -- common/autotest_common.sh@1187 -- # local i=0 00:07:49.222 04:19:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:49.222 04:19:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:49.222 04:19:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:51.135 04:19:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:51.135 04:19:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:51.135 04:19:30 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:51.135 04:19:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:51.135 04:19:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:51.135 04:19:30 -- common/autotest_common.sh@1197 -- # return 0 00:07:51.135 04:19:30 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:51.135 04:19:30 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:51.135 04:19:30 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:51.135 04:19:30 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:51.135 04:19:30 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:51.135 04:19:30 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:51.135 04:19:30 -- setup/common.sh@80 -- # echo 536870912 00:07:51.135 04:19:30 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:51.135 04:19:30 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:51.135 04:19:30 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:51.135 04:19:30 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:51.395 04:19:30 -- target/filesystem.sh@69 -- # partprobe 00:07:51.964 04:19:30 -- target/filesystem.sh@70 -- # sleep 1 00:07:52.902 04:19:31 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:52.902 04:19:31 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:52.902 04:19:31 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:52.902 04:19:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:52.902 04:19:31 -- common/autotest_common.sh@10 -- # set +x 00:07:52.902 ************************************ 00:07:52.902 START TEST filesystem_ext4 00:07:52.902 ************************************ 00:07:52.902 04:19:31 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:52.902 04:19:31 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:52.902 04:19:31 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:52.902 04:19:31 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:52.902 04:19:31 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:52.902 04:19:31 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:52.902 04:19:31 -- common/autotest_common.sh@914 -- # local i=0 00:07:52.902 04:19:31 -- common/autotest_common.sh@915 -- # local force 00:07:52.902 04:19:31 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:52.902 04:19:31 -- common/autotest_common.sh@918 -- # force=-F 00:07:52.902 04:19:31 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:52.902 mke2fs 1.47.0 (5-Feb-2023) 00:07:52.902 Discarding device blocks: 0/522240 done 00:07:52.902 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:52.902 Filesystem UUID: ed8fa4ef-18ca-4666-8453-5fc7e7389362 00:07:52.902 Superblock backups stored on blocks: 00:07:52.902 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:52.902 00:07:52.902 Allocating group tables: 0/64 done 00:07:52.902 Writing inode tables: 0/64 done 00:07:52.902 Creating journal (8192 blocks): done 00:07:53.161 Writing superblocks and filesystem accounting information: 0/64 done 00:07:53.161 00:07:53.161 04:19:32 -- common/autotest_common.sh@931 -- # return 0 00:07:53.161 04:19:32 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:58.440 04:19:37 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:58.440 04:19:37 -- target/filesystem.sh@25 -- # sync 00:07:58.440 04:19:37 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:58.440 04:19:37 -- target/filesystem.sh@27 -- # sync 00:07:58.440 04:19:37 -- target/filesystem.sh@29 -- # i=0 00:07:58.440 04:19:37 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:58.440 04:19:37 -- target/filesystem.sh@37 -- # kill -0 2812525 00:07:58.440 04:19:37 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:58.440 04:19:37 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:58.440 04:19:37 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:58.440 04:19:37 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:58.440 00:07:58.440 real 0m5.384s 00:07:58.440 user 0m0.017s 00:07:58.440 sys 0m0.068s 00:07:58.440 04:19:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:58.440 04:19:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.440 ************************************ 00:07:58.440 END TEST filesystem_ext4 00:07:58.440 ************************************ 00:07:58.440 04:19:37 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:58.440 04:19:37 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:58.440 04:19:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:58.440 04:19:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.440 ************************************ 00:07:58.440 START TEST filesystem_btrfs 00:07:58.440 ************************************ 00:07:58.440 04:19:37 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:58.440 04:19:37 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:58.440 04:19:37 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:58.440 04:19:37 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:58.440 04:19:37 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:58.440 04:19:37 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:58.440 04:19:37 -- common/autotest_common.sh@914 -- # local i=0 00:07:58.440 04:19:37 -- common/autotest_common.sh@915 -- # local force 00:07:58.440 04:19:37 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:58.440 04:19:37 -- common/autotest_common.sh@920 -- # force=-f 00:07:58.440 04:19:37 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:58.440 btrfs-progs v6.8.1 00:07:58.440 See https://btrfs.readthedocs.io for more information. 00:07:58.440 00:07:58.440 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:58.440 NOTE: several default settings have changed in version 5.15, please make sure 00:07:58.440 this does not affect your deployments: 00:07:58.440 - DUP for metadata (-m dup) 00:07:58.440 - enabled no-holes (-O no-holes) 00:07:58.440 - enabled free-space-tree (-R free-space-tree) 00:07:58.440 00:07:58.440 Label: (null) 00:07:58.440 UUID: 849cef00-f449-4a2b-a671-7730b3437734 00:07:58.440 Node size: 16384 00:07:58.440 Sector size: 4096 (CPU page size: 4096) 00:07:58.440 Filesystem size: 510.00MiB 00:07:58.440 Block group profiles: 00:07:58.440 Data: single 8.00MiB 00:07:58.440 Metadata: DUP 32.00MiB 00:07:58.440 System: DUP 8.00MiB 00:07:58.440 SSD detected: yes 00:07:58.440 Zoned device: no 00:07:58.440 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:58.440 Checksum: crc32c 00:07:58.440 Number of devices: 1 00:07:58.440 Devices: 00:07:58.440 ID SIZE PATH 00:07:58.440 1 510.00MiB /dev/nvme0n1p1 00:07:58.440 00:07:58.440 04:19:37 -- common/autotest_common.sh@931 -- # return 0 00:07:58.440 04:19:37 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:58.700 04:19:37 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:58.700 04:19:37 -- target/filesystem.sh@25 -- # sync 00:07:58.700 04:19:37 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:58.700 04:19:37 -- target/filesystem.sh@27 -- # sync 00:07:58.700 04:19:37 -- target/filesystem.sh@29 -- # i=0 00:07:58.700 04:19:37 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:58.700 04:19:37 -- target/filesystem.sh@37 -- # kill -0 2812525 00:07:58.700 04:19:37 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:58.700 04:19:37 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:58.700 04:19:37 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:58.700 04:19:37 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:58.700 00:07:58.700 real 0m0.483s 00:07:58.700 user 0m0.021s 00:07:58.700 sys 0m0.089s 00:07:58.700 04:19:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:58.700 04:19:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.700 ************************************ 00:07:58.700 END TEST filesystem_btrfs 00:07:58.700 ************************************ 00:07:58.700 04:19:37 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:58.700 04:19:37 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:58.700 04:19:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:58.700 04:19:37 -- common/autotest_common.sh@10 -- # set +x 00:07:58.700 ************************************ 00:07:58.700 START TEST filesystem_xfs 00:07:58.700 ************************************ 00:07:58.700 04:19:37 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:58.700 04:19:37 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:58.700 04:19:37 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:58.700 04:19:37 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:58.700 04:19:37 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:58.700 04:19:37 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:58.700 04:19:37 -- common/autotest_common.sh@914 -- # local i=0 00:07:58.700 04:19:37 -- common/autotest_common.sh@915 -- # local force 00:07:58.700 04:19:37 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:58.700 04:19:37 -- common/autotest_common.sh@920 -- # force=-f 00:07:58.700 04:19:37 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:58.960 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:58.960 = sectsz=512 attr=2, projid32bit=1 00:07:58.960 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:58.960 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:58.960 data = bsize=4096 blocks=130560, imaxpct=25 00:07:58.960 = sunit=0 swidth=0 blks 00:07:58.960 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:58.960 log =internal log bsize=4096 blocks=16384, version=2 00:07:58.960 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:58.960 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:59.528 Discarding blocks...Done. 00:07:59.528 04:19:38 -- common/autotest_common.sh@931 -- # return 0 00:07:59.528 04:19:38 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:02.067 04:19:40 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:02.067 04:19:41 -- target/filesystem.sh@25 -- # sync 00:08:02.067 04:19:41 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:02.067 04:19:41 -- target/filesystem.sh@27 -- # sync 00:08:02.067 04:19:41 -- target/filesystem.sh@29 -- # i=0 00:08:02.067 04:19:41 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:02.067 04:19:41 -- target/filesystem.sh@37 -- # kill -0 2812525 00:08:02.067 04:19:41 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:02.067 04:19:41 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:02.067 04:19:41 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:02.067 04:19:41 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:02.067 00:08:02.067 real 0m3.228s 00:08:02.067 user 0m0.010s 00:08:02.067 sys 0m0.072s 00:08:02.067 04:19:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:02.067 04:19:41 -- common/autotest_common.sh@10 -- # set +x 00:08:02.067 ************************************ 00:08:02.068 END TEST filesystem_xfs 00:08:02.068 ************************************ 00:08:02.068 04:19:41 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:02.068 04:19:41 -- target/filesystem.sh@93 -- # sync 00:08:02.068 04:19:41 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:02.068 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.068 04:19:41 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:02.068 04:19:41 -- common/autotest_common.sh@1208 -- # local i=0 00:08:02.068 04:19:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:02.068 04:19:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:02.068 04:19:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:02.068 04:19:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:02.068 04:19:41 -- common/autotest_common.sh@1220 -- # return 0 00:08:02.068 04:19:41 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:02.068 04:19:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:02.068 04:19:41 -- common/autotest_common.sh@10 -- # set +x 00:08:02.068 04:19:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:02.068 04:19:41 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:02.068 04:19:41 -- target/filesystem.sh@101 -- # killprocess 2812525 00:08:02.068 04:19:41 -- common/autotest_common.sh@936 -- # '[' -z 2812525 ']' 00:08:02.068 04:19:41 -- common/autotest_common.sh@940 -- # kill -0 2812525 00:08:02.068 04:19:41 -- common/autotest_common.sh@941 -- # uname 00:08:02.068 04:19:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:02.068 04:19:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2812525 00:08:02.068 04:19:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:02.068 04:19:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:02.068 04:19:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2812525' 00:08:02.068 killing process with pid 2812525 00:08:02.068 04:19:41 -- common/autotest_common.sh@955 -- # kill 2812525 00:08:02.068 04:19:41 -- common/autotest_common.sh@960 -- # wait 2812525 00:08:02.636 04:19:41 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:02.636 00:08:02.636 real 0m15.490s 00:08:02.636 user 0m59.814s 00:08:02.636 sys 0m2.098s 00:08:02.636 04:19:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:02.636 04:19:41 -- common/autotest_common.sh@10 -- # set +x 00:08:02.636 ************************************ 00:08:02.636 END TEST nvmf_filesystem_no_in_capsule 00:08:02.636 ************************************ 00:08:02.636 04:19:41 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:02.636 04:19:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:02.636 04:19:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:02.636 04:19:41 -- common/autotest_common.sh@10 -- # set +x 00:08:02.636 ************************************ 00:08:02.636 START TEST nvmf_filesystem_in_capsule 00:08:02.636 ************************************ 00:08:02.636 04:19:41 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:02.636 04:19:41 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:02.636 04:19:41 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:02.636 04:19:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:02.636 04:19:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:02.636 04:19:41 -- common/autotest_common.sh@10 -- # set +x 00:08:02.636 04:19:41 -- nvmf/common.sh@469 -- # nvmfpid=2814629 00:08:02.636 04:19:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:02.636 04:19:41 -- nvmf/common.sh@470 -- # waitforlisten 2814629 00:08:02.636 04:19:41 -- common/autotest_common.sh@829 -- # '[' -z 2814629 ']' 00:08:02.636 04:19:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:02.636 04:19:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:02.636 04:19:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:02.636 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:02.636 04:19:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:02.636 04:19:41 -- common/autotest_common.sh@10 -- # set +x 00:08:02.636 [2024-11-26 04:19:41.822613] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:02.636 [2024-11-26 04:19:41.822713] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:02.636 EAL: No free 2048 kB hugepages reported on node 1 00:08:02.896 [2024-11-26 04:19:41.890464] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:02.896 [2024-11-26 04:19:41.976791] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:02.896 [2024-11-26 04:19:41.976982] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:02.896 [2024-11-26 04:19:41.977004] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:02.896 [2024-11-26 04:19:41.977019] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:02.896 [2024-11-26 04:19:41.977079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:02.896 [2024-11-26 04:19:41.977134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:02.896 [2024-11-26 04:19:41.977253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:02.896 [2024-11-26 04:19:41.977255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:03.830 04:19:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:03.830 04:19:42 -- common/autotest_common.sh@862 -- # return 0 00:08:03.830 04:19:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:03.830 04:19:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:03.830 04:19:42 -- common/autotest_common.sh@10 -- # set +x 00:08:03.830 04:19:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:03.830 04:19:42 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:03.830 04:19:42 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:03.830 04:19:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:03.830 04:19:42 -- common/autotest_common.sh@10 -- # set +x 00:08:03.830 [2024-11-26 04:19:42.862514] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:03.830 04:19:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:03.830 04:19:42 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:03.830 04:19:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:03.830 04:19:42 -- common/autotest_common.sh@10 -- # set +x 00:08:03.830 Malloc1 00:08:03.830 04:19:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:03.830 04:19:43 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:03.830 04:19:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:03.830 04:19:43 -- common/autotest_common.sh@10 -- # set +x 00:08:03.830 04:19:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:03.830 04:19:43 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:03.830 04:19:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:03.830 04:19:43 -- common/autotest_common.sh@10 -- # set +x 00:08:03.830 04:19:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:03.830 04:19:43 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:03.830 04:19:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:03.830 04:19:43 -- common/autotest_common.sh@10 -- # set +x 00:08:03.831 [2024-11-26 04:19:43.049335] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:04.089 04:19:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:04.089 04:19:43 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:04.089 04:19:43 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:04.089 04:19:43 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:04.089 04:19:43 -- common/autotest_common.sh@1369 -- # local bs 00:08:04.089 04:19:43 -- common/autotest_common.sh@1370 -- # local nb 00:08:04.089 04:19:43 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:04.089 04:19:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:04.089 04:19:43 -- common/autotest_common.sh@10 -- # set +x 00:08:04.089 04:19:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:04.089 04:19:43 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:04.089 { 00:08:04.089 "name": "Malloc1", 00:08:04.089 "aliases": [ 00:08:04.089 "494cc8d7-49c2-4776-a95f-2394c10a3a56" 00:08:04.089 ], 00:08:04.089 "product_name": "Malloc disk", 00:08:04.089 "block_size": 512, 00:08:04.089 "num_blocks": 1048576, 00:08:04.089 "uuid": "494cc8d7-49c2-4776-a95f-2394c10a3a56", 00:08:04.089 "assigned_rate_limits": { 00:08:04.089 "rw_ios_per_sec": 0, 00:08:04.089 "rw_mbytes_per_sec": 0, 00:08:04.089 "r_mbytes_per_sec": 0, 00:08:04.089 "w_mbytes_per_sec": 0 00:08:04.089 }, 00:08:04.089 "claimed": true, 00:08:04.089 "claim_type": "exclusive_write", 00:08:04.089 "zoned": false, 00:08:04.089 "supported_io_types": { 00:08:04.089 "read": true, 00:08:04.089 "write": true, 00:08:04.089 "unmap": true, 00:08:04.089 "write_zeroes": true, 00:08:04.089 "flush": true, 00:08:04.089 "reset": true, 00:08:04.089 "compare": false, 00:08:04.089 "compare_and_write": false, 00:08:04.089 "abort": true, 00:08:04.089 "nvme_admin": false, 00:08:04.089 "nvme_io": false 00:08:04.089 }, 00:08:04.089 "memory_domains": [ 00:08:04.089 { 00:08:04.089 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:04.089 "dma_device_type": 2 00:08:04.089 } 00:08:04.089 ], 00:08:04.089 "driver_specific": {} 00:08:04.089 } 00:08:04.089 ]' 00:08:04.089 04:19:43 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:04.089 04:19:43 -- common/autotest_common.sh@1372 -- # bs=512 00:08:04.089 04:19:43 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:04.089 04:19:43 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:04.089 04:19:43 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:04.089 04:19:43 -- common/autotest_common.sh@1377 -- # echo 512 00:08:04.089 04:19:43 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:04.089 04:19:43 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:04.658 04:19:43 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:04.658 04:19:43 -- common/autotest_common.sh@1187 -- # local i=0 00:08:04.658 04:19:43 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:04.658 04:19:43 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:04.658 04:19:43 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:06.566 04:19:45 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:06.566 04:19:45 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:06.566 04:19:45 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:06.566 04:19:45 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:06.566 04:19:45 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:06.567 04:19:45 -- common/autotest_common.sh@1197 -- # return 0 00:08:06.567 04:19:45 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:06.567 04:19:45 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:06.567 04:19:45 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:06.567 04:19:45 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:06.567 04:19:45 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:06.567 04:19:45 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:06.567 04:19:45 -- setup/common.sh@80 -- # echo 536870912 00:08:06.567 04:19:45 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:06.567 04:19:45 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:06.827 04:19:45 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:06.827 04:19:45 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:07.087 04:19:46 -- target/filesystem.sh@69 -- # partprobe 00:08:07.656 04:19:46 -- target/filesystem.sh@70 -- # sleep 1 00:08:08.595 04:19:47 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:08.595 04:19:47 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:08.595 04:19:47 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:08.595 04:19:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:08.595 04:19:47 -- common/autotest_common.sh@10 -- # set +x 00:08:08.595 ************************************ 00:08:08.595 START TEST filesystem_in_capsule_ext4 00:08:08.595 ************************************ 00:08:08.595 04:19:47 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:08.595 04:19:47 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:08.595 04:19:47 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:08.595 04:19:47 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:08.595 04:19:47 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:08.595 04:19:47 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:08.595 04:19:47 -- common/autotest_common.sh@914 -- # local i=0 00:08:08.595 04:19:47 -- common/autotest_common.sh@915 -- # local force 00:08:08.595 04:19:47 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:08.595 04:19:47 -- common/autotest_common.sh@918 -- # force=-F 00:08:08.595 04:19:47 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:08.595 mke2fs 1.47.0 (5-Feb-2023) 00:08:08.595 Discarding device blocks: 0/522240 done 00:08:08.595 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:08.595 Filesystem UUID: 3dee3c72-499b-4b50-8647-647f23383092 00:08:08.595 Superblock backups stored on blocks: 00:08:08.595 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:08.595 00:08:08.595 Allocating group tables: 0/64 done 00:08:08.595 Writing inode tables: 0/64 done 00:08:08.856 Creating journal (8192 blocks): done 00:08:08.856 Writing superblocks and filesystem accounting information: 0/64 done 00:08:08.856 00:08:08.856 04:19:47 -- common/autotest_common.sh@931 -- # return 0 00:08:08.856 04:19:47 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:14.129 04:19:53 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:14.129 04:19:53 -- target/filesystem.sh@25 -- # sync 00:08:14.129 04:19:53 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:14.129 04:19:53 -- target/filesystem.sh@27 -- # sync 00:08:14.129 04:19:53 -- target/filesystem.sh@29 -- # i=0 00:08:14.129 04:19:53 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:14.388 04:19:53 -- target/filesystem.sh@37 -- # kill -0 2814629 00:08:14.388 04:19:53 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:14.388 04:19:53 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:14.388 04:19:53 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:14.388 04:19:53 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:14.388 00:08:14.388 real 0m5.686s 00:08:14.388 user 0m0.019s 00:08:14.388 sys 0m0.066s 00:08:14.388 04:19:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:14.388 04:19:53 -- common/autotest_common.sh@10 -- # set +x 00:08:14.388 ************************************ 00:08:14.388 END TEST filesystem_in_capsule_ext4 00:08:14.388 ************************************ 00:08:14.388 04:19:53 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:14.388 04:19:53 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:14.388 04:19:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:14.388 04:19:53 -- common/autotest_common.sh@10 -- # set +x 00:08:14.388 ************************************ 00:08:14.388 START TEST filesystem_in_capsule_btrfs 00:08:14.388 ************************************ 00:08:14.388 04:19:53 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:14.388 04:19:53 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:14.388 04:19:53 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:14.388 04:19:53 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:14.388 04:19:53 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:14.388 04:19:53 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:14.388 04:19:53 -- common/autotest_common.sh@914 -- # local i=0 00:08:14.388 04:19:53 -- common/autotest_common.sh@915 -- # local force 00:08:14.388 04:19:53 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:14.388 04:19:53 -- common/autotest_common.sh@920 -- # force=-f 00:08:14.388 04:19:53 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:14.647 btrfs-progs v6.8.1 00:08:14.647 See https://btrfs.readthedocs.io for more information. 00:08:14.647 00:08:14.647 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:14.647 NOTE: several default settings have changed in version 5.15, please make sure 00:08:14.647 this does not affect your deployments: 00:08:14.647 - DUP for metadata (-m dup) 00:08:14.647 - enabled no-holes (-O no-holes) 00:08:14.647 - enabled free-space-tree (-R free-space-tree) 00:08:14.647 00:08:14.647 Label: (null) 00:08:14.647 UUID: 9bc28268-2541-4a75-821e-a88c76c1ba80 00:08:14.647 Node size: 16384 00:08:14.647 Sector size: 4096 (CPU page size: 4096) 00:08:14.647 Filesystem size: 510.00MiB 00:08:14.647 Block group profiles: 00:08:14.647 Data: single 8.00MiB 00:08:14.647 Metadata: DUP 32.00MiB 00:08:14.647 System: DUP 8.00MiB 00:08:14.647 SSD detected: yes 00:08:14.647 Zoned device: no 00:08:14.647 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:14.647 Checksum: crc32c 00:08:14.647 Number of devices: 1 00:08:14.647 Devices: 00:08:14.647 ID SIZE PATH 00:08:14.647 1 510.00MiB /dev/nvme0n1p1 00:08:14.647 00:08:14.647 04:19:53 -- common/autotest_common.sh@931 -- # return 0 00:08:14.647 04:19:53 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:15.583 04:19:54 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:15.583 04:19:54 -- target/filesystem.sh@25 -- # sync 00:08:15.583 04:19:54 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:15.583 04:19:54 -- target/filesystem.sh@27 -- # sync 00:08:15.583 04:19:54 -- target/filesystem.sh@29 -- # i=0 00:08:15.583 04:19:54 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:15.583 04:19:54 -- target/filesystem.sh@37 -- # kill -0 2814629 00:08:15.583 04:19:54 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:15.583 04:19:54 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:15.583 04:19:54 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:15.583 04:19:54 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:15.583 00:08:15.583 real 0m1.283s 00:08:15.583 user 0m0.017s 00:08:15.583 sys 0m0.100s 00:08:15.583 04:19:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:15.583 04:19:54 -- common/autotest_common.sh@10 -- # set +x 00:08:15.583 ************************************ 00:08:15.583 END TEST filesystem_in_capsule_btrfs 00:08:15.583 ************************************ 00:08:15.583 04:19:54 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:15.583 04:19:54 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:15.583 04:19:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:15.583 04:19:54 -- common/autotest_common.sh@10 -- # set +x 00:08:15.583 ************************************ 00:08:15.583 START TEST filesystem_in_capsule_xfs 00:08:15.583 ************************************ 00:08:15.583 04:19:54 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:15.583 04:19:54 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:15.583 04:19:54 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:15.583 04:19:54 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:15.583 04:19:54 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:15.583 04:19:54 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:15.583 04:19:54 -- common/autotest_common.sh@914 -- # local i=0 00:08:15.583 04:19:54 -- common/autotest_common.sh@915 -- # local force 00:08:15.583 04:19:54 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:15.583 04:19:54 -- common/autotest_common.sh@920 -- # force=-f 00:08:15.583 04:19:54 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:15.843 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:15.843 = sectsz=512 attr=2, projid32bit=1 00:08:15.843 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:15.843 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:15.843 data = bsize=4096 blocks=130560, imaxpct=25 00:08:15.843 = sunit=0 swidth=0 blks 00:08:15.843 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:15.843 log =internal log bsize=4096 blocks=16384, version=2 00:08:15.843 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:15.843 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:16.779 Discarding blocks...Done. 00:08:16.779 04:19:55 -- common/autotest_common.sh@931 -- # return 0 00:08:16.779 04:19:55 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:18.688 04:19:57 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:18.688 04:19:57 -- target/filesystem.sh@25 -- # sync 00:08:18.688 04:19:57 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:18.688 04:19:57 -- target/filesystem.sh@27 -- # sync 00:08:18.688 04:19:57 -- target/filesystem.sh@29 -- # i=0 00:08:18.688 04:19:57 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:18.688 04:19:57 -- target/filesystem.sh@37 -- # kill -0 2814629 00:08:18.688 04:19:57 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:18.688 04:19:57 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:18.688 04:19:57 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:18.688 04:19:57 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:18.688 00:08:18.688 real 0m3.031s 00:08:18.688 user 0m0.015s 00:08:18.688 sys 0m0.068s 00:08:18.688 04:19:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:18.688 04:19:57 -- common/autotest_common.sh@10 -- # set +x 00:08:18.688 ************************************ 00:08:18.688 END TEST filesystem_in_capsule_xfs 00:08:18.688 ************************************ 00:08:18.688 04:19:57 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:18.947 04:19:57 -- target/filesystem.sh@93 -- # sync 00:08:18.947 04:19:57 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:18.947 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.947 04:19:58 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:18.947 04:19:58 -- common/autotest_common.sh@1208 -- # local i=0 00:08:18.947 04:19:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:18.947 04:19:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:18.947 04:19:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:18.947 04:19:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:18.947 04:19:58 -- common/autotest_common.sh@1220 -- # return 0 00:08:18.947 04:19:58 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:18.947 04:19:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:18.947 04:19:58 -- common/autotest_common.sh@10 -- # set +x 00:08:18.947 04:19:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:18.947 04:19:58 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:18.947 04:19:58 -- target/filesystem.sh@101 -- # killprocess 2814629 00:08:18.947 04:19:58 -- common/autotest_common.sh@936 -- # '[' -z 2814629 ']' 00:08:18.947 04:19:58 -- common/autotest_common.sh@940 -- # kill -0 2814629 00:08:18.947 04:19:58 -- common/autotest_common.sh@941 -- # uname 00:08:18.947 04:19:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:18.947 04:19:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2814629 00:08:18.947 04:19:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:18.947 04:19:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:18.947 04:19:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2814629' 00:08:18.947 killing process with pid 2814629 00:08:18.947 04:19:58 -- common/autotest_common.sh@955 -- # kill 2814629 00:08:18.947 04:19:58 -- common/autotest_common.sh@960 -- # wait 2814629 00:08:19.580 04:19:58 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:19.580 00:08:19.580 real 0m16.811s 00:08:19.580 user 1m5.089s 00:08:19.580 sys 0m2.209s 00:08:19.580 04:19:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:19.580 04:19:58 -- common/autotest_common.sh@10 -- # set +x 00:08:19.580 ************************************ 00:08:19.580 END TEST nvmf_filesystem_in_capsule 00:08:19.580 ************************************ 00:08:19.580 04:19:58 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:19.580 04:19:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:19.580 04:19:58 -- nvmf/common.sh@116 -- # sync 00:08:19.580 04:19:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:19.580 04:19:58 -- nvmf/common.sh@119 -- # set +e 00:08:19.580 04:19:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:19.580 04:19:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:19.580 rmmod nvme_tcp 00:08:19.580 rmmod nvme_fabrics 00:08:19.580 rmmod nvme_keyring 00:08:19.580 04:19:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:19.580 04:19:58 -- nvmf/common.sh@123 -- # set -e 00:08:19.580 04:19:58 -- nvmf/common.sh@124 -- # return 0 00:08:19.580 04:19:58 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:19.580 04:19:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:19.580 04:19:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:19.580 04:19:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:19.580 04:19:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:19.580 04:19:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:19.580 04:19:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:19.580 04:19:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:19.580 04:19:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:21.506 04:20:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:21.506 00:08:21.506 real 0m37.109s 00:08:21.506 user 2m5.968s 00:08:21.506 sys 0m6.062s 00:08:21.506 04:20:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:21.506 04:20:00 -- common/autotest_common.sh@10 -- # set +x 00:08:21.506 ************************************ 00:08:21.506 END TEST nvmf_filesystem 00:08:21.506 ************************************ 00:08:21.767 04:20:00 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:21.767 04:20:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:21.767 04:20:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:21.767 04:20:00 -- common/autotest_common.sh@10 -- # set +x 00:08:21.767 ************************************ 00:08:21.767 START TEST nvmf_discovery 00:08:21.767 ************************************ 00:08:21.767 04:20:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:21.767 * Looking for test storage... 00:08:21.767 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:21.767 04:20:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:21.767 04:20:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:21.767 04:20:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:21.767 04:20:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:21.767 04:20:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:21.767 04:20:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:21.767 04:20:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:21.767 04:20:00 -- scripts/common.sh@335 -- # IFS=.-: 00:08:21.767 04:20:00 -- scripts/common.sh@335 -- # read -ra ver1 00:08:21.767 04:20:00 -- scripts/common.sh@336 -- # IFS=.-: 00:08:21.767 04:20:00 -- scripts/common.sh@336 -- # read -ra ver2 00:08:21.767 04:20:00 -- scripts/common.sh@337 -- # local 'op=<' 00:08:21.767 04:20:00 -- scripts/common.sh@339 -- # ver1_l=2 00:08:21.767 04:20:00 -- scripts/common.sh@340 -- # ver2_l=1 00:08:21.767 04:20:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:21.767 04:20:00 -- scripts/common.sh@343 -- # case "$op" in 00:08:21.767 04:20:00 -- scripts/common.sh@344 -- # : 1 00:08:21.767 04:20:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:21.767 04:20:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:21.767 04:20:00 -- scripts/common.sh@364 -- # decimal 1 00:08:21.767 04:20:00 -- scripts/common.sh@352 -- # local d=1 00:08:21.767 04:20:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:21.767 04:20:00 -- scripts/common.sh@354 -- # echo 1 00:08:21.767 04:20:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:21.767 04:20:00 -- scripts/common.sh@365 -- # decimal 2 00:08:21.767 04:20:00 -- scripts/common.sh@352 -- # local d=2 00:08:21.767 04:20:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:21.767 04:20:00 -- scripts/common.sh@354 -- # echo 2 00:08:21.767 04:20:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:21.767 04:20:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:21.767 04:20:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:21.767 04:20:00 -- scripts/common.sh@367 -- # return 0 00:08:21.767 04:20:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:21.767 04:20:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:21.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:21.767 --rc genhtml_branch_coverage=1 00:08:21.767 --rc genhtml_function_coverage=1 00:08:21.767 --rc genhtml_legend=1 00:08:21.767 --rc geninfo_all_blocks=1 00:08:21.767 --rc geninfo_unexecuted_blocks=1 00:08:21.767 00:08:21.767 ' 00:08:21.767 04:20:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:21.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:21.767 --rc genhtml_branch_coverage=1 00:08:21.767 --rc genhtml_function_coverage=1 00:08:21.767 --rc genhtml_legend=1 00:08:21.767 --rc geninfo_all_blocks=1 00:08:21.767 --rc geninfo_unexecuted_blocks=1 00:08:21.767 00:08:21.767 ' 00:08:21.767 04:20:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:21.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:21.767 --rc genhtml_branch_coverage=1 00:08:21.767 --rc genhtml_function_coverage=1 00:08:21.767 --rc genhtml_legend=1 00:08:21.767 --rc geninfo_all_blocks=1 00:08:21.767 --rc geninfo_unexecuted_blocks=1 00:08:21.767 00:08:21.767 ' 00:08:21.767 04:20:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:21.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:21.767 --rc genhtml_branch_coverage=1 00:08:21.767 --rc genhtml_function_coverage=1 00:08:21.768 --rc genhtml_legend=1 00:08:21.768 --rc geninfo_all_blocks=1 00:08:21.768 --rc geninfo_unexecuted_blocks=1 00:08:21.768 00:08:21.768 ' 00:08:21.768 04:20:00 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:21.768 04:20:00 -- nvmf/common.sh@7 -- # uname -s 00:08:21.768 04:20:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:21.768 04:20:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:21.768 04:20:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:21.768 04:20:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:21.768 04:20:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:21.768 04:20:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:21.768 04:20:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:21.768 04:20:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:21.768 04:20:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:21.768 04:20:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:21.768 04:20:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:21.768 04:20:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:21.768 04:20:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:21.768 04:20:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:21.768 04:20:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:21.768 04:20:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:21.768 04:20:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:21.768 04:20:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:21.768 04:20:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:21.768 04:20:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:21.768 04:20:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:21.768 04:20:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:21.768 04:20:00 -- paths/export.sh@5 -- # export PATH 00:08:21.768 04:20:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:21.768 04:20:00 -- nvmf/common.sh@46 -- # : 0 00:08:21.768 04:20:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:21.768 04:20:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:21.768 04:20:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:21.768 04:20:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:21.768 04:20:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:21.768 04:20:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:21.768 04:20:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:21.768 04:20:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:21.768 04:20:00 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:21.768 04:20:00 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:21.768 04:20:00 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:21.768 04:20:00 -- target/discovery.sh@15 -- # hash nvme 00:08:21.768 04:20:00 -- target/discovery.sh@20 -- # nvmftestinit 00:08:21.768 04:20:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:21.768 04:20:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:21.768 04:20:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:21.768 04:20:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:21.768 04:20:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:21.768 04:20:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:21.768 04:20:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:21.768 04:20:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:21.768 04:20:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:21.768 04:20:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:21.768 04:20:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:21.768 04:20:00 -- common/autotest_common.sh@10 -- # set +x 00:08:23.675 04:20:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:23.675 04:20:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:23.675 04:20:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:23.675 04:20:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:23.675 04:20:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:23.675 04:20:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:23.675 04:20:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:23.675 04:20:02 -- nvmf/common.sh@294 -- # net_devs=() 00:08:23.675 04:20:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:23.675 04:20:02 -- nvmf/common.sh@295 -- # e810=() 00:08:23.675 04:20:02 -- nvmf/common.sh@295 -- # local -ga e810 00:08:23.675 04:20:02 -- nvmf/common.sh@296 -- # x722=() 00:08:23.675 04:20:02 -- nvmf/common.sh@296 -- # local -ga x722 00:08:23.675 04:20:02 -- nvmf/common.sh@297 -- # mlx=() 00:08:23.675 04:20:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:23.675 04:20:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:23.675 04:20:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:23.675 04:20:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:23.675 04:20:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:23.675 04:20:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:23.675 04:20:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:23.675 04:20:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:23.675 04:20:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:23.675 04:20:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:23.675 04:20:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:23.675 04:20:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:23.675 04:20:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:23.675 04:20:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:23.675 04:20:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:23.675 04:20:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:23.935 04:20:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:23.935 04:20:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:23.935 04:20:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:23.935 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:23.935 04:20:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:23.935 04:20:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:23.935 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:23.935 04:20:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:23.935 04:20:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:23.935 04:20:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:23.935 04:20:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:23.935 04:20:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:23.935 04:20:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:23.935 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:23.935 04:20:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:23.935 04:20:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:23.935 04:20:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:23.935 04:20:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:23.935 04:20:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:23.935 04:20:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:23.935 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:23.935 04:20:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:23.935 04:20:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:23.935 04:20:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:23.935 04:20:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:23.935 04:20:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:23.935 04:20:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:23.935 04:20:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:23.935 04:20:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:23.935 04:20:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:23.935 04:20:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:23.935 04:20:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:23.935 04:20:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:23.935 04:20:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:23.935 04:20:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:23.935 04:20:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:23.935 04:20:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:23.935 04:20:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:23.935 04:20:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:23.935 04:20:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:23.935 04:20:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:23.935 04:20:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:23.935 04:20:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:23.935 04:20:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:23.935 04:20:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:23.935 04:20:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:23.935 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:23.935 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.421 ms 00:08:23.935 00:08:23.935 --- 10.0.0.2 ping statistics --- 00:08:23.935 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:23.935 rtt min/avg/max/mdev = 0.421/0.421/0.421/0.000 ms 00:08:23.935 04:20:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:23.935 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:23.935 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:08:23.935 00:08:23.935 --- 10.0.0.1 ping statistics --- 00:08:23.935 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:23.935 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:08:23.935 04:20:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:23.935 04:20:03 -- nvmf/common.sh@410 -- # return 0 00:08:23.935 04:20:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:23.935 04:20:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:23.935 04:20:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:23.935 04:20:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:23.935 04:20:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:23.935 04:20:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:23.935 04:20:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:23.935 04:20:03 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:23.935 04:20:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:23.935 04:20:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:23.935 04:20:03 -- common/autotest_common.sh@10 -- # set +x 00:08:23.935 04:20:03 -- nvmf/common.sh@469 -- # nvmfpid=2818854 00:08:23.935 04:20:03 -- nvmf/common.sh@470 -- # waitforlisten 2818854 00:08:23.935 04:20:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:23.935 04:20:03 -- common/autotest_common.sh@829 -- # '[' -z 2818854 ']' 00:08:23.936 04:20:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:23.936 04:20:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:23.936 04:20:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:23.936 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:23.936 04:20:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:23.936 04:20:03 -- common/autotest_common.sh@10 -- # set +x 00:08:24.196 [2024-11-26 04:20:03.192143] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:24.196 [2024-11-26 04:20:03.192242] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:24.196 EAL: No free 2048 kB hugepages reported on node 1 00:08:24.196 [2024-11-26 04:20:03.270203] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:24.196 [2024-11-26 04:20:03.367129] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:24.196 [2024-11-26 04:20:03.367289] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:24.196 [2024-11-26 04:20:03.367309] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:24.196 [2024-11-26 04:20:03.367324] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:24.196 [2024-11-26 04:20:03.367417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:24.196 [2024-11-26 04:20:03.367446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:24.196 [2024-11-26 04:20:03.367497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:24.196 [2024-11-26 04:20:03.367500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:25.134 04:20:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:25.134 04:20:04 -- common/autotest_common.sh@862 -- # return 0 00:08:25.134 04:20:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:25.134 04:20:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:25.134 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.134 04:20:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:25.134 04:20:04 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:25.134 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.134 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.134 [2024-11-26 04:20:04.227446] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:25.134 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.134 04:20:04 -- target/discovery.sh@26 -- # seq 1 4 00:08:25.134 04:20:04 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:25.134 04:20:04 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:25.134 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.134 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.134 Null1 00:08:25.134 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.134 04:20:04 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:25.134 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.134 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.134 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.134 04:20:04 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:25.134 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.134 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.134 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.134 04:20:04 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:25.134 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.134 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.134 [2024-11-26 04:20:04.267826] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:25.134 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.134 04:20:04 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:25.134 04:20:04 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:25.134 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.134 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.134 Null2 00:08:25.134 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.134 04:20:04 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:25.134 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.134 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.134 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.134 04:20:04 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:25.134 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.134 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.134 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.134 04:20:04 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:25.134 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.134 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.134 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.134 04:20:04 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:25.135 04:20:04 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:25.135 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.135 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.135 Null3 00:08:25.135 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.135 04:20:04 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:25.135 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.135 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.135 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.135 04:20:04 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:25.135 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.135 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.135 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.135 04:20:04 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:25.135 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.135 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.135 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.135 04:20:04 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:25.135 04:20:04 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:25.135 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.135 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.135 Null4 00:08:25.135 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.135 04:20:04 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:25.135 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.135 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.135 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.135 04:20:04 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:25.135 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.135 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.394 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.394 04:20:04 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:25.394 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.394 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.394 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.394 04:20:04 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:25.394 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.394 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.394 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.394 04:20:04 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:25.394 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.394 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.394 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.394 04:20:04 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:25.394 00:08:25.394 Discovery Log Number of Records 6, Generation counter 6 00:08:25.394 =====Discovery Log Entry 0====== 00:08:25.394 trtype: tcp 00:08:25.394 adrfam: ipv4 00:08:25.394 subtype: current discovery subsystem 00:08:25.394 treq: not required 00:08:25.394 portid: 0 00:08:25.394 trsvcid: 4420 00:08:25.394 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:25.394 traddr: 10.0.0.2 00:08:25.394 eflags: explicit discovery connections, duplicate discovery information 00:08:25.394 sectype: none 00:08:25.394 =====Discovery Log Entry 1====== 00:08:25.394 trtype: tcp 00:08:25.394 adrfam: ipv4 00:08:25.394 subtype: nvme subsystem 00:08:25.394 treq: not required 00:08:25.394 portid: 0 00:08:25.394 trsvcid: 4420 00:08:25.394 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:25.394 traddr: 10.0.0.2 00:08:25.394 eflags: none 00:08:25.394 sectype: none 00:08:25.394 =====Discovery Log Entry 2====== 00:08:25.394 trtype: tcp 00:08:25.394 adrfam: ipv4 00:08:25.394 subtype: nvme subsystem 00:08:25.394 treq: not required 00:08:25.394 portid: 0 00:08:25.394 trsvcid: 4420 00:08:25.394 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:25.394 traddr: 10.0.0.2 00:08:25.394 eflags: none 00:08:25.394 sectype: none 00:08:25.394 =====Discovery Log Entry 3====== 00:08:25.394 trtype: tcp 00:08:25.394 adrfam: ipv4 00:08:25.394 subtype: nvme subsystem 00:08:25.394 treq: not required 00:08:25.394 portid: 0 00:08:25.394 trsvcid: 4420 00:08:25.394 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:25.394 traddr: 10.0.0.2 00:08:25.394 eflags: none 00:08:25.394 sectype: none 00:08:25.394 =====Discovery Log Entry 4====== 00:08:25.394 trtype: tcp 00:08:25.394 adrfam: ipv4 00:08:25.394 subtype: nvme subsystem 00:08:25.394 treq: not required 00:08:25.394 portid: 0 00:08:25.394 trsvcid: 4420 00:08:25.394 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:25.394 traddr: 10.0.0.2 00:08:25.394 eflags: none 00:08:25.394 sectype: none 00:08:25.394 =====Discovery Log Entry 5====== 00:08:25.394 trtype: tcp 00:08:25.394 adrfam: ipv4 00:08:25.394 subtype: discovery subsystem referral 00:08:25.394 treq: not required 00:08:25.394 portid: 0 00:08:25.394 trsvcid: 4430 00:08:25.394 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:25.394 traddr: 10.0.0.2 00:08:25.394 eflags: none 00:08:25.394 sectype: none 00:08:25.394 04:20:04 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:25.394 Perform nvmf subsystem discovery via RPC 00:08:25.394 04:20:04 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:25.394 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.394 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.394 [2024-11-26 04:20:04.524416] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:25.394 [ 00:08:25.394 { 00:08:25.394 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:25.394 "subtype": "Discovery", 00:08:25.394 "listen_addresses": [ 00:08:25.394 { 00:08:25.394 "transport": "TCP", 00:08:25.394 "trtype": "TCP", 00:08:25.394 "adrfam": "IPv4", 00:08:25.394 "traddr": "10.0.0.2", 00:08:25.394 "trsvcid": "4420" 00:08:25.394 } 00:08:25.394 ], 00:08:25.394 "allow_any_host": true, 00:08:25.394 "hosts": [] 00:08:25.394 }, 00:08:25.394 { 00:08:25.394 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:25.394 "subtype": "NVMe", 00:08:25.394 "listen_addresses": [ 00:08:25.394 { 00:08:25.394 "transport": "TCP", 00:08:25.394 "trtype": "TCP", 00:08:25.394 "adrfam": "IPv4", 00:08:25.394 "traddr": "10.0.0.2", 00:08:25.394 "trsvcid": "4420" 00:08:25.394 } 00:08:25.394 ], 00:08:25.394 "allow_any_host": true, 00:08:25.394 "hosts": [], 00:08:25.394 "serial_number": "SPDK00000000000001", 00:08:25.394 "model_number": "SPDK bdev Controller", 00:08:25.394 "max_namespaces": 32, 00:08:25.394 "min_cntlid": 1, 00:08:25.394 "max_cntlid": 65519, 00:08:25.394 "namespaces": [ 00:08:25.394 { 00:08:25.394 "nsid": 1, 00:08:25.394 "bdev_name": "Null1", 00:08:25.394 "name": "Null1", 00:08:25.394 "nguid": "C7305726E02C4E94B0DDE00F4EBA16E1", 00:08:25.394 "uuid": "c7305726-e02c-4e94-b0dd-e00f4eba16e1" 00:08:25.394 } 00:08:25.394 ] 00:08:25.394 }, 00:08:25.394 { 00:08:25.394 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:25.394 "subtype": "NVMe", 00:08:25.394 "listen_addresses": [ 00:08:25.394 { 00:08:25.394 "transport": "TCP", 00:08:25.394 "trtype": "TCP", 00:08:25.394 "adrfam": "IPv4", 00:08:25.394 "traddr": "10.0.0.2", 00:08:25.394 "trsvcid": "4420" 00:08:25.394 } 00:08:25.394 ], 00:08:25.394 "allow_any_host": true, 00:08:25.394 "hosts": [], 00:08:25.394 "serial_number": "SPDK00000000000002", 00:08:25.394 "model_number": "SPDK bdev Controller", 00:08:25.394 "max_namespaces": 32, 00:08:25.394 "min_cntlid": 1, 00:08:25.394 "max_cntlid": 65519, 00:08:25.394 "namespaces": [ 00:08:25.394 { 00:08:25.394 "nsid": 1, 00:08:25.394 "bdev_name": "Null2", 00:08:25.394 "name": "Null2", 00:08:25.394 "nguid": "CECCEB0195DF4D4F91F81B693C2E10B6", 00:08:25.394 "uuid": "cecceb01-95df-4d4f-91f8-1b693c2e10b6" 00:08:25.394 } 00:08:25.395 ] 00:08:25.395 }, 00:08:25.395 { 00:08:25.395 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:25.395 "subtype": "NVMe", 00:08:25.395 "listen_addresses": [ 00:08:25.395 { 00:08:25.395 "transport": "TCP", 00:08:25.395 "trtype": "TCP", 00:08:25.395 "adrfam": "IPv4", 00:08:25.395 "traddr": "10.0.0.2", 00:08:25.395 "trsvcid": "4420" 00:08:25.395 } 00:08:25.395 ], 00:08:25.395 "allow_any_host": true, 00:08:25.395 "hosts": [], 00:08:25.395 "serial_number": "SPDK00000000000003", 00:08:25.395 "model_number": "SPDK bdev Controller", 00:08:25.395 "max_namespaces": 32, 00:08:25.395 "min_cntlid": 1, 00:08:25.395 "max_cntlid": 65519, 00:08:25.395 "namespaces": [ 00:08:25.395 { 00:08:25.395 "nsid": 1, 00:08:25.395 "bdev_name": "Null3", 00:08:25.395 "name": "Null3", 00:08:25.395 "nguid": "A7F233CA5D66451AA2F3394268FD27D6", 00:08:25.395 "uuid": "a7f233ca-5d66-451a-a2f3-394268fd27d6" 00:08:25.395 } 00:08:25.395 ] 00:08:25.395 }, 00:08:25.395 { 00:08:25.395 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:25.395 "subtype": "NVMe", 00:08:25.395 "listen_addresses": [ 00:08:25.395 { 00:08:25.395 "transport": "TCP", 00:08:25.395 "trtype": "TCP", 00:08:25.395 "adrfam": "IPv4", 00:08:25.395 "traddr": "10.0.0.2", 00:08:25.395 "trsvcid": "4420" 00:08:25.395 } 00:08:25.395 ], 00:08:25.395 "allow_any_host": true, 00:08:25.395 "hosts": [], 00:08:25.395 "serial_number": "SPDK00000000000004", 00:08:25.395 "model_number": "SPDK bdev Controller", 00:08:25.395 "max_namespaces": 32, 00:08:25.395 "min_cntlid": 1, 00:08:25.395 "max_cntlid": 65519, 00:08:25.395 "namespaces": [ 00:08:25.395 { 00:08:25.395 "nsid": 1, 00:08:25.395 "bdev_name": "Null4", 00:08:25.395 "name": "Null4", 00:08:25.395 "nguid": "E1B1D48A80A54E7EA65BB7D996A21C0E", 00:08:25.395 "uuid": "e1b1d48a-80a5-4e7e-a65b-b7d996a21c0e" 00:08:25.395 } 00:08:25.395 ] 00:08:25.395 } 00:08:25.395 ] 00:08:25.395 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.395 04:20:04 -- target/discovery.sh@42 -- # seq 1 4 00:08:25.395 04:20:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:25.395 04:20:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:25.395 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.395 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.395 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.395 04:20:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:25.395 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.395 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.395 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.395 04:20:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:25.395 04:20:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:25.395 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.395 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.395 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.395 04:20:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:25.395 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.395 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.395 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.395 04:20:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:25.395 04:20:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:25.395 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.395 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.395 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.395 04:20:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:25.395 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.395 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.395 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.395 04:20:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:25.395 04:20:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:25.395 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.395 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.395 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.395 04:20:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:25.395 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.395 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.395 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.395 04:20:04 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:25.395 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.395 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.653 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.653 04:20:04 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:25.653 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:25.653 04:20:04 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:25.653 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:25.653 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:25.653 04:20:04 -- target/discovery.sh@49 -- # check_bdevs= 00:08:25.653 04:20:04 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:25.653 04:20:04 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:25.653 04:20:04 -- target/discovery.sh@57 -- # nvmftestfini 00:08:25.653 04:20:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:25.653 04:20:04 -- nvmf/common.sh@116 -- # sync 00:08:25.653 04:20:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:25.653 04:20:04 -- nvmf/common.sh@119 -- # set +e 00:08:25.653 04:20:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:25.653 04:20:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:25.654 rmmod nvme_tcp 00:08:25.654 rmmod nvme_fabrics 00:08:25.654 rmmod nvme_keyring 00:08:25.654 04:20:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:25.654 04:20:04 -- nvmf/common.sh@123 -- # set -e 00:08:25.654 04:20:04 -- nvmf/common.sh@124 -- # return 0 00:08:25.654 04:20:04 -- nvmf/common.sh@477 -- # '[' -n 2818854 ']' 00:08:25.654 04:20:04 -- nvmf/common.sh@478 -- # killprocess 2818854 00:08:25.654 04:20:04 -- common/autotest_common.sh@936 -- # '[' -z 2818854 ']' 00:08:25.654 04:20:04 -- common/autotest_common.sh@940 -- # kill -0 2818854 00:08:25.654 04:20:04 -- common/autotest_common.sh@941 -- # uname 00:08:25.654 04:20:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:25.654 04:20:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2818854 00:08:25.654 04:20:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:25.654 04:20:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:25.654 04:20:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2818854' 00:08:25.654 killing process with pid 2818854 00:08:25.654 04:20:04 -- common/autotest_common.sh@955 -- # kill 2818854 00:08:25.654 [2024-11-26 04:20:04.752521] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:25.654 04:20:04 -- common/autotest_common.sh@960 -- # wait 2818854 00:08:25.912 04:20:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:25.912 04:20:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:25.912 04:20:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:25.912 04:20:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:25.912 04:20:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:25.912 04:20:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:25.912 04:20:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:25.912 04:20:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:27.820 04:20:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:27.820 00:08:27.820 real 0m6.279s 00:08:27.820 user 0m7.501s 00:08:27.820 sys 0m1.960s 00:08:27.820 04:20:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:27.820 04:20:07 -- common/autotest_common.sh@10 -- # set +x 00:08:27.820 ************************************ 00:08:27.820 END TEST nvmf_discovery 00:08:27.820 ************************************ 00:08:28.079 04:20:07 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:28.079 04:20:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:28.079 04:20:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:28.079 04:20:07 -- common/autotest_common.sh@10 -- # set +x 00:08:28.079 ************************************ 00:08:28.079 START TEST nvmf_referrals 00:08:28.079 ************************************ 00:08:28.079 04:20:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:28.079 * Looking for test storage... 00:08:28.079 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:28.079 04:20:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:28.079 04:20:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:28.079 04:20:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:28.079 04:20:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:28.079 04:20:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:28.079 04:20:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:28.079 04:20:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:28.079 04:20:07 -- scripts/common.sh@335 -- # IFS=.-: 00:08:28.079 04:20:07 -- scripts/common.sh@335 -- # read -ra ver1 00:08:28.079 04:20:07 -- scripts/common.sh@336 -- # IFS=.-: 00:08:28.079 04:20:07 -- scripts/common.sh@336 -- # read -ra ver2 00:08:28.079 04:20:07 -- scripts/common.sh@337 -- # local 'op=<' 00:08:28.079 04:20:07 -- scripts/common.sh@339 -- # ver1_l=2 00:08:28.079 04:20:07 -- scripts/common.sh@340 -- # ver2_l=1 00:08:28.079 04:20:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:28.079 04:20:07 -- scripts/common.sh@343 -- # case "$op" in 00:08:28.079 04:20:07 -- scripts/common.sh@344 -- # : 1 00:08:28.079 04:20:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:28.079 04:20:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:28.079 04:20:07 -- scripts/common.sh@364 -- # decimal 1 00:08:28.079 04:20:07 -- scripts/common.sh@352 -- # local d=1 00:08:28.079 04:20:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:28.079 04:20:07 -- scripts/common.sh@354 -- # echo 1 00:08:28.079 04:20:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:28.079 04:20:07 -- scripts/common.sh@365 -- # decimal 2 00:08:28.079 04:20:07 -- scripts/common.sh@352 -- # local d=2 00:08:28.079 04:20:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:28.079 04:20:07 -- scripts/common.sh@354 -- # echo 2 00:08:28.079 04:20:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:28.079 04:20:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:28.079 04:20:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:28.079 04:20:07 -- scripts/common.sh@367 -- # return 0 00:08:28.079 04:20:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:28.079 04:20:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:28.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:28.079 --rc genhtml_branch_coverage=1 00:08:28.079 --rc genhtml_function_coverage=1 00:08:28.079 --rc genhtml_legend=1 00:08:28.079 --rc geninfo_all_blocks=1 00:08:28.079 --rc geninfo_unexecuted_blocks=1 00:08:28.079 00:08:28.079 ' 00:08:28.079 04:20:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:28.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:28.079 --rc genhtml_branch_coverage=1 00:08:28.079 --rc genhtml_function_coverage=1 00:08:28.079 --rc genhtml_legend=1 00:08:28.079 --rc geninfo_all_blocks=1 00:08:28.079 --rc geninfo_unexecuted_blocks=1 00:08:28.079 00:08:28.079 ' 00:08:28.079 04:20:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:28.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:28.079 --rc genhtml_branch_coverage=1 00:08:28.079 --rc genhtml_function_coverage=1 00:08:28.079 --rc genhtml_legend=1 00:08:28.079 --rc geninfo_all_blocks=1 00:08:28.079 --rc geninfo_unexecuted_blocks=1 00:08:28.079 00:08:28.079 ' 00:08:28.079 04:20:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:28.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:28.079 --rc genhtml_branch_coverage=1 00:08:28.079 --rc genhtml_function_coverage=1 00:08:28.079 --rc genhtml_legend=1 00:08:28.079 --rc geninfo_all_blocks=1 00:08:28.079 --rc geninfo_unexecuted_blocks=1 00:08:28.079 00:08:28.079 ' 00:08:28.079 04:20:07 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:28.079 04:20:07 -- nvmf/common.sh@7 -- # uname -s 00:08:28.079 04:20:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:28.079 04:20:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:28.079 04:20:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:28.079 04:20:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:28.079 04:20:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:28.080 04:20:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:28.080 04:20:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:28.080 04:20:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:28.080 04:20:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:28.080 04:20:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:28.080 04:20:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:28.080 04:20:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:28.080 04:20:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:28.080 04:20:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:28.080 04:20:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:28.080 04:20:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:28.080 04:20:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:28.080 04:20:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:28.080 04:20:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:28.080 04:20:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:28.080 04:20:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:28.080 04:20:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:28.080 04:20:07 -- paths/export.sh@5 -- # export PATH 00:08:28.080 04:20:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:28.080 04:20:07 -- nvmf/common.sh@46 -- # : 0 00:08:28.080 04:20:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:28.080 04:20:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:28.080 04:20:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:28.080 04:20:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:28.080 04:20:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:28.080 04:20:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:28.080 04:20:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:28.080 04:20:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:28.080 04:20:07 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:28.080 04:20:07 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:28.080 04:20:07 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:28.080 04:20:07 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:28.080 04:20:07 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:28.080 04:20:07 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:28.080 04:20:07 -- target/referrals.sh@37 -- # nvmftestinit 00:08:28.080 04:20:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:28.080 04:20:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:28.080 04:20:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:28.080 04:20:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:28.080 04:20:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:28.080 04:20:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:28.080 04:20:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:28.080 04:20:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:28.080 04:20:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:28.080 04:20:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:28.080 04:20:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:28.080 04:20:07 -- common/autotest_common.sh@10 -- # set +x 00:08:30.616 04:20:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:30.616 04:20:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:30.616 04:20:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:30.616 04:20:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:30.616 04:20:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:30.616 04:20:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:30.616 04:20:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:30.616 04:20:09 -- nvmf/common.sh@294 -- # net_devs=() 00:08:30.616 04:20:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:30.616 04:20:09 -- nvmf/common.sh@295 -- # e810=() 00:08:30.616 04:20:09 -- nvmf/common.sh@295 -- # local -ga e810 00:08:30.616 04:20:09 -- nvmf/common.sh@296 -- # x722=() 00:08:30.616 04:20:09 -- nvmf/common.sh@296 -- # local -ga x722 00:08:30.616 04:20:09 -- nvmf/common.sh@297 -- # mlx=() 00:08:30.616 04:20:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:30.616 04:20:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:30.616 04:20:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:30.616 04:20:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:30.616 04:20:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:30.616 04:20:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:30.616 04:20:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:30.616 04:20:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:30.616 04:20:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:30.616 04:20:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:30.616 04:20:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:30.616 04:20:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:30.616 04:20:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:30.616 04:20:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:30.616 04:20:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:30.616 04:20:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:30.616 04:20:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:30.616 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:30.616 04:20:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:30.616 04:20:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:30.616 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:30.616 04:20:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:30.616 04:20:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:30.617 04:20:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:30.617 04:20:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:30.617 04:20:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:30.617 04:20:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:30.617 04:20:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:30.617 04:20:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:30.617 04:20:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:30.617 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:30.617 04:20:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:30.617 04:20:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:30.617 04:20:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:30.617 04:20:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:30.617 04:20:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:30.617 04:20:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:30.617 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:30.617 04:20:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:30.617 04:20:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:30.617 04:20:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:30.617 04:20:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:30.617 04:20:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:30.617 04:20:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:30.617 04:20:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:30.617 04:20:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:30.617 04:20:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:30.617 04:20:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:30.617 04:20:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:30.617 04:20:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:30.617 04:20:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:30.617 04:20:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:30.617 04:20:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:30.617 04:20:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:30.617 04:20:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:30.617 04:20:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:30.617 04:20:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:30.617 04:20:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:30.617 04:20:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:30.617 04:20:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:30.617 04:20:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:30.617 04:20:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:30.617 04:20:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:30.617 04:20:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:30.617 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:30.617 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:08:30.617 00:08:30.617 --- 10.0.0.2 ping statistics --- 00:08:30.617 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:30.617 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:08:30.617 04:20:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:30.617 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:30.617 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:08:30.617 00:08:30.617 --- 10.0.0.1 ping statistics --- 00:08:30.617 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:30.617 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:08:30.617 04:20:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:30.617 04:20:09 -- nvmf/common.sh@410 -- # return 0 00:08:30.617 04:20:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:30.617 04:20:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:30.617 04:20:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:30.617 04:20:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:30.617 04:20:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:30.617 04:20:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:30.617 04:20:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:30.617 04:20:09 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:30.617 04:20:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:30.617 04:20:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:30.617 04:20:09 -- common/autotest_common.sh@10 -- # set +x 00:08:30.617 04:20:09 -- nvmf/common.sh@469 -- # nvmfpid=2820996 00:08:30.617 04:20:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:30.617 04:20:09 -- nvmf/common.sh@470 -- # waitforlisten 2820996 00:08:30.617 04:20:09 -- common/autotest_common.sh@829 -- # '[' -z 2820996 ']' 00:08:30.617 04:20:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:30.617 04:20:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:30.617 04:20:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:30.617 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:30.617 04:20:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:30.617 04:20:09 -- common/autotest_common.sh@10 -- # set +x 00:08:30.617 [2024-11-26 04:20:09.487191] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:30.617 [2024-11-26 04:20:09.487274] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:30.617 EAL: No free 2048 kB hugepages reported on node 1 00:08:30.617 [2024-11-26 04:20:09.562421] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:30.617 [2024-11-26 04:20:09.655457] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:30.617 [2024-11-26 04:20:09.655621] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:30.617 [2024-11-26 04:20:09.655641] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:30.617 [2024-11-26 04:20:09.655655] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:30.617 [2024-11-26 04:20:09.655731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:30.617 [2024-11-26 04:20:09.655789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:30.617 [2024-11-26 04:20:09.655841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:30.617 [2024-11-26 04:20:09.655844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:31.551 04:20:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:31.551 04:20:10 -- common/autotest_common.sh@862 -- # return 0 00:08:31.551 04:20:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:31.551 04:20:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:31.551 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.551 04:20:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:31.551 04:20:10 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:31.551 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:31.551 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.551 [2024-11-26 04:20:10.487317] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:31.551 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:31.551 04:20:10 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:08:31.551 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:31.551 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.552 [2024-11-26 04:20:10.499541] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:08:31.552 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:31.552 04:20:10 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:08:31.552 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:31.552 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.552 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:31.552 04:20:10 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:08:31.552 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:31.552 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.552 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:31.552 04:20:10 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:08:31.552 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:31.552 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.552 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:31.552 04:20:10 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:31.552 04:20:10 -- target/referrals.sh@48 -- # jq length 00:08:31.552 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:31.552 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.552 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:31.552 04:20:10 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:31.552 04:20:10 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:31.552 04:20:10 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:31.552 04:20:10 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:31.552 04:20:10 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:31.552 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:31.552 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.552 04:20:10 -- target/referrals.sh@21 -- # sort 00:08:31.552 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:31.552 04:20:10 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:31.552 04:20:10 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:31.552 04:20:10 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:31.552 04:20:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:31.552 04:20:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:31.552 04:20:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:31.552 04:20:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:31.552 04:20:10 -- target/referrals.sh@26 -- # sort 00:08:31.809 04:20:10 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:31.809 04:20:10 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:31.809 04:20:10 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:08:31.809 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:31.809 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.809 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:31.809 04:20:10 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:08:31.809 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:31.809 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.809 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:31.809 04:20:10 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:08:31.809 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:31.809 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.809 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:31.809 04:20:10 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:31.809 04:20:10 -- target/referrals.sh@56 -- # jq length 00:08:31.809 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:31.809 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:08:31.809 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:31.809 04:20:10 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:31.809 04:20:10 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:31.809 04:20:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:31.809 04:20:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:31.809 04:20:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:31.809 04:20:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:31.809 04:20:10 -- target/referrals.sh@26 -- # sort 00:08:32.067 04:20:11 -- target/referrals.sh@26 -- # echo 00:08:32.067 04:20:11 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:32.067 04:20:11 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:08:32.067 04:20:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.067 04:20:11 -- common/autotest_common.sh@10 -- # set +x 00:08:32.067 04:20:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.067 04:20:11 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:32.067 04:20:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.067 04:20:11 -- common/autotest_common.sh@10 -- # set +x 00:08:32.067 04:20:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.067 04:20:11 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:32.067 04:20:11 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:32.067 04:20:11 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:32.067 04:20:11 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:32.067 04:20:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.067 04:20:11 -- common/autotest_common.sh@10 -- # set +x 00:08:32.067 04:20:11 -- target/referrals.sh@21 -- # sort 00:08:32.067 04:20:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.067 04:20:11 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:32.067 04:20:11 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:32.067 04:20:11 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:32.067 04:20:11 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:32.067 04:20:11 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:32.067 04:20:11 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:32.067 04:20:11 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:32.067 04:20:11 -- target/referrals.sh@26 -- # sort 00:08:32.325 04:20:11 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:32.325 04:20:11 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:32.325 04:20:11 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:32.325 04:20:11 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:32.325 04:20:11 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:32.325 04:20:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:32.325 04:20:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:32.325 04:20:11 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:32.325 04:20:11 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:32.325 04:20:11 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:32.325 04:20:11 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:32.325 04:20:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:32.325 04:20:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:32.583 04:20:11 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:32.583 04:20:11 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:32.583 04:20:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.583 04:20:11 -- common/autotest_common.sh@10 -- # set +x 00:08:32.583 04:20:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.583 04:20:11 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:32.583 04:20:11 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:32.583 04:20:11 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:32.583 04:20:11 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:32.583 04:20:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.583 04:20:11 -- common/autotest_common.sh@10 -- # set +x 00:08:32.583 04:20:11 -- target/referrals.sh@21 -- # sort 00:08:32.583 04:20:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.583 04:20:11 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:32.583 04:20:11 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:32.583 04:20:11 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:32.583 04:20:11 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:32.583 04:20:11 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:32.583 04:20:11 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:32.583 04:20:11 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:32.583 04:20:11 -- target/referrals.sh@26 -- # sort 00:08:32.841 04:20:11 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:32.841 04:20:11 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:32.841 04:20:11 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:32.841 04:20:11 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:32.841 04:20:11 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:32.841 04:20:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:32.841 04:20:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:33.099 04:20:12 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:33.099 04:20:12 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:33.099 04:20:12 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:33.099 04:20:12 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:33.099 04:20:12 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:33.099 04:20:12 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:33.099 04:20:12 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:33.099 04:20:12 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:33.099 04:20:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.099 04:20:12 -- common/autotest_common.sh@10 -- # set +x 00:08:33.357 04:20:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.357 04:20:12 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:33.357 04:20:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.357 04:20:12 -- target/referrals.sh@82 -- # jq length 00:08:33.357 04:20:12 -- common/autotest_common.sh@10 -- # set +x 00:08:33.357 04:20:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.357 04:20:12 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:33.357 04:20:12 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:33.357 04:20:12 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:33.357 04:20:12 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:33.357 04:20:12 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:33.357 04:20:12 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:33.357 04:20:12 -- target/referrals.sh@26 -- # sort 00:08:33.615 04:20:12 -- target/referrals.sh@26 -- # echo 00:08:33.615 04:20:12 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:33.615 04:20:12 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:33.615 04:20:12 -- target/referrals.sh@86 -- # nvmftestfini 00:08:33.615 04:20:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:33.615 04:20:12 -- nvmf/common.sh@116 -- # sync 00:08:33.615 04:20:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:33.615 04:20:12 -- nvmf/common.sh@119 -- # set +e 00:08:33.615 04:20:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:33.615 04:20:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:33.615 rmmod nvme_tcp 00:08:33.615 rmmod nvme_fabrics 00:08:33.615 rmmod nvme_keyring 00:08:33.615 04:20:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:33.615 04:20:12 -- nvmf/common.sh@123 -- # set -e 00:08:33.615 04:20:12 -- nvmf/common.sh@124 -- # return 0 00:08:33.615 04:20:12 -- nvmf/common.sh@477 -- # '[' -n 2820996 ']' 00:08:33.615 04:20:12 -- nvmf/common.sh@478 -- # killprocess 2820996 00:08:33.615 04:20:12 -- common/autotest_common.sh@936 -- # '[' -z 2820996 ']' 00:08:33.615 04:20:12 -- common/autotest_common.sh@940 -- # kill -0 2820996 00:08:33.615 04:20:12 -- common/autotest_common.sh@941 -- # uname 00:08:33.615 04:20:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:33.615 04:20:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2820996 00:08:33.615 04:20:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:33.615 04:20:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:33.615 04:20:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2820996' 00:08:33.615 killing process with pid 2820996 00:08:33.615 04:20:12 -- common/autotest_common.sh@955 -- # kill 2820996 00:08:33.615 04:20:12 -- common/autotest_common.sh@960 -- # wait 2820996 00:08:33.875 04:20:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:33.875 04:20:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:33.875 04:20:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:33.875 04:20:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:33.875 04:20:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:33.875 04:20:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:33.875 04:20:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:33.875 04:20:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:35.783 04:20:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:35.783 00:08:35.783 real 0m7.899s 00:08:35.783 user 0m14.706s 00:08:35.783 sys 0m2.291s 00:08:35.783 04:20:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:35.783 04:20:14 -- common/autotest_common.sh@10 -- # set +x 00:08:35.783 ************************************ 00:08:35.783 END TEST nvmf_referrals 00:08:35.783 ************************************ 00:08:35.783 04:20:14 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:35.783 04:20:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:35.783 04:20:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:35.783 04:20:14 -- common/autotest_common.sh@10 -- # set +x 00:08:35.783 ************************************ 00:08:35.783 START TEST nvmf_connect_disconnect 00:08:35.783 ************************************ 00:08:35.783 04:20:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:36.042 * Looking for test storage... 00:08:36.042 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:36.042 04:20:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:36.042 04:20:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:36.042 04:20:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:36.042 04:20:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:36.042 04:20:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:36.042 04:20:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:36.042 04:20:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:36.042 04:20:15 -- scripts/common.sh@335 -- # IFS=.-: 00:08:36.042 04:20:15 -- scripts/common.sh@335 -- # read -ra ver1 00:08:36.042 04:20:15 -- scripts/common.sh@336 -- # IFS=.-: 00:08:36.042 04:20:15 -- scripts/common.sh@336 -- # read -ra ver2 00:08:36.042 04:20:15 -- scripts/common.sh@337 -- # local 'op=<' 00:08:36.042 04:20:15 -- scripts/common.sh@339 -- # ver1_l=2 00:08:36.042 04:20:15 -- scripts/common.sh@340 -- # ver2_l=1 00:08:36.042 04:20:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:36.042 04:20:15 -- scripts/common.sh@343 -- # case "$op" in 00:08:36.042 04:20:15 -- scripts/common.sh@344 -- # : 1 00:08:36.042 04:20:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:36.042 04:20:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:36.042 04:20:15 -- scripts/common.sh@364 -- # decimal 1 00:08:36.042 04:20:15 -- scripts/common.sh@352 -- # local d=1 00:08:36.042 04:20:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:36.042 04:20:15 -- scripts/common.sh@354 -- # echo 1 00:08:36.042 04:20:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:36.042 04:20:15 -- scripts/common.sh@365 -- # decimal 2 00:08:36.042 04:20:15 -- scripts/common.sh@352 -- # local d=2 00:08:36.042 04:20:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:36.042 04:20:15 -- scripts/common.sh@354 -- # echo 2 00:08:36.042 04:20:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:36.042 04:20:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:36.042 04:20:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:36.042 04:20:15 -- scripts/common.sh@367 -- # return 0 00:08:36.042 04:20:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:36.042 04:20:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:36.042 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:36.042 --rc genhtml_branch_coverage=1 00:08:36.042 --rc genhtml_function_coverage=1 00:08:36.042 --rc genhtml_legend=1 00:08:36.042 --rc geninfo_all_blocks=1 00:08:36.042 --rc geninfo_unexecuted_blocks=1 00:08:36.042 00:08:36.042 ' 00:08:36.042 04:20:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:36.042 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:36.042 --rc genhtml_branch_coverage=1 00:08:36.042 --rc genhtml_function_coverage=1 00:08:36.042 --rc genhtml_legend=1 00:08:36.042 --rc geninfo_all_blocks=1 00:08:36.042 --rc geninfo_unexecuted_blocks=1 00:08:36.042 00:08:36.042 ' 00:08:36.042 04:20:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:36.042 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:36.043 --rc genhtml_branch_coverage=1 00:08:36.043 --rc genhtml_function_coverage=1 00:08:36.043 --rc genhtml_legend=1 00:08:36.043 --rc geninfo_all_blocks=1 00:08:36.043 --rc geninfo_unexecuted_blocks=1 00:08:36.043 00:08:36.043 ' 00:08:36.043 04:20:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:36.043 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:36.043 --rc genhtml_branch_coverage=1 00:08:36.043 --rc genhtml_function_coverage=1 00:08:36.043 --rc genhtml_legend=1 00:08:36.043 --rc geninfo_all_blocks=1 00:08:36.043 --rc geninfo_unexecuted_blocks=1 00:08:36.043 00:08:36.043 ' 00:08:36.043 04:20:15 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:36.043 04:20:15 -- nvmf/common.sh@7 -- # uname -s 00:08:36.043 04:20:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:36.043 04:20:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:36.043 04:20:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:36.043 04:20:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:36.043 04:20:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:36.043 04:20:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:36.043 04:20:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:36.043 04:20:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:36.043 04:20:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:36.043 04:20:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:36.043 04:20:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:36.043 04:20:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:36.043 04:20:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:36.043 04:20:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:36.043 04:20:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:36.043 04:20:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:36.043 04:20:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:36.043 04:20:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:36.043 04:20:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:36.043 04:20:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.043 04:20:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.043 04:20:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.043 04:20:15 -- paths/export.sh@5 -- # export PATH 00:08:36.043 04:20:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.043 04:20:15 -- nvmf/common.sh@46 -- # : 0 00:08:36.043 04:20:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:36.043 04:20:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:36.043 04:20:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:36.043 04:20:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:36.043 04:20:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:36.043 04:20:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:36.043 04:20:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:36.043 04:20:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:36.043 04:20:15 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:36.043 04:20:15 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:36.043 04:20:15 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:36.043 04:20:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:36.043 04:20:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:36.043 04:20:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:36.043 04:20:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:36.043 04:20:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:36.043 04:20:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:36.043 04:20:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:36.043 04:20:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:36.043 04:20:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:36.043 04:20:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:36.043 04:20:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:36.043 04:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:38.577 04:20:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:38.577 04:20:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:38.577 04:20:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:38.577 04:20:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:38.577 04:20:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:38.577 04:20:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:38.577 04:20:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:38.577 04:20:17 -- nvmf/common.sh@294 -- # net_devs=() 00:08:38.577 04:20:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:38.577 04:20:17 -- nvmf/common.sh@295 -- # e810=() 00:08:38.577 04:20:17 -- nvmf/common.sh@295 -- # local -ga e810 00:08:38.577 04:20:17 -- nvmf/common.sh@296 -- # x722=() 00:08:38.577 04:20:17 -- nvmf/common.sh@296 -- # local -ga x722 00:08:38.577 04:20:17 -- nvmf/common.sh@297 -- # mlx=() 00:08:38.577 04:20:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:38.577 04:20:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:38.577 04:20:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:38.577 04:20:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:38.577 04:20:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:38.577 04:20:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:38.577 04:20:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:38.577 04:20:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:38.577 04:20:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:38.577 04:20:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:38.577 04:20:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:38.577 04:20:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:38.577 04:20:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:38.577 04:20:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:38.577 04:20:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:38.577 04:20:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:38.577 04:20:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:38.577 04:20:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:38.577 04:20:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:38.577 04:20:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:38.577 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:38.577 04:20:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:38.577 04:20:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:38.577 04:20:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:38.577 04:20:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:38.577 04:20:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:38.577 04:20:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:38.577 04:20:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:38.578 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:38.578 04:20:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:38.578 04:20:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:38.578 04:20:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:38.578 04:20:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:38.578 04:20:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:38.578 04:20:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:38.578 04:20:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:38.578 04:20:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:38.578 04:20:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:38.578 04:20:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:38.578 04:20:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:38.578 04:20:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:38.578 04:20:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:38.578 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:38.578 04:20:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:38.578 04:20:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:38.578 04:20:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:38.578 04:20:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:38.578 04:20:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:38.578 04:20:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:38.578 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:38.578 04:20:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:38.578 04:20:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:38.578 04:20:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:38.578 04:20:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:38.578 04:20:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:38.578 04:20:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:38.578 04:20:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:38.578 04:20:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:38.578 04:20:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:38.578 04:20:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:38.578 04:20:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:38.578 04:20:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:38.578 04:20:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:38.578 04:20:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:38.578 04:20:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:38.578 04:20:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:38.578 04:20:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:38.578 04:20:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:38.578 04:20:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:38.578 04:20:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:38.578 04:20:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:38.578 04:20:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:38.578 04:20:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:38.578 04:20:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:38.578 04:20:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:38.578 04:20:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:38.578 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:38.578 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:08:38.578 00:08:38.578 --- 10.0.0.2 ping statistics --- 00:08:38.578 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:38.578 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:08:38.578 04:20:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:38.578 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:38.578 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.054 ms 00:08:38.578 00:08:38.578 --- 10.0.0.1 ping statistics --- 00:08:38.578 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:38.578 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:08:38.578 04:20:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:38.578 04:20:17 -- nvmf/common.sh@410 -- # return 0 00:08:38.578 04:20:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:38.578 04:20:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:38.578 04:20:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:38.578 04:20:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:38.578 04:20:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:38.578 04:20:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:38.578 04:20:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:38.578 04:20:17 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:38.578 04:20:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:38.578 04:20:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:38.578 04:20:17 -- common/autotest_common.sh@10 -- # set +x 00:08:38.578 04:20:17 -- nvmf/common.sh@469 -- # nvmfpid=2823487 00:08:38.578 04:20:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:38.578 04:20:17 -- nvmf/common.sh@470 -- # waitforlisten 2823487 00:08:38.578 04:20:17 -- common/autotest_common.sh@829 -- # '[' -z 2823487 ']' 00:08:38.578 04:20:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:38.578 04:20:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:38.578 04:20:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:38.578 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:38.578 04:20:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:38.578 04:20:17 -- common/autotest_common.sh@10 -- # set +x 00:08:38.578 [2024-11-26 04:20:17.456519] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:38.578 [2024-11-26 04:20:17.456626] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:38.578 EAL: No free 2048 kB hugepages reported on node 1 00:08:38.578 [2024-11-26 04:20:17.529540] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:38.578 [2024-11-26 04:20:17.624591] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:38.578 [2024-11-26 04:20:17.624751] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:38.578 [2024-11-26 04:20:17.624773] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:38.578 [2024-11-26 04:20:17.624787] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:38.578 [2024-11-26 04:20:17.624851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:38.578 [2024-11-26 04:20:17.624907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:38.578 [2024-11-26 04:20:17.624932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:38.578 [2024-11-26 04:20:17.624937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:39.512 04:20:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:39.512 04:20:18 -- common/autotest_common.sh@862 -- # return 0 00:08:39.512 04:20:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:39.512 04:20:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:39.512 04:20:18 -- common/autotest_common.sh@10 -- # set +x 00:08:39.512 04:20:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:39.512 04:20:18 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:39.512 04:20:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.512 04:20:18 -- common/autotest_common.sh@10 -- # set +x 00:08:39.512 [2024-11-26 04:20:18.531546] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:39.512 04:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.512 04:20:18 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:39.512 04:20:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.512 04:20:18 -- common/autotest_common.sh@10 -- # set +x 00:08:39.512 04:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.512 04:20:18 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:39.512 04:20:18 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:39.512 04:20:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.512 04:20:18 -- common/autotest_common.sh@10 -- # set +x 00:08:39.512 04:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.512 04:20:18 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:39.512 04:20:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.512 04:20:18 -- common/autotest_common.sh@10 -- # set +x 00:08:39.512 04:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.512 04:20:18 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:39.512 04:20:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.512 04:20:18 -- common/autotest_common.sh@10 -- # set +x 00:08:39.512 [2024-11-26 04:20:18.587478] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:39.512 04:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.512 04:20:18 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:08:39.512 04:20:18 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:08:39.512 04:20:18 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:08:39.512 04:20:18 -- target/connect_disconnect.sh@34 -- # set +x 00:08:42.040 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.569 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.468 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.995 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.544 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.496 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.033 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.943 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.480 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.019 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.923 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.459 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.997 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.902 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.442 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.981 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.887 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.495 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.030 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.939 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.467 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.373 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.914 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.452 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.361 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.895 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.804 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.345 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.880 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.791 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.335 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.873 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.781 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.317 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.851 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.759 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.297 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.208 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.745 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.284 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.825 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.735 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.278 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.186 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.776 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.684 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.219 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.761 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.693 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.230 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.135 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.671 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.206 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.114 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.653 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.560 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.093 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.630 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.540 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.076 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.014 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.547 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.458 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.997 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.538 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.448 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.985 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.523 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.882 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.419 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.957 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.492 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.396 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.930 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.837 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.373 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.911 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.817 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.413 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.952 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.853 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:53.386 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.293 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.829 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:00.363 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.269 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.805 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.346 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.890 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.796 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.331 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.231 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.769 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.300 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.205 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.743 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:28.276 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.220 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.220 04:24:09 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:30.220 04:24:09 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:30.220 04:24:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:30.220 04:24:09 -- nvmf/common.sh@116 -- # sync 00:12:30.220 04:24:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:30.220 04:24:09 -- nvmf/common.sh@119 -- # set +e 00:12:30.220 04:24:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:30.220 04:24:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:30.220 rmmod nvme_tcp 00:12:30.220 rmmod nvme_fabrics 00:12:30.220 rmmod nvme_keyring 00:12:30.220 04:24:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:30.220 04:24:09 -- nvmf/common.sh@123 -- # set -e 00:12:30.220 04:24:09 -- nvmf/common.sh@124 -- # return 0 00:12:30.220 04:24:09 -- nvmf/common.sh@477 -- # '[' -n 2823487 ']' 00:12:30.220 04:24:09 -- nvmf/common.sh@478 -- # killprocess 2823487 00:12:30.220 04:24:09 -- common/autotest_common.sh@936 -- # '[' -z 2823487 ']' 00:12:30.220 04:24:09 -- common/autotest_common.sh@940 -- # kill -0 2823487 00:12:30.220 04:24:09 -- common/autotest_common.sh@941 -- # uname 00:12:30.220 04:24:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:30.220 04:24:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2823487 00:12:30.478 04:24:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:30.478 04:24:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:30.478 04:24:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2823487' 00:12:30.478 killing process with pid 2823487 00:12:30.478 04:24:09 -- common/autotest_common.sh@955 -- # kill 2823487 00:12:30.478 04:24:09 -- common/autotest_common.sh@960 -- # wait 2823487 00:12:30.737 04:24:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:30.737 04:24:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:30.737 04:24:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:30.737 04:24:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:30.737 04:24:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:30.737 04:24:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:30.737 04:24:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:30.737 04:24:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:32.643 04:24:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:32.643 00:12:32.643 real 3m56.775s 00:12:32.643 user 15m2.242s 00:12:32.643 sys 0m34.870s 00:12:32.643 04:24:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:32.643 04:24:11 -- common/autotest_common.sh@10 -- # set +x 00:12:32.643 ************************************ 00:12:32.643 END TEST nvmf_connect_disconnect 00:12:32.643 ************************************ 00:12:32.643 04:24:11 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:32.643 04:24:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:32.643 04:24:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:32.643 04:24:11 -- common/autotest_common.sh@10 -- # set +x 00:12:32.643 ************************************ 00:12:32.643 START TEST nvmf_multitarget 00:12:32.643 ************************************ 00:12:32.643 04:24:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:32.643 * Looking for test storage... 00:12:32.643 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:32.643 04:24:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:32.643 04:24:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:32.643 04:24:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:32.902 04:24:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:32.902 04:24:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:32.902 04:24:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:32.902 04:24:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:32.902 04:24:11 -- scripts/common.sh@335 -- # IFS=.-: 00:12:32.903 04:24:11 -- scripts/common.sh@335 -- # read -ra ver1 00:12:32.903 04:24:11 -- scripts/common.sh@336 -- # IFS=.-: 00:12:32.903 04:24:11 -- scripts/common.sh@336 -- # read -ra ver2 00:12:32.903 04:24:11 -- scripts/common.sh@337 -- # local 'op=<' 00:12:32.903 04:24:11 -- scripts/common.sh@339 -- # ver1_l=2 00:12:32.903 04:24:11 -- scripts/common.sh@340 -- # ver2_l=1 00:12:32.903 04:24:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:32.903 04:24:11 -- scripts/common.sh@343 -- # case "$op" in 00:12:32.903 04:24:11 -- scripts/common.sh@344 -- # : 1 00:12:32.903 04:24:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:32.903 04:24:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:32.903 04:24:11 -- scripts/common.sh@364 -- # decimal 1 00:12:32.903 04:24:11 -- scripts/common.sh@352 -- # local d=1 00:12:32.903 04:24:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:32.903 04:24:11 -- scripts/common.sh@354 -- # echo 1 00:12:32.903 04:24:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:32.903 04:24:11 -- scripts/common.sh@365 -- # decimal 2 00:12:32.903 04:24:11 -- scripts/common.sh@352 -- # local d=2 00:12:32.903 04:24:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:32.903 04:24:11 -- scripts/common.sh@354 -- # echo 2 00:12:32.903 04:24:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:32.903 04:24:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:32.903 04:24:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:32.903 04:24:11 -- scripts/common.sh@367 -- # return 0 00:12:32.903 04:24:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:32.903 04:24:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:32.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:32.903 --rc genhtml_branch_coverage=1 00:12:32.903 --rc genhtml_function_coverage=1 00:12:32.903 --rc genhtml_legend=1 00:12:32.903 --rc geninfo_all_blocks=1 00:12:32.903 --rc geninfo_unexecuted_blocks=1 00:12:32.903 00:12:32.903 ' 00:12:32.903 04:24:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:32.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:32.903 --rc genhtml_branch_coverage=1 00:12:32.903 --rc genhtml_function_coverage=1 00:12:32.903 --rc genhtml_legend=1 00:12:32.903 --rc geninfo_all_blocks=1 00:12:32.903 --rc geninfo_unexecuted_blocks=1 00:12:32.903 00:12:32.903 ' 00:12:32.903 04:24:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:32.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:32.903 --rc genhtml_branch_coverage=1 00:12:32.903 --rc genhtml_function_coverage=1 00:12:32.903 --rc genhtml_legend=1 00:12:32.903 --rc geninfo_all_blocks=1 00:12:32.903 --rc geninfo_unexecuted_blocks=1 00:12:32.903 00:12:32.903 ' 00:12:32.903 04:24:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:32.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:32.903 --rc genhtml_branch_coverage=1 00:12:32.903 --rc genhtml_function_coverage=1 00:12:32.903 --rc genhtml_legend=1 00:12:32.903 --rc geninfo_all_blocks=1 00:12:32.903 --rc geninfo_unexecuted_blocks=1 00:12:32.903 00:12:32.903 ' 00:12:32.903 04:24:11 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:32.903 04:24:11 -- nvmf/common.sh@7 -- # uname -s 00:12:32.903 04:24:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:32.903 04:24:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:32.903 04:24:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:32.903 04:24:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:32.903 04:24:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:32.903 04:24:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:32.903 04:24:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:32.903 04:24:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:32.903 04:24:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:32.903 04:24:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:32.903 04:24:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:32.903 04:24:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:32.903 04:24:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:32.903 04:24:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:32.903 04:24:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:32.903 04:24:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:32.903 04:24:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:32.903 04:24:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:32.903 04:24:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:32.903 04:24:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:32.903 04:24:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:32.903 04:24:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:32.903 04:24:11 -- paths/export.sh@5 -- # export PATH 00:12:32.903 04:24:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:32.903 04:24:11 -- nvmf/common.sh@46 -- # : 0 00:12:32.903 04:24:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:32.903 04:24:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:32.903 04:24:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:32.903 04:24:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:32.903 04:24:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:32.903 04:24:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:32.903 04:24:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:32.903 04:24:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:32.903 04:24:11 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:32.903 04:24:11 -- target/multitarget.sh@15 -- # nvmftestinit 00:12:32.903 04:24:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:32.903 04:24:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:32.903 04:24:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:32.903 04:24:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:32.903 04:24:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:32.903 04:24:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:32.903 04:24:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:32.903 04:24:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:32.903 04:24:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:32.903 04:24:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:32.903 04:24:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:32.903 04:24:11 -- common/autotest_common.sh@10 -- # set +x 00:12:34.807 04:24:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:34.807 04:24:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:34.807 04:24:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:34.807 04:24:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:34.807 04:24:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:34.807 04:24:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:34.807 04:24:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:34.807 04:24:13 -- nvmf/common.sh@294 -- # net_devs=() 00:12:34.807 04:24:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:34.807 04:24:13 -- nvmf/common.sh@295 -- # e810=() 00:12:34.807 04:24:13 -- nvmf/common.sh@295 -- # local -ga e810 00:12:34.807 04:24:13 -- nvmf/common.sh@296 -- # x722=() 00:12:34.807 04:24:13 -- nvmf/common.sh@296 -- # local -ga x722 00:12:34.807 04:24:13 -- nvmf/common.sh@297 -- # mlx=() 00:12:34.807 04:24:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:34.807 04:24:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:34.807 04:24:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:34.807 04:24:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:34.807 04:24:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:34.807 04:24:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:34.807 04:24:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:34.807 04:24:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:34.807 04:24:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:34.807 04:24:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:34.807 04:24:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:34.807 04:24:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:34.807 04:24:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:34.807 04:24:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:34.807 04:24:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:34.807 04:24:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:34.807 04:24:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:34.807 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:34.807 04:24:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:34.807 04:24:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:34.807 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:34.807 04:24:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:34.807 04:24:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:34.807 04:24:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:34.807 04:24:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:34.807 04:24:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:34.807 04:24:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:34.807 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:34.807 04:24:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:34.807 04:24:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:34.807 04:24:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:34.807 04:24:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:34.807 04:24:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:34.807 04:24:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:34.807 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:34.807 04:24:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:34.807 04:24:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:34.807 04:24:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:34.807 04:24:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:34.807 04:24:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:34.807 04:24:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:34.807 04:24:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:34.807 04:24:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:34.807 04:24:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:34.807 04:24:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:34.807 04:24:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:34.807 04:24:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:34.807 04:24:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:34.807 04:24:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:34.807 04:24:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:34.807 04:24:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:34.807 04:24:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:34.807 04:24:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:35.065 04:24:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:35.065 04:24:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:35.065 04:24:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:35.065 04:24:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:35.065 04:24:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:35.065 04:24:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:35.065 04:24:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:35.065 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:35.065 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.253 ms 00:12:35.065 00:12:35.065 --- 10.0.0.2 ping statistics --- 00:12:35.066 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:35.066 rtt min/avg/max/mdev = 0.253/0.253/0.253/0.000 ms 00:12:35.066 04:24:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:35.066 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:35.066 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:12:35.066 00:12:35.066 --- 10.0.0.1 ping statistics --- 00:12:35.066 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:35.066 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:12:35.066 04:24:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:35.066 04:24:14 -- nvmf/common.sh@410 -- # return 0 00:12:35.066 04:24:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:35.066 04:24:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:35.066 04:24:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:35.066 04:24:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:35.066 04:24:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:35.066 04:24:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:35.066 04:24:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:35.066 04:24:14 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:12:35.066 04:24:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:35.066 04:24:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:35.066 04:24:14 -- common/autotest_common.sh@10 -- # set +x 00:12:35.066 04:24:14 -- nvmf/common.sh@469 -- # nvmfpid=2856175 00:12:35.066 04:24:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:35.066 04:24:14 -- nvmf/common.sh@470 -- # waitforlisten 2856175 00:12:35.066 04:24:14 -- common/autotest_common.sh@829 -- # '[' -z 2856175 ']' 00:12:35.066 04:24:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:35.066 04:24:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:35.066 04:24:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:35.066 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:35.066 04:24:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:35.066 04:24:14 -- common/autotest_common.sh@10 -- # set +x 00:12:35.324 [2024-11-26 04:24:14.292296] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:12:35.324 [2024-11-26 04:24:14.292375] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:35.324 EAL: No free 2048 kB hugepages reported on node 1 00:12:35.324 [2024-11-26 04:24:14.363527] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:35.324 [2024-11-26 04:24:14.450981] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:35.324 [2024-11-26 04:24:14.451158] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:35.324 [2024-11-26 04:24:14.451189] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:35.324 [2024-11-26 04:24:14.451202] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:35.324 [2024-11-26 04:24:14.451364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:35.324 [2024-11-26 04:24:14.451418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:35.324 [2024-11-26 04:24:14.451468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:35.324 [2024-11-26 04:24:14.451471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:36.257 04:24:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:36.257 04:24:15 -- common/autotest_common.sh@862 -- # return 0 00:12:36.257 04:24:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:36.257 04:24:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:36.257 04:24:15 -- common/autotest_common.sh@10 -- # set +x 00:12:36.257 04:24:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:36.257 04:24:15 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:36.257 04:24:15 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:36.257 04:24:15 -- target/multitarget.sh@21 -- # jq length 00:12:36.257 04:24:15 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:36.257 04:24:15 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:36.515 "nvmf_tgt_1" 00:12:36.515 04:24:15 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:36.515 "nvmf_tgt_2" 00:12:36.515 04:24:15 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:36.515 04:24:15 -- target/multitarget.sh@28 -- # jq length 00:12:36.773 04:24:15 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:36.773 04:24:15 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:36.773 true 00:12:36.773 04:24:15 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:36.773 true 00:12:37.033 04:24:15 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:37.033 04:24:15 -- target/multitarget.sh@35 -- # jq length 00:12:37.033 04:24:16 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:37.033 04:24:16 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:37.033 04:24:16 -- target/multitarget.sh@41 -- # nvmftestfini 00:12:37.033 04:24:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:37.033 04:24:16 -- nvmf/common.sh@116 -- # sync 00:12:37.033 04:24:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:37.033 04:24:16 -- nvmf/common.sh@119 -- # set +e 00:12:37.033 04:24:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:37.033 04:24:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:37.033 rmmod nvme_tcp 00:12:37.033 rmmod nvme_fabrics 00:12:37.033 rmmod nvme_keyring 00:12:37.033 04:24:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:37.033 04:24:16 -- nvmf/common.sh@123 -- # set -e 00:12:37.033 04:24:16 -- nvmf/common.sh@124 -- # return 0 00:12:37.033 04:24:16 -- nvmf/common.sh@477 -- # '[' -n 2856175 ']' 00:12:37.033 04:24:16 -- nvmf/common.sh@478 -- # killprocess 2856175 00:12:37.033 04:24:16 -- common/autotest_common.sh@936 -- # '[' -z 2856175 ']' 00:12:37.033 04:24:16 -- common/autotest_common.sh@940 -- # kill -0 2856175 00:12:37.033 04:24:16 -- common/autotest_common.sh@941 -- # uname 00:12:37.033 04:24:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:37.033 04:24:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2856175 00:12:37.033 04:24:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:37.033 04:24:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:37.033 04:24:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2856175' 00:12:37.033 killing process with pid 2856175 00:12:37.033 04:24:16 -- common/autotest_common.sh@955 -- # kill 2856175 00:12:37.033 04:24:16 -- common/autotest_common.sh@960 -- # wait 2856175 00:12:37.293 04:24:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:37.293 04:24:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:37.293 04:24:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:37.293 04:24:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:37.293 04:24:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:37.293 04:24:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:37.293 04:24:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:37.293 04:24:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:39.843 04:24:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:39.843 00:12:39.843 real 0m6.703s 00:12:39.843 user 0m9.720s 00:12:39.843 sys 0m2.012s 00:12:39.843 04:24:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:39.843 04:24:18 -- common/autotest_common.sh@10 -- # set +x 00:12:39.843 ************************************ 00:12:39.843 END TEST nvmf_multitarget 00:12:39.843 ************************************ 00:12:39.843 04:24:18 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:39.843 04:24:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:39.843 04:24:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:39.843 04:24:18 -- common/autotest_common.sh@10 -- # set +x 00:12:39.843 ************************************ 00:12:39.843 START TEST nvmf_rpc 00:12:39.843 ************************************ 00:12:39.843 04:24:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:39.843 * Looking for test storage... 00:12:39.843 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:39.843 04:24:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:39.843 04:24:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:39.843 04:24:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:39.843 04:24:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:39.843 04:24:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:39.843 04:24:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:39.844 04:24:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:39.844 04:24:18 -- scripts/common.sh@335 -- # IFS=.-: 00:12:39.844 04:24:18 -- scripts/common.sh@335 -- # read -ra ver1 00:12:39.844 04:24:18 -- scripts/common.sh@336 -- # IFS=.-: 00:12:39.844 04:24:18 -- scripts/common.sh@336 -- # read -ra ver2 00:12:39.844 04:24:18 -- scripts/common.sh@337 -- # local 'op=<' 00:12:39.844 04:24:18 -- scripts/common.sh@339 -- # ver1_l=2 00:12:39.844 04:24:18 -- scripts/common.sh@340 -- # ver2_l=1 00:12:39.844 04:24:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:39.844 04:24:18 -- scripts/common.sh@343 -- # case "$op" in 00:12:39.844 04:24:18 -- scripts/common.sh@344 -- # : 1 00:12:39.844 04:24:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:39.844 04:24:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:39.844 04:24:18 -- scripts/common.sh@364 -- # decimal 1 00:12:39.844 04:24:18 -- scripts/common.sh@352 -- # local d=1 00:12:39.844 04:24:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:39.844 04:24:18 -- scripts/common.sh@354 -- # echo 1 00:12:39.844 04:24:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:39.844 04:24:18 -- scripts/common.sh@365 -- # decimal 2 00:12:39.844 04:24:18 -- scripts/common.sh@352 -- # local d=2 00:12:39.844 04:24:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:39.844 04:24:18 -- scripts/common.sh@354 -- # echo 2 00:12:39.844 04:24:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:39.844 04:24:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:39.844 04:24:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:39.844 04:24:18 -- scripts/common.sh@367 -- # return 0 00:12:39.844 04:24:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:39.844 04:24:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:39.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:39.844 --rc genhtml_branch_coverage=1 00:12:39.844 --rc genhtml_function_coverage=1 00:12:39.844 --rc genhtml_legend=1 00:12:39.844 --rc geninfo_all_blocks=1 00:12:39.844 --rc geninfo_unexecuted_blocks=1 00:12:39.844 00:12:39.844 ' 00:12:39.844 04:24:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:39.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:39.844 --rc genhtml_branch_coverage=1 00:12:39.844 --rc genhtml_function_coverage=1 00:12:39.844 --rc genhtml_legend=1 00:12:39.844 --rc geninfo_all_blocks=1 00:12:39.844 --rc geninfo_unexecuted_blocks=1 00:12:39.844 00:12:39.844 ' 00:12:39.844 04:24:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:39.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:39.844 --rc genhtml_branch_coverage=1 00:12:39.844 --rc genhtml_function_coverage=1 00:12:39.844 --rc genhtml_legend=1 00:12:39.844 --rc geninfo_all_blocks=1 00:12:39.844 --rc geninfo_unexecuted_blocks=1 00:12:39.844 00:12:39.844 ' 00:12:39.844 04:24:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:39.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:39.844 --rc genhtml_branch_coverage=1 00:12:39.844 --rc genhtml_function_coverage=1 00:12:39.844 --rc genhtml_legend=1 00:12:39.844 --rc geninfo_all_blocks=1 00:12:39.844 --rc geninfo_unexecuted_blocks=1 00:12:39.844 00:12:39.844 ' 00:12:39.844 04:24:18 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:39.844 04:24:18 -- nvmf/common.sh@7 -- # uname -s 00:12:39.844 04:24:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:39.844 04:24:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:39.844 04:24:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:39.844 04:24:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:39.844 04:24:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:39.844 04:24:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:39.844 04:24:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:39.844 04:24:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:39.844 04:24:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:39.844 04:24:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:39.844 04:24:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:39.844 04:24:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:39.844 04:24:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:39.844 04:24:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:39.844 04:24:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:39.844 04:24:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:39.844 04:24:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:39.844 04:24:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:39.844 04:24:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:39.844 04:24:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:39.844 04:24:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:39.844 04:24:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:39.844 04:24:18 -- paths/export.sh@5 -- # export PATH 00:12:39.844 04:24:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:39.844 04:24:18 -- nvmf/common.sh@46 -- # : 0 00:12:39.844 04:24:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:39.844 04:24:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:39.844 04:24:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:39.844 04:24:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:39.844 04:24:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:39.844 04:24:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:39.844 04:24:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:39.844 04:24:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:39.844 04:24:18 -- target/rpc.sh@11 -- # loops=5 00:12:39.844 04:24:18 -- target/rpc.sh@23 -- # nvmftestinit 00:12:39.844 04:24:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:39.844 04:24:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:39.844 04:24:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:39.844 04:24:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:39.844 04:24:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:39.844 04:24:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:39.844 04:24:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:39.844 04:24:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:39.844 04:24:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:39.844 04:24:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:39.844 04:24:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:39.844 04:24:18 -- common/autotest_common.sh@10 -- # set +x 00:12:41.753 04:24:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:41.753 04:24:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:41.753 04:24:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:41.753 04:24:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:41.753 04:24:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:41.753 04:24:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:41.753 04:24:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:41.753 04:24:20 -- nvmf/common.sh@294 -- # net_devs=() 00:12:41.753 04:24:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:41.753 04:24:20 -- nvmf/common.sh@295 -- # e810=() 00:12:41.753 04:24:20 -- nvmf/common.sh@295 -- # local -ga e810 00:12:41.753 04:24:20 -- nvmf/common.sh@296 -- # x722=() 00:12:41.753 04:24:20 -- nvmf/common.sh@296 -- # local -ga x722 00:12:41.753 04:24:20 -- nvmf/common.sh@297 -- # mlx=() 00:12:41.753 04:24:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:41.753 04:24:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:41.753 04:24:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:41.753 04:24:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:41.753 04:24:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:41.753 04:24:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:41.753 04:24:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:41.753 04:24:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:41.753 04:24:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:41.753 04:24:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:41.753 04:24:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:41.753 04:24:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:41.753 04:24:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:41.753 04:24:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:41.753 04:24:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:41.753 04:24:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:41.753 04:24:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:41.753 04:24:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:41.753 04:24:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:41.753 04:24:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:41.753 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:41.753 04:24:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:41.753 04:24:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:41.753 04:24:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:41.753 04:24:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:41.753 04:24:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:41.753 04:24:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:41.753 04:24:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:41.753 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:41.753 04:24:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:41.753 04:24:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:41.754 04:24:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:41.754 04:24:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:41.754 04:24:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:41.754 04:24:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:41.754 04:24:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:41.754 04:24:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:41.754 04:24:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:41.754 04:24:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:41.754 04:24:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:41.754 04:24:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:41.754 04:24:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:41.754 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:41.754 04:24:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:41.754 04:24:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:41.754 04:24:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:41.754 04:24:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:41.754 04:24:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:41.754 04:24:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:41.754 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:41.754 04:24:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:41.754 04:24:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:41.754 04:24:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:41.754 04:24:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:41.754 04:24:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:41.754 04:24:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:41.754 04:24:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:41.754 04:24:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:41.754 04:24:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:41.754 04:24:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:41.754 04:24:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:41.754 04:24:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:41.754 04:24:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:41.754 04:24:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:41.754 04:24:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:41.754 04:24:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:41.754 04:24:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:41.754 04:24:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:41.754 04:24:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:41.754 04:24:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:41.754 04:24:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:41.754 04:24:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:41.754 04:24:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:41.754 04:24:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:41.754 04:24:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:41.754 04:24:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:41.754 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:41.754 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.260 ms 00:12:41.754 00:12:41.754 --- 10.0.0.2 ping statistics --- 00:12:41.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:41.754 rtt min/avg/max/mdev = 0.260/0.260/0.260/0.000 ms 00:12:41.754 04:24:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:41.754 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:41.754 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:12:41.754 00:12:41.754 --- 10.0.0.1 ping statistics --- 00:12:41.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:41.754 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:12:41.754 04:24:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:41.754 04:24:20 -- nvmf/common.sh@410 -- # return 0 00:12:41.754 04:24:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:41.754 04:24:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:41.754 04:24:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:41.754 04:24:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:41.754 04:24:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:41.754 04:24:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:41.754 04:24:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:41.754 04:24:20 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:41.754 04:24:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:41.754 04:24:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:41.754 04:24:20 -- common/autotest_common.sh@10 -- # set +x 00:12:41.754 04:24:20 -- nvmf/common.sh@469 -- # nvmfpid=2858333 00:12:41.754 04:24:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:41.754 04:24:20 -- nvmf/common.sh@470 -- # waitforlisten 2858333 00:12:41.754 04:24:20 -- common/autotest_common.sh@829 -- # '[' -z 2858333 ']' 00:12:41.754 04:24:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:41.754 04:24:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:41.754 04:24:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:41.754 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:41.754 04:24:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:41.754 04:24:20 -- common/autotest_common.sh@10 -- # set +x 00:12:41.754 [2024-11-26 04:24:20.846138] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:12:41.754 [2024-11-26 04:24:20.846217] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:41.754 EAL: No free 2048 kB hugepages reported on node 1 00:12:41.754 [2024-11-26 04:24:20.918577] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:42.014 [2024-11-26 04:24:21.008033] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:42.014 [2024-11-26 04:24:21.008194] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:42.014 [2024-11-26 04:24:21.008229] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:42.014 [2024-11-26 04:24:21.008242] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:42.014 [2024-11-26 04:24:21.008384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:42.014 [2024-11-26 04:24:21.008437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:42.014 [2024-11-26 04:24:21.008488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:42.014 [2024-11-26 04:24:21.008491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:42.954 04:24:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:42.954 04:24:21 -- common/autotest_common.sh@862 -- # return 0 00:12:42.954 04:24:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:42.954 04:24:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:42.954 04:24:21 -- common/autotest_common.sh@10 -- # set +x 00:12:42.954 04:24:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:42.954 04:24:21 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:42.954 04:24:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.954 04:24:21 -- common/autotest_common.sh@10 -- # set +x 00:12:42.954 04:24:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.954 04:24:21 -- target/rpc.sh@26 -- # stats='{ 00:12:42.954 "tick_rate": 2700000000, 00:12:42.954 "poll_groups": [ 00:12:42.954 { 00:12:42.954 "name": "nvmf_tgt_poll_group_0", 00:12:42.954 "admin_qpairs": 0, 00:12:42.954 "io_qpairs": 0, 00:12:42.954 "current_admin_qpairs": 0, 00:12:42.954 "current_io_qpairs": 0, 00:12:42.954 "pending_bdev_io": 0, 00:12:42.954 "completed_nvme_io": 0, 00:12:42.954 "transports": [] 00:12:42.954 }, 00:12:42.954 { 00:12:42.954 "name": "nvmf_tgt_poll_group_1", 00:12:42.954 "admin_qpairs": 0, 00:12:42.954 "io_qpairs": 0, 00:12:42.954 "current_admin_qpairs": 0, 00:12:42.954 "current_io_qpairs": 0, 00:12:42.954 "pending_bdev_io": 0, 00:12:42.954 "completed_nvme_io": 0, 00:12:42.954 "transports": [] 00:12:42.954 }, 00:12:42.954 { 00:12:42.954 "name": "nvmf_tgt_poll_group_2", 00:12:42.954 "admin_qpairs": 0, 00:12:42.954 "io_qpairs": 0, 00:12:42.954 "current_admin_qpairs": 0, 00:12:42.954 "current_io_qpairs": 0, 00:12:42.954 "pending_bdev_io": 0, 00:12:42.954 "completed_nvme_io": 0, 00:12:42.954 "transports": [] 00:12:42.954 }, 00:12:42.954 { 00:12:42.954 "name": "nvmf_tgt_poll_group_3", 00:12:42.954 "admin_qpairs": 0, 00:12:42.954 "io_qpairs": 0, 00:12:42.954 "current_admin_qpairs": 0, 00:12:42.954 "current_io_qpairs": 0, 00:12:42.954 "pending_bdev_io": 0, 00:12:42.954 "completed_nvme_io": 0, 00:12:42.954 "transports": [] 00:12:42.954 } 00:12:42.954 ] 00:12:42.954 }' 00:12:42.954 04:24:21 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:42.954 04:24:21 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:42.954 04:24:21 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:42.954 04:24:21 -- target/rpc.sh@15 -- # wc -l 00:12:42.954 04:24:21 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:42.954 04:24:21 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:42.954 04:24:21 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:42.954 04:24:21 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:42.954 04:24:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.954 04:24:21 -- common/autotest_common.sh@10 -- # set +x 00:12:42.954 [2024-11-26 04:24:21.941679] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:42.954 04:24:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.954 04:24:21 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:42.954 04:24:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.954 04:24:21 -- common/autotest_common.sh@10 -- # set +x 00:12:42.954 04:24:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.954 04:24:21 -- target/rpc.sh@33 -- # stats='{ 00:12:42.954 "tick_rate": 2700000000, 00:12:42.954 "poll_groups": [ 00:12:42.954 { 00:12:42.954 "name": "nvmf_tgt_poll_group_0", 00:12:42.954 "admin_qpairs": 0, 00:12:42.954 "io_qpairs": 0, 00:12:42.954 "current_admin_qpairs": 0, 00:12:42.954 "current_io_qpairs": 0, 00:12:42.954 "pending_bdev_io": 0, 00:12:42.954 "completed_nvme_io": 0, 00:12:42.954 "transports": [ 00:12:42.954 { 00:12:42.954 "trtype": "TCP" 00:12:42.954 } 00:12:42.954 ] 00:12:42.954 }, 00:12:42.954 { 00:12:42.954 "name": "nvmf_tgt_poll_group_1", 00:12:42.954 "admin_qpairs": 0, 00:12:42.954 "io_qpairs": 0, 00:12:42.954 "current_admin_qpairs": 0, 00:12:42.954 "current_io_qpairs": 0, 00:12:42.954 "pending_bdev_io": 0, 00:12:42.954 "completed_nvme_io": 0, 00:12:42.954 "transports": [ 00:12:42.954 { 00:12:42.954 "trtype": "TCP" 00:12:42.954 } 00:12:42.954 ] 00:12:42.954 }, 00:12:42.954 { 00:12:42.954 "name": "nvmf_tgt_poll_group_2", 00:12:42.954 "admin_qpairs": 0, 00:12:42.954 "io_qpairs": 0, 00:12:42.954 "current_admin_qpairs": 0, 00:12:42.954 "current_io_qpairs": 0, 00:12:42.954 "pending_bdev_io": 0, 00:12:42.954 "completed_nvme_io": 0, 00:12:42.954 "transports": [ 00:12:42.954 { 00:12:42.954 "trtype": "TCP" 00:12:42.954 } 00:12:42.954 ] 00:12:42.954 }, 00:12:42.954 { 00:12:42.954 "name": "nvmf_tgt_poll_group_3", 00:12:42.954 "admin_qpairs": 0, 00:12:42.954 "io_qpairs": 0, 00:12:42.954 "current_admin_qpairs": 0, 00:12:42.954 "current_io_qpairs": 0, 00:12:42.954 "pending_bdev_io": 0, 00:12:42.954 "completed_nvme_io": 0, 00:12:42.954 "transports": [ 00:12:42.954 { 00:12:42.954 "trtype": "TCP" 00:12:42.954 } 00:12:42.954 ] 00:12:42.954 } 00:12:42.954 ] 00:12:42.954 }' 00:12:42.954 04:24:21 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:42.954 04:24:21 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:42.954 04:24:21 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:42.954 04:24:21 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:42.954 04:24:22 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:42.954 04:24:22 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:42.954 04:24:22 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:42.954 04:24:22 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:42.954 04:24:22 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:42.954 04:24:22 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:42.954 04:24:22 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:42.954 04:24:22 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:42.954 04:24:22 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:42.954 04:24:22 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:42.954 04:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.954 04:24:22 -- common/autotest_common.sh@10 -- # set +x 00:12:42.954 Malloc1 00:12:42.954 04:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.954 04:24:22 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:42.954 04:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.954 04:24:22 -- common/autotest_common.sh@10 -- # set +x 00:12:42.954 04:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.954 04:24:22 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:42.954 04:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.954 04:24:22 -- common/autotest_common.sh@10 -- # set +x 00:12:42.955 04:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.955 04:24:22 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:42.955 04:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.955 04:24:22 -- common/autotest_common.sh@10 -- # set +x 00:12:42.955 04:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.955 04:24:22 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:42.955 04:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.955 04:24:22 -- common/autotest_common.sh@10 -- # set +x 00:12:42.955 [2024-11-26 04:24:22.095275] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:42.955 04:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.955 04:24:22 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:42.955 04:24:22 -- common/autotest_common.sh@650 -- # local es=0 00:12:42.955 04:24:22 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:42.955 04:24:22 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:42.955 04:24:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:42.955 04:24:22 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:42.955 04:24:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:42.955 04:24:22 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:42.955 04:24:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:42.955 04:24:22 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:42.955 04:24:22 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:42.955 04:24:22 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:42.955 [2024-11-26 04:24:22.117864] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:42.955 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:42.955 could not add new controller: failed to write to nvme-fabrics device 00:12:42.955 04:24:22 -- common/autotest_common.sh@653 -- # es=1 00:12:42.955 04:24:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:42.955 04:24:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:42.955 04:24:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:42.955 04:24:22 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:42.955 04:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.955 04:24:22 -- common/autotest_common.sh@10 -- # set +x 00:12:42.955 04:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.955 04:24:22 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:43.894 04:24:22 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:43.894 04:24:22 -- common/autotest_common.sh@1187 -- # local i=0 00:12:43.894 04:24:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:43.894 04:24:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:43.894 04:24:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:45.801 04:24:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:45.801 04:24:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:45.801 04:24:24 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:45.801 04:24:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:45.801 04:24:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:45.801 04:24:24 -- common/autotest_common.sh@1197 -- # return 0 00:12:45.801 04:24:24 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:45.801 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:45.801 04:24:24 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:45.801 04:24:24 -- common/autotest_common.sh@1208 -- # local i=0 00:12:45.801 04:24:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:45.801 04:24:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:45.801 04:24:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:45.801 04:24:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:45.801 04:24:24 -- common/autotest_common.sh@1220 -- # return 0 00:12:45.801 04:24:24 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:45.801 04:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:45.801 04:24:24 -- common/autotest_common.sh@10 -- # set +x 00:12:45.801 04:24:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:45.801 04:24:24 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:45.801 04:24:24 -- common/autotest_common.sh@650 -- # local es=0 00:12:45.801 04:24:24 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:45.801 04:24:24 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:45.801 04:24:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:45.801 04:24:24 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:45.801 04:24:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:45.801 04:24:24 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:45.801 04:24:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:45.801 04:24:24 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:45.801 04:24:24 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:45.801 04:24:24 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:45.801 [2024-11-26 04:24:24.958015] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:45.801 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:45.801 could not add new controller: failed to write to nvme-fabrics device 00:12:45.801 04:24:24 -- common/autotest_common.sh@653 -- # es=1 00:12:45.801 04:24:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:45.801 04:24:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:45.801 04:24:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:45.801 04:24:24 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:45.801 04:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:45.801 04:24:24 -- common/autotest_common.sh@10 -- # set +x 00:12:45.801 04:24:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:45.801 04:24:24 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:46.739 04:24:25 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:46.739 04:24:25 -- common/autotest_common.sh@1187 -- # local i=0 00:12:46.739 04:24:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:46.739 04:24:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:46.739 04:24:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:48.648 04:24:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:48.648 04:24:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:48.648 04:24:27 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:48.648 04:24:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:48.648 04:24:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:48.648 04:24:27 -- common/autotest_common.sh@1197 -- # return 0 00:12:48.649 04:24:27 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:48.649 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.649 04:24:27 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:48.649 04:24:27 -- common/autotest_common.sh@1208 -- # local i=0 00:12:48.649 04:24:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:48.649 04:24:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:48.649 04:24:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:48.649 04:24:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:48.649 04:24:27 -- common/autotest_common.sh@1220 -- # return 0 00:12:48.649 04:24:27 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:48.649 04:24:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:48.649 04:24:27 -- common/autotest_common.sh@10 -- # set +x 00:12:48.649 04:24:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:48.649 04:24:27 -- target/rpc.sh@81 -- # seq 1 5 00:12:48.649 04:24:27 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:48.649 04:24:27 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:48.649 04:24:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:48.649 04:24:27 -- common/autotest_common.sh@10 -- # set +x 00:12:48.649 04:24:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:48.649 04:24:27 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:48.649 04:24:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:48.649 04:24:27 -- common/autotest_common.sh@10 -- # set +x 00:12:48.649 [2024-11-26 04:24:27.813798] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:48.649 04:24:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:48.649 04:24:27 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:48.649 04:24:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:48.649 04:24:27 -- common/autotest_common.sh@10 -- # set +x 00:12:48.649 04:24:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:48.649 04:24:27 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:48.649 04:24:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:48.649 04:24:27 -- common/autotest_common.sh@10 -- # set +x 00:12:48.649 04:24:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:48.649 04:24:27 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:49.220 04:24:28 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:49.220 04:24:28 -- common/autotest_common.sh@1187 -- # local i=0 00:12:49.220 04:24:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:49.220 04:24:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:49.220 04:24:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:51.753 04:24:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:51.753 04:24:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:51.753 04:24:30 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:51.753 04:24:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:51.753 04:24:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:51.753 04:24:30 -- common/autotest_common.sh@1197 -- # return 0 00:12:51.753 04:24:30 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:51.753 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:51.753 04:24:30 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:51.753 04:24:30 -- common/autotest_common.sh@1208 -- # local i=0 00:12:51.753 04:24:30 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:51.753 04:24:30 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:51.753 04:24:30 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:51.753 04:24:30 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:51.753 04:24:30 -- common/autotest_common.sh@1220 -- # return 0 00:12:51.753 04:24:30 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:51.753 04:24:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.753 04:24:30 -- common/autotest_common.sh@10 -- # set +x 00:12:51.753 04:24:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.753 04:24:30 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:51.753 04:24:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.753 04:24:30 -- common/autotest_common.sh@10 -- # set +x 00:12:51.753 04:24:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.753 04:24:30 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:51.753 04:24:30 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:51.753 04:24:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.753 04:24:30 -- common/autotest_common.sh@10 -- # set +x 00:12:51.753 04:24:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.753 04:24:30 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:51.753 04:24:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.753 04:24:30 -- common/autotest_common.sh@10 -- # set +x 00:12:51.753 [2024-11-26 04:24:30.590917] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:51.753 04:24:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.753 04:24:30 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:51.753 04:24:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.753 04:24:30 -- common/autotest_common.sh@10 -- # set +x 00:12:51.753 04:24:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.753 04:24:30 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:51.753 04:24:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.753 04:24:30 -- common/autotest_common.sh@10 -- # set +x 00:12:51.753 04:24:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.753 04:24:30 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:52.012 04:24:31 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:52.012 04:24:31 -- common/autotest_common.sh@1187 -- # local i=0 00:12:52.012 04:24:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:52.012 04:24:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:52.012 04:24:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:54.551 04:24:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:54.551 04:24:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:54.551 04:24:33 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:54.551 04:24:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:54.551 04:24:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:54.551 04:24:33 -- common/autotest_common.sh@1197 -- # return 0 00:12:54.551 04:24:33 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:54.551 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:54.551 04:24:33 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:54.551 04:24:33 -- common/autotest_common.sh@1208 -- # local i=0 00:12:54.551 04:24:33 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:54.551 04:24:33 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:54.551 04:24:33 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:54.551 04:24:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:54.551 04:24:33 -- common/autotest_common.sh@1220 -- # return 0 00:12:54.551 04:24:33 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:54.551 04:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:54.551 04:24:33 -- common/autotest_common.sh@10 -- # set +x 00:12:54.551 04:24:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:54.551 04:24:33 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:54.551 04:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:54.551 04:24:33 -- common/autotest_common.sh@10 -- # set +x 00:12:54.551 04:24:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:54.551 04:24:33 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:54.551 04:24:33 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:54.551 04:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:54.551 04:24:33 -- common/autotest_common.sh@10 -- # set +x 00:12:54.551 04:24:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:54.551 04:24:33 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:54.551 04:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:54.551 04:24:33 -- common/autotest_common.sh@10 -- # set +x 00:12:54.551 [2024-11-26 04:24:33.329917] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:54.551 04:24:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:54.551 04:24:33 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:54.551 04:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:54.552 04:24:33 -- common/autotest_common.sh@10 -- # set +x 00:12:54.552 04:24:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:54.552 04:24:33 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:54.552 04:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:54.552 04:24:33 -- common/autotest_common.sh@10 -- # set +x 00:12:54.552 04:24:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:54.552 04:24:33 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:55.120 04:24:34 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:55.120 04:24:34 -- common/autotest_common.sh@1187 -- # local i=0 00:12:55.120 04:24:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:55.120 04:24:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:55.120 04:24:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:57.031 04:24:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:57.031 04:24:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:57.031 04:24:36 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:57.031 04:24:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:57.031 04:24:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:57.031 04:24:36 -- common/autotest_common.sh@1197 -- # return 0 00:12:57.031 04:24:36 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:57.031 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:57.031 04:24:36 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:57.031 04:24:36 -- common/autotest_common.sh@1208 -- # local i=0 00:12:57.031 04:24:36 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:57.031 04:24:36 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:57.031 04:24:36 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:57.031 04:24:36 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:57.031 04:24:36 -- common/autotest_common.sh@1220 -- # return 0 00:12:57.031 04:24:36 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:57.031 04:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.031 04:24:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 04:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.031 04:24:36 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:57.031 04:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.031 04:24:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 04:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.031 04:24:36 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:57.031 04:24:36 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:57.031 04:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.031 04:24:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 04:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.031 04:24:36 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:57.031 04:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.031 04:24:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 [2024-11-26 04:24:36.202654] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:57.031 04:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.031 04:24:36 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:57.031 04:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.031 04:24:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 04:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.031 04:24:36 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:57.031 04:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.031 04:24:36 -- common/autotest_common.sh@10 -- # set +x 00:12:57.031 04:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.031 04:24:36 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:57.968 04:24:36 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:57.968 04:24:36 -- common/autotest_common.sh@1187 -- # local i=0 00:12:57.968 04:24:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:57.968 04:24:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:57.968 04:24:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:59.875 04:24:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:59.875 04:24:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:59.875 04:24:38 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:59.875 04:24:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:59.875 04:24:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:59.875 04:24:38 -- common/autotest_common.sh@1197 -- # return 0 00:12:59.875 04:24:38 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:59.875 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:59.875 04:24:39 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:59.875 04:24:39 -- common/autotest_common.sh@1208 -- # local i=0 00:12:59.875 04:24:39 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:59.875 04:24:39 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:59.875 04:24:39 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:59.875 04:24:39 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:59.875 04:24:39 -- common/autotest_common.sh@1220 -- # return 0 00:12:59.875 04:24:39 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:59.875 04:24:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.875 04:24:39 -- common/autotest_common.sh@10 -- # set +x 00:12:59.875 04:24:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.875 04:24:39 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:59.875 04:24:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.875 04:24:39 -- common/autotest_common.sh@10 -- # set +x 00:12:59.875 04:24:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.875 04:24:39 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:59.875 04:24:39 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:59.875 04:24:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.875 04:24:39 -- common/autotest_common.sh@10 -- # set +x 00:12:59.875 04:24:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.875 04:24:39 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:59.875 04:24:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.875 04:24:39 -- common/autotest_common.sh@10 -- # set +x 00:12:59.875 [2024-11-26 04:24:39.077085] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:59.875 04:24:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.875 04:24:39 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:59.875 04:24:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.875 04:24:39 -- common/autotest_common.sh@10 -- # set +x 00:12:59.875 04:24:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.875 04:24:39 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:59.875 04:24:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.875 04:24:39 -- common/autotest_common.sh@10 -- # set +x 00:13:00.146 04:24:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.146 04:24:39 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:00.715 04:24:39 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:00.715 04:24:39 -- common/autotest_common.sh@1187 -- # local i=0 00:13:00.715 04:24:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:00.715 04:24:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:00.715 04:24:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:02.621 04:24:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:02.622 04:24:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:02.622 04:24:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:02.622 04:24:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:02.622 04:24:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:02.622 04:24:41 -- common/autotest_common.sh@1197 -- # return 0 00:13:02.622 04:24:41 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:02.880 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.880 04:24:41 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:02.880 04:24:41 -- common/autotest_common.sh@1208 -- # local i=0 00:13:02.880 04:24:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:02.881 04:24:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:02.881 04:24:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:02.881 04:24:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:02.881 04:24:41 -- common/autotest_common.sh@1220 -- # return 0 00:13:02.881 04:24:41 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:02.881 04:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:41 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:02.881 04:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:41 -- target/rpc.sh@99 -- # seq 1 5 00:13:02.881 04:24:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:02.881 04:24:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:02.881 04:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:02.881 04:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 [2024-11-26 04:24:41.953527] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:02.881 04:24:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:02.881 04:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:02.881 04:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.881 04:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:02.881 04:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:02.881 04:24:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:02.881 04:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:02.881 04:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:41 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 [2024-11-26 04:24:42.001561] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:02.881 04:24:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 [2024-11-26 04:24:42.049765] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:02.881 04:24:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:02.881 [2024-11-26 04:24:42.097936] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:02.881 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.881 04:24:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:02.881 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.881 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:03.140 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.140 04:24:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:03.140 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.140 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:03.140 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.140 04:24:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.140 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.140 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:03.140 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.140 04:24:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:03.140 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.140 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:03.140 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.140 04:24:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:03.140 04:24:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:03.140 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.140 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:03.140 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.140 04:24:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:03.140 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.140 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:03.140 [2024-11-26 04:24:42.146084] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:03.140 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.140 04:24:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:03.140 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.140 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:03.140 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.140 04:24:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:03.140 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.140 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:03.140 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.140 04:24:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.140 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.140 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:03.140 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.140 04:24:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:03.140 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.140 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:03.140 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.140 04:24:42 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:03.140 04:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.140 04:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:03.140 04:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.140 04:24:42 -- target/rpc.sh@110 -- # stats='{ 00:13:03.140 "tick_rate": 2700000000, 00:13:03.140 "poll_groups": [ 00:13:03.140 { 00:13:03.140 "name": "nvmf_tgt_poll_group_0", 00:13:03.140 "admin_qpairs": 2, 00:13:03.140 "io_qpairs": 84, 00:13:03.140 "current_admin_qpairs": 0, 00:13:03.140 "current_io_qpairs": 0, 00:13:03.140 "pending_bdev_io": 0, 00:13:03.140 "completed_nvme_io": 133, 00:13:03.140 "transports": [ 00:13:03.140 { 00:13:03.140 "trtype": "TCP" 00:13:03.140 } 00:13:03.140 ] 00:13:03.140 }, 00:13:03.140 { 00:13:03.140 "name": "nvmf_tgt_poll_group_1", 00:13:03.140 "admin_qpairs": 2, 00:13:03.140 "io_qpairs": 84, 00:13:03.140 "current_admin_qpairs": 0, 00:13:03.140 "current_io_qpairs": 0, 00:13:03.140 "pending_bdev_io": 0, 00:13:03.140 "completed_nvme_io": 183, 00:13:03.140 "transports": [ 00:13:03.140 { 00:13:03.140 "trtype": "TCP" 00:13:03.140 } 00:13:03.140 ] 00:13:03.140 }, 00:13:03.140 { 00:13:03.140 "name": "nvmf_tgt_poll_group_2", 00:13:03.140 "admin_qpairs": 1, 00:13:03.140 "io_qpairs": 84, 00:13:03.140 "current_admin_qpairs": 0, 00:13:03.140 "current_io_qpairs": 0, 00:13:03.140 "pending_bdev_io": 0, 00:13:03.140 "completed_nvme_io": 184, 00:13:03.140 "transports": [ 00:13:03.140 { 00:13:03.140 "trtype": "TCP" 00:13:03.140 } 00:13:03.140 ] 00:13:03.140 }, 00:13:03.140 { 00:13:03.140 "name": "nvmf_tgt_poll_group_3", 00:13:03.140 "admin_qpairs": 2, 00:13:03.140 "io_qpairs": 84, 00:13:03.140 "current_admin_qpairs": 0, 00:13:03.140 "current_io_qpairs": 0, 00:13:03.140 "pending_bdev_io": 0, 00:13:03.140 "completed_nvme_io": 186, 00:13:03.140 "transports": [ 00:13:03.140 { 00:13:03.140 "trtype": "TCP" 00:13:03.140 } 00:13:03.140 ] 00:13:03.140 } 00:13:03.140 ] 00:13:03.140 }' 00:13:03.140 04:24:42 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:03.140 04:24:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:03.140 04:24:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:03.140 04:24:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:03.140 04:24:42 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:03.140 04:24:42 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:03.140 04:24:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:03.140 04:24:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:03.140 04:24:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:03.140 04:24:42 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:03.140 04:24:42 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:03.140 04:24:42 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:03.140 04:24:42 -- target/rpc.sh@123 -- # nvmftestfini 00:13:03.140 04:24:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:03.140 04:24:42 -- nvmf/common.sh@116 -- # sync 00:13:03.140 04:24:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:03.140 04:24:42 -- nvmf/common.sh@119 -- # set +e 00:13:03.140 04:24:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:03.140 04:24:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:03.140 rmmod nvme_tcp 00:13:03.140 rmmod nvme_fabrics 00:13:03.140 rmmod nvme_keyring 00:13:03.140 04:24:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:03.140 04:24:42 -- nvmf/common.sh@123 -- # set -e 00:13:03.140 04:24:42 -- nvmf/common.sh@124 -- # return 0 00:13:03.140 04:24:42 -- nvmf/common.sh@477 -- # '[' -n 2858333 ']' 00:13:03.140 04:24:42 -- nvmf/common.sh@478 -- # killprocess 2858333 00:13:03.140 04:24:42 -- common/autotest_common.sh@936 -- # '[' -z 2858333 ']' 00:13:03.140 04:24:42 -- common/autotest_common.sh@940 -- # kill -0 2858333 00:13:03.140 04:24:42 -- common/autotest_common.sh@941 -- # uname 00:13:03.140 04:24:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:03.140 04:24:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2858333 00:13:03.140 04:24:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:03.140 04:24:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:03.140 04:24:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2858333' 00:13:03.140 killing process with pid 2858333 00:13:03.140 04:24:42 -- common/autotest_common.sh@955 -- # kill 2858333 00:13:03.140 04:24:42 -- common/autotest_common.sh@960 -- # wait 2858333 00:13:03.398 04:24:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:03.398 04:24:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:03.398 04:24:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:03.658 04:24:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:03.658 04:24:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:03.658 04:24:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:03.658 04:24:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:03.658 04:24:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:05.563 04:24:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:05.563 00:13:05.563 real 0m26.154s 00:13:05.563 user 1m25.894s 00:13:05.563 sys 0m4.122s 00:13:05.563 04:24:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:05.563 04:24:44 -- common/autotest_common.sh@10 -- # set +x 00:13:05.563 ************************************ 00:13:05.563 END TEST nvmf_rpc 00:13:05.563 ************************************ 00:13:05.563 04:24:44 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:05.563 04:24:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:05.563 04:24:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:05.563 04:24:44 -- common/autotest_common.sh@10 -- # set +x 00:13:05.563 ************************************ 00:13:05.563 START TEST nvmf_invalid 00:13:05.563 ************************************ 00:13:05.563 04:24:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:05.563 * Looking for test storage... 00:13:05.563 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:05.563 04:24:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:05.563 04:24:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:05.563 04:24:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:05.821 04:24:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:05.821 04:24:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:05.821 04:24:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:05.821 04:24:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:05.821 04:24:44 -- scripts/common.sh@335 -- # IFS=.-: 00:13:05.821 04:24:44 -- scripts/common.sh@335 -- # read -ra ver1 00:13:05.821 04:24:44 -- scripts/common.sh@336 -- # IFS=.-: 00:13:05.821 04:24:44 -- scripts/common.sh@336 -- # read -ra ver2 00:13:05.821 04:24:44 -- scripts/common.sh@337 -- # local 'op=<' 00:13:05.821 04:24:44 -- scripts/common.sh@339 -- # ver1_l=2 00:13:05.821 04:24:44 -- scripts/common.sh@340 -- # ver2_l=1 00:13:05.821 04:24:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:05.821 04:24:44 -- scripts/common.sh@343 -- # case "$op" in 00:13:05.821 04:24:44 -- scripts/common.sh@344 -- # : 1 00:13:05.821 04:24:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:05.821 04:24:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:05.821 04:24:44 -- scripts/common.sh@364 -- # decimal 1 00:13:05.821 04:24:44 -- scripts/common.sh@352 -- # local d=1 00:13:05.821 04:24:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:05.821 04:24:44 -- scripts/common.sh@354 -- # echo 1 00:13:05.821 04:24:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:05.821 04:24:44 -- scripts/common.sh@365 -- # decimal 2 00:13:05.821 04:24:44 -- scripts/common.sh@352 -- # local d=2 00:13:05.821 04:24:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:05.821 04:24:44 -- scripts/common.sh@354 -- # echo 2 00:13:05.821 04:24:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:05.821 04:24:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:05.821 04:24:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:05.821 04:24:44 -- scripts/common.sh@367 -- # return 0 00:13:05.821 04:24:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:05.821 04:24:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:05.821 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:05.821 --rc genhtml_branch_coverage=1 00:13:05.821 --rc genhtml_function_coverage=1 00:13:05.821 --rc genhtml_legend=1 00:13:05.821 --rc geninfo_all_blocks=1 00:13:05.821 --rc geninfo_unexecuted_blocks=1 00:13:05.821 00:13:05.821 ' 00:13:05.821 04:24:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:05.821 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:05.821 --rc genhtml_branch_coverage=1 00:13:05.821 --rc genhtml_function_coverage=1 00:13:05.821 --rc genhtml_legend=1 00:13:05.821 --rc geninfo_all_blocks=1 00:13:05.821 --rc geninfo_unexecuted_blocks=1 00:13:05.821 00:13:05.821 ' 00:13:05.821 04:24:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:05.821 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:05.821 --rc genhtml_branch_coverage=1 00:13:05.821 --rc genhtml_function_coverage=1 00:13:05.821 --rc genhtml_legend=1 00:13:05.821 --rc geninfo_all_blocks=1 00:13:05.821 --rc geninfo_unexecuted_blocks=1 00:13:05.821 00:13:05.821 ' 00:13:05.821 04:24:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:05.821 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:05.821 --rc genhtml_branch_coverage=1 00:13:05.821 --rc genhtml_function_coverage=1 00:13:05.821 --rc genhtml_legend=1 00:13:05.821 --rc geninfo_all_blocks=1 00:13:05.821 --rc geninfo_unexecuted_blocks=1 00:13:05.821 00:13:05.821 ' 00:13:05.821 04:24:44 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:05.821 04:24:44 -- nvmf/common.sh@7 -- # uname -s 00:13:05.821 04:24:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:05.821 04:24:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:05.821 04:24:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:05.821 04:24:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:05.821 04:24:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:05.821 04:24:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:05.821 04:24:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:05.822 04:24:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:05.822 04:24:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:05.822 04:24:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:05.822 04:24:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:05.822 04:24:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:05.822 04:24:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:05.822 04:24:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:05.822 04:24:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:05.822 04:24:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:05.822 04:24:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:05.822 04:24:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:05.822 04:24:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:05.822 04:24:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:05.822 04:24:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:05.822 04:24:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:05.822 04:24:44 -- paths/export.sh@5 -- # export PATH 00:13:05.822 04:24:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:05.822 04:24:44 -- nvmf/common.sh@46 -- # : 0 00:13:05.822 04:24:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:05.822 04:24:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:05.822 04:24:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:05.822 04:24:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:05.822 04:24:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:05.822 04:24:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:05.822 04:24:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:05.822 04:24:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:05.822 04:24:44 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:05.822 04:24:44 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:05.822 04:24:44 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:05.822 04:24:44 -- target/invalid.sh@14 -- # target=foobar 00:13:05.822 04:24:44 -- target/invalid.sh@16 -- # RANDOM=0 00:13:05.822 04:24:44 -- target/invalid.sh@34 -- # nvmftestinit 00:13:05.822 04:24:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:05.822 04:24:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:05.822 04:24:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:05.822 04:24:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:05.822 04:24:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:05.822 04:24:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:05.822 04:24:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:05.822 04:24:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:05.822 04:24:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:05.822 04:24:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:05.822 04:24:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:05.822 04:24:44 -- common/autotest_common.sh@10 -- # set +x 00:13:07.804 04:24:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:07.804 04:24:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:07.804 04:24:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:07.804 04:24:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:07.804 04:24:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:07.804 04:24:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:07.804 04:24:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:07.804 04:24:46 -- nvmf/common.sh@294 -- # net_devs=() 00:13:07.804 04:24:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:07.804 04:24:46 -- nvmf/common.sh@295 -- # e810=() 00:13:07.804 04:24:46 -- nvmf/common.sh@295 -- # local -ga e810 00:13:07.804 04:24:46 -- nvmf/common.sh@296 -- # x722=() 00:13:07.804 04:24:46 -- nvmf/common.sh@296 -- # local -ga x722 00:13:07.804 04:24:46 -- nvmf/common.sh@297 -- # mlx=() 00:13:07.804 04:24:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:07.804 04:24:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:07.804 04:24:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:07.804 04:24:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:07.804 04:24:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:07.804 04:24:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:07.804 04:24:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:07.804 04:24:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:07.804 04:24:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:07.804 04:24:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:07.804 04:24:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:07.804 04:24:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:07.804 04:24:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:07.804 04:24:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:07.804 04:24:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:07.804 04:24:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:07.804 04:24:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:07.804 04:24:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:07.804 04:24:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:07.804 04:24:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:07.804 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:07.804 04:24:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:07.804 04:24:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:07.804 04:24:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:07.804 04:24:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:07.804 04:24:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:07.804 04:24:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:07.804 04:24:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:07.805 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:07.805 04:24:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:07.805 04:24:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:07.805 04:24:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:07.805 04:24:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:07.805 04:24:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:07.805 04:24:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:07.805 04:24:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:07.805 04:24:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:07.805 04:24:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:07.805 04:24:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:07.805 04:24:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:07.805 04:24:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:07.805 04:24:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:07.805 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:07.805 04:24:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:07.805 04:24:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:07.805 04:24:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:07.805 04:24:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:07.805 04:24:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:07.805 04:24:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:07.805 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:07.805 04:24:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:07.805 04:24:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:07.805 04:24:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:07.805 04:24:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:07.805 04:24:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:07.805 04:24:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:07.805 04:24:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:07.805 04:24:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:07.805 04:24:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:07.805 04:24:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:07.805 04:24:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:07.805 04:24:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:07.805 04:24:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:07.805 04:24:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:07.805 04:24:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:07.805 04:24:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:07.805 04:24:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:07.805 04:24:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:07.805 04:24:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:07.805 04:24:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:07.805 04:24:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:07.805 04:24:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:07.805 04:24:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:08.064 04:24:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:08.064 04:24:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:08.064 04:24:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:08.064 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:08.064 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.331 ms 00:13:08.064 00:13:08.064 --- 10.0.0.2 ping statistics --- 00:13:08.064 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:08.064 rtt min/avg/max/mdev = 0.331/0.331/0.331/0.000 ms 00:13:08.064 04:24:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:08.064 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:08.064 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.169 ms 00:13:08.064 00:13:08.064 --- 10.0.0.1 ping statistics --- 00:13:08.064 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:08.064 rtt min/avg/max/mdev = 0.169/0.169/0.169/0.000 ms 00:13:08.064 04:24:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:08.064 04:24:47 -- nvmf/common.sh@410 -- # return 0 00:13:08.064 04:24:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:08.064 04:24:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:08.064 04:24:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:08.064 04:24:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:08.064 04:24:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:08.064 04:24:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:08.064 04:24:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:08.064 04:24:47 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:08.064 04:24:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:08.064 04:24:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:08.064 04:24:47 -- common/autotest_common.sh@10 -- # set +x 00:13:08.064 04:24:47 -- nvmf/common.sh@469 -- # nvmfpid=2863054 00:13:08.064 04:24:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:08.064 04:24:47 -- nvmf/common.sh@470 -- # waitforlisten 2863054 00:13:08.064 04:24:47 -- common/autotest_common.sh@829 -- # '[' -z 2863054 ']' 00:13:08.064 04:24:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:08.064 04:24:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:08.064 04:24:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:08.064 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:08.064 04:24:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:08.064 04:24:47 -- common/autotest_common.sh@10 -- # set +x 00:13:08.064 [2024-11-26 04:24:47.210411] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:08.064 [2024-11-26 04:24:47.210479] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:08.064 EAL: No free 2048 kB hugepages reported on node 1 00:13:08.064 [2024-11-26 04:24:47.274900] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:08.322 [2024-11-26 04:24:47.361789] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:08.322 [2024-11-26 04:24:47.361964] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:08.322 [2024-11-26 04:24:47.361981] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:08.322 [2024-11-26 04:24:47.362002] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:08.322 [2024-11-26 04:24:47.362125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:08.322 [2024-11-26 04:24:47.362192] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:08.322 [2024-11-26 04:24:47.362257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:08.322 [2024-11-26 04:24:47.362260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:09.257 04:24:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:09.257 04:24:48 -- common/autotest_common.sh@862 -- # return 0 00:13:09.257 04:24:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:09.257 04:24:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:09.257 04:24:48 -- common/autotest_common.sh@10 -- # set +x 00:13:09.257 04:24:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:09.257 04:24:48 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:09.257 04:24:48 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode11214 00:13:09.516 [2024-11-26 04:24:48.557429] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:09.516 04:24:48 -- target/invalid.sh@40 -- # out='request: 00:13:09.516 { 00:13:09.516 "nqn": "nqn.2016-06.io.spdk:cnode11214", 00:13:09.516 "tgt_name": "foobar", 00:13:09.516 "method": "nvmf_create_subsystem", 00:13:09.516 "req_id": 1 00:13:09.516 } 00:13:09.516 Got JSON-RPC error response 00:13:09.516 response: 00:13:09.516 { 00:13:09.516 "code": -32603, 00:13:09.516 "message": "Unable to find target foobar" 00:13:09.516 }' 00:13:09.516 04:24:48 -- target/invalid.sh@41 -- # [[ request: 00:13:09.516 { 00:13:09.516 "nqn": "nqn.2016-06.io.spdk:cnode11214", 00:13:09.516 "tgt_name": "foobar", 00:13:09.516 "method": "nvmf_create_subsystem", 00:13:09.516 "req_id": 1 00:13:09.516 } 00:13:09.516 Got JSON-RPC error response 00:13:09.516 response: 00:13:09.516 { 00:13:09.516 "code": -32603, 00:13:09.516 "message": "Unable to find target foobar" 00:13:09.516 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:09.516 04:24:48 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:09.516 04:24:48 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode27399 00:13:09.774 [2024-11-26 04:24:48.862435] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27399: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:09.774 04:24:48 -- target/invalid.sh@45 -- # out='request: 00:13:09.774 { 00:13:09.774 "nqn": "nqn.2016-06.io.spdk:cnode27399", 00:13:09.774 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:09.774 "method": "nvmf_create_subsystem", 00:13:09.774 "req_id": 1 00:13:09.774 } 00:13:09.774 Got JSON-RPC error response 00:13:09.774 response: 00:13:09.774 { 00:13:09.774 "code": -32602, 00:13:09.774 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:09.774 }' 00:13:09.774 04:24:48 -- target/invalid.sh@46 -- # [[ request: 00:13:09.774 { 00:13:09.774 "nqn": "nqn.2016-06.io.spdk:cnode27399", 00:13:09.774 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:09.774 "method": "nvmf_create_subsystem", 00:13:09.774 "req_id": 1 00:13:09.774 } 00:13:09.774 Got JSON-RPC error response 00:13:09.774 response: 00:13:09.774 { 00:13:09.774 "code": -32602, 00:13:09.774 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:09.774 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:09.774 04:24:48 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:09.774 04:24:48 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode8691 00:13:10.033 [2024-11-26 04:24:49.123255] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8691: invalid model number 'SPDK_Controller' 00:13:10.033 04:24:49 -- target/invalid.sh@50 -- # out='request: 00:13:10.033 { 00:13:10.033 "nqn": "nqn.2016-06.io.spdk:cnode8691", 00:13:10.033 "model_number": "SPDK_Controller\u001f", 00:13:10.033 "method": "nvmf_create_subsystem", 00:13:10.033 "req_id": 1 00:13:10.033 } 00:13:10.033 Got JSON-RPC error response 00:13:10.033 response: 00:13:10.033 { 00:13:10.033 "code": -32602, 00:13:10.033 "message": "Invalid MN SPDK_Controller\u001f" 00:13:10.033 }' 00:13:10.033 04:24:49 -- target/invalid.sh@51 -- # [[ request: 00:13:10.033 { 00:13:10.033 "nqn": "nqn.2016-06.io.spdk:cnode8691", 00:13:10.033 "model_number": "SPDK_Controller\u001f", 00:13:10.033 "method": "nvmf_create_subsystem", 00:13:10.033 "req_id": 1 00:13:10.033 } 00:13:10.033 Got JSON-RPC error response 00:13:10.033 response: 00:13:10.033 { 00:13:10.033 "code": -32602, 00:13:10.033 "message": "Invalid MN SPDK_Controller\u001f" 00:13:10.033 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:10.033 04:24:49 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:10.033 04:24:49 -- target/invalid.sh@19 -- # local length=21 ll 00:13:10.033 04:24:49 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:10.034 04:24:49 -- target/invalid.sh@21 -- # local chars 00:13:10.034 04:24:49 -- target/invalid.sh@22 -- # local string 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 105 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=i 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 77 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=M 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 85 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=U 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 85 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=U 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 33 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x21' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+='!' 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 55 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x37' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=7 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 77 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=M 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 90 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=Z 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 45 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=- 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 35 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x23' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+='#' 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 116 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=t 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 39 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x27' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=\' 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 64 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=@ 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 79 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=O 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 93 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=']' 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 48 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=0 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 46 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=. 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 98 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=b 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 105 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=i 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 93 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=']' 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # printf %x 52 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x34' 00:13:10.034 04:24:49 -- target/invalid.sh@25 -- # string+=4 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.034 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.034 04:24:49 -- target/invalid.sh@28 -- # [[ i == \- ]] 00:13:10.034 04:24:49 -- target/invalid.sh@31 -- # echo 'iMUU!7MZ-#t'\''@O]0.bi]4' 00:13:10.034 04:24:49 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'iMUU!7MZ-#t'\''@O]0.bi]4' nqn.2016-06.io.spdk:cnode15092 00:13:10.293 [2024-11-26 04:24:49.428210] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15092: invalid serial number 'iMUU!7MZ-#t'@O]0.bi]4' 00:13:10.293 04:24:49 -- target/invalid.sh@54 -- # out='request: 00:13:10.293 { 00:13:10.293 "nqn": "nqn.2016-06.io.spdk:cnode15092", 00:13:10.293 "serial_number": "iMUU!7MZ-#t'\''@O]0.bi]4", 00:13:10.293 "method": "nvmf_create_subsystem", 00:13:10.293 "req_id": 1 00:13:10.293 } 00:13:10.293 Got JSON-RPC error response 00:13:10.293 response: 00:13:10.293 { 00:13:10.293 "code": -32602, 00:13:10.293 "message": "Invalid SN iMUU!7MZ-#t'\''@O]0.bi]4" 00:13:10.293 }' 00:13:10.293 04:24:49 -- target/invalid.sh@55 -- # [[ request: 00:13:10.293 { 00:13:10.293 "nqn": "nqn.2016-06.io.spdk:cnode15092", 00:13:10.293 "serial_number": "iMUU!7MZ-#t'@O]0.bi]4", 00:13:10.293 "method": "nvmf_create_subsystem", 00:13:10.293 "req_id": 1 00:13:10.293 } 00:13:10.293 Got JSON-RPC error response 00:13:10.293 response: 00:13:10.293 { 00:13:10.293 "code": -32602, 00:13:10.293 "message": "Invalid SN iMUU!7MZ-#t'@O]0.bi]4" 00:13:10.293 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:10.293 04:24:49 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:10.293 04:24:49 -- target/invalid.sh@19 -- # local length=41 ll 00:13:10.293 04:24:49 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:10.293 04:24:49 -- target/invalid.sh@21 -- # local chars 00:13:10.293 04:24:49 -- target/invalid.sh@22 -- # local string 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 113 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x71' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=q 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 92 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+='\' 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 111 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=o 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 60 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+='<' 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 115 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=s 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 45 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=- 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 46 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=. 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 51 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x33' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=3 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 77 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=M 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 34 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x22' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+='"' 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 110 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=n 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 85 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=U 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 98 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=b 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 47 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=/ 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 108 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=l 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 55 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x37' 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # string+=7 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.293 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # printf %x 95 00:13:10.293 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:13:10.294 04:24:49 -- target/invalid.sh@25 -- # string+=_ 00:13:10.294 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.294 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.294 04:24:49 -- target/invalid.sh@25 -- # printf %x 85 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=U 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 70 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=F 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 89 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x59' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=Y 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 40 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x28' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+='(' 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 68 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=D 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 33 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x21' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+='!' 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 102 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=f 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 100 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=d 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 68 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=D 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 97 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=a 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 123 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+='{' 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 115 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=s 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 60 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+='<' 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 78 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=N 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 111 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=o 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 40 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x28' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+='(' 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 114 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x72' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=r 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 106 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=j 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 102 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=f 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 125 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+='}' 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 94 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+='^' 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 40 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x28' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+='(' 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 95 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # string+=_ 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.553 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # printf %x 55 00:13:10.553 04:24:49 -- target/invalid.sh@25 -- # echo -e '\x37' 00:13:10.554 04:24:49 -- target/invalid.sh@25 -- # string+=7 00:13:10.554 04:24:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:10.554 04:24:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:10.554 04:24:49 -- target/invalid.sh@28 -- # [[ q == \- ]] 00:13:10.554 04:24:49 -- target/invalid.sh@31 -- # echo 'q\o /dev/null' 00:13:13.137 04:24:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:15.677 04:24:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:15.677 00:13:15.677 real 0m9.692s 00:13:15.677 user 0m23.975s 00:13:15.677 sys 0m2.528s 00:13:15.677 04:24:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:15.677 04:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:15.677 ************************************ 00:13:15.677 END TEST nvmf_invalid 00:13:15.677 ************************************ 00:13:15.677 04:24:54 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:15.677 04:24:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:15.677 04:24:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:15.677 04:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:15.677 ************************************ 00:13:15.677 START TEST nvmf_abort 00:13:15.677 ************************************ 00:13:15.677 04:24:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:15.677 * Looking for test storage... 00:13:15.677 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:15.677 04:24:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:15.677 04:24:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:15.677 04:24:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:15.677 04:24:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:15.677 04:24:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:15.677 04:24:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:15.677 04:24:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:15.677 04:24:54 -- scripts/common.sh@335 -- # IFS=.-: 00:13:15.677 04:24:54 -- scripts/common.sh@335 -- # read -ra ver1 00:13:15.677 04:24:54 -- scripts/common.sh@336 -- # IFS=.-: 00:13:15.677 04:24:54 -- scripts/common.sh@336 -- # read -ra ver2 00:13:15.677 04:24:54 -- scripts/common.sh@337 -- # local 'op=<' 00:13:15.677 04:24:54 -- scripts/common.sh@339 -- # ver1_l=2 00:13:15.677 04:24:54 -- scripts/common.sh@340 -- # ver2_l=1 00:13:15.677 04:24:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:15.677 04:24:54 -- scripts/common.sh@343 -- # case "$op" in 00:13:15.677 04:24:54 -- scripts/common.sh@344 -- # : 1 00:13:15.677 04:24:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:15.677 04:24:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:15.677 04:24:54 -- scripts/common.sh@364 -- # decimal 1 00:13:15.677 04:24:54 -- scripts/common.sh@352 -- # local d=1 00:13:15.677 04:24:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:15.677 04:24:54 -- scripts/common.sh@354 -- # echo 1 00:13:15.677 04:24:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:15.677 04:24:54 -- scripts/common.sh@365 -- # decimal 2 00:13:15.677 04:24:54 -- scripts/common.sh@352 -- # local d=2 00:13:15.677 04:24:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:15.677 04:24:54 -- scripts/common.sh@354 -- # echo 2 00:13:15.677 04:24:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:15.677 04:24:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:15.677 04:24:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:15.677 04:24:54 -- scripts/common.sh@367 -- # return 0 00:13:15.677 04:24:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:15.677 04:24:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:15.677 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.677 --rc genhtml_branch_coverage=1 00:13:15.677 --rc genhtml_function_coverage=1 00:13:15.677 --rc genhtml_legend=1 00:13:15.677 --rc geninfo_all_blocks=1 00:13:15.677 --rc geninfo_unexecuted_blocks=1 00:13:15.677 00:13:15.677 ' 00:13:15.677 04:24:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:15.677 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.677 --rc genhtml_branch_coverage=1 00:13:15.677 --rc genhtml_function_coverage=1 00:13:15.677 --rc genhtml_legend=1 00:13:15.677 --rc geninfo_all_blocks=1 00:13:15.677 --rc geninfo_unexecuted_blocks=1 00:13:15.677 00:13:15.677 ' 00:13:15.677 04:24:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:15.677 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.677 --rc genhtml_branch_coverage=1 00:13:15.677 --rc genhtml_function_coverage=1 00:13:15.677 --rc genhtml_legend=1 00:13:15.677 --rc geninfo_all_blocks=1 00:13:15.677 --rc geninfo_unexecuted_blocks=1 00:13:15.677 00:13:15.677 ' 00:13:15.677 04:24:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:15.677 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.677 --rc genhtml_branch_coverage=1 00:13:15.677 --rc genhtml_function_coverage=1 00:13:15.677 --rc genhtml_legend=1 00:13:15.677 --rc geninfo_all_blocks=1 00:13:15.677 --rc geninfo_unexecuted_blocks=1 00:13:15.677 00:13:15.677 ' 00:13:15.677 04:24:54 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:15.677 04:24:54 -- nvmf/common.sh@7 -- # uname -s 00:13:15.677 04:24:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:15.677 04:24:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:15.677 04:24:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:15.677 04:24:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:15.677 04:24:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:15.677 04:24:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:15.677 04:24:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:15.677 04:24:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:15.677 04:24:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:15.677 04:24:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:15.677 04:24:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:15.677 04:24:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:15.677 04:24:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:15.677 04:24:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:15.677 04:24:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:15.677 04:24:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:15.677 04:24:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:15.677 04:24:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:15.677 04:24:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:15.677 04:24:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.677 04:24:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.677 04:24:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.677 04:24:54 -- paths/export.sh@5 -- # export PATH 00:13:15.677 04:24:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.677 04:24:54 -- nvmf/common.sh@46 -- # : 0 00:13:15.677 04:24:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:15.677 04:24:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:15.677 04:24:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:15.677 04:24:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:15.677 04:24:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:15.677 04:24:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:15.677 04:24:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:15.677 04:24:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:15.677 04:24:54 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:15.677 04:24:54 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:15.677 04:24:54 -- target/abort.sh@14 -- # nvmftestinit 00:13:15.677 04:24:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:15.678 04:24:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:15.678 04:24:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:15.678 04:24:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:15.678 04:24:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:15.678 04:24:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:15.678 04:24:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:15.678 04:24:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:15.678 04:24:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:15.678 04:24:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:15.678 04:24:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:15.678 04:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:17.583 04:24:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:17.583 04:24:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:17.583 04:24:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:17.583 04:24:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:17.583 04:24:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:17.583 04:24:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:17.583 04:24:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:17.583 04:24:56 -- nvmf/common.sh@294 -- # net_devs=() 00:13:17.583 04:24:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:17.583 04:24:56 -- nvmf/common.sh@295 -- # e810=() 00:13:17.583 04:24:56 -- nvmf/common.sh@295 -- # local -ga e810 00:13:17.583 04:24:56 -- nvmf/common.sh@296 -- # x722=() 00:13:17.583 04:24:56 -- nvmf/common.sh@296 -- # local -ga x722 00:13:17.583 04:24:56 -- nvmf/common.sh@297 -- # mlx=() 00:13:17.583 04:24:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:17.583 04:24:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:17.583 04:24:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:17.583 04:24:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:17.583 04:24:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:17.583 04:24:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:17.583 04:24:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:17.583 04:24:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:17.583 04:24:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:17.583 04:24:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:17.583 04:24:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:17.583 04:24:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:17.583 04:24:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:17.583 04:24:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:17.583 04:24:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:17.583 04:24:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:17.583 04:24:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:17.583 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:17.583 04:24:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:17.583 04:24:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:17.583 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:17.583 04:24:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:17.583 04:24:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:17.583 04:24:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:17.583 04:24:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:17.583 04:24:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:17.583 04:24:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:17.583 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:17.583 04:24:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:17.583 04:24:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:17.583 04:24:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:17.583 04:24:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:17.583 04:24:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:17.583 04:24:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:17.583 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:17.583 04:24:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:17.583 04:24:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:17.583 04:24:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:17.583 04:24:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:17.583 04:24:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:17.583 04:24:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:17.583 04:24:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:17.583 04:24:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:17.583 04:24:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:17.583 04:24:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:17.583 04:24:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:17.583 04:24:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:17.583 04:24:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:17.583 04:24:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:17.583 04:24:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:17.583 04:24:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:17.583 04:24:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:17.583 04:24:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:17.583 04:24:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:17.583 04:24:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:17.583 04:24:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:17.583 04:24:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:17.583 04:24:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:17.583 04:24:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:17.583 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:17.583 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.417 ms 00:13:17.583 00:13:17.583 --- 10.0.0.2 ping statistics --- 00:13:17.583 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:17.583 rtt min/avg/max/mdev = 0.417/0.417/0.417/0.000 ms 00:13:17.583 04:24:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:17.583 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:17.583 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.162 ms 00:13:17.583 00:13:17.583 --- 10.0.0.1 ping statistics --- 00:13:17.583 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:17.583 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:13:17.583 04:24:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:17.583 04:24:56 -- nvmf/common.sh@410 -- # return 0 00:13:17.583 04:24:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:17.583 04:24:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:17.583 04:24:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:17.583 04:24:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:17.584 04:24:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:17.584 04:24:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:17.584 04:24:56 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:17.584 04:24:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:17.584 04:24:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:17.584 04:24:56 -- common/autotest_common.sh@10 -- # set +x 00:13:17.584 04:24:56 -- nvmf/common.sh@469 -- # nvmfpid=2865848 00:13:17.584 04:24:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:17.584 04:24:56 -- nvmf/common.sh@470 -- # waitforlisten 2865848 00:13:17.584 04:24:56 -- common/autotest_common.sh@829 -- # '[' -z 2865848 ']' 00:13:17.584 04:24:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:17.584 04:24:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:17.584 04:24:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:17.584 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:17.584 04:24:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:17.584 04:24:56 -- common/autotest_common.sh@10 -- # set +x 00:13:17.584 [2024-11-26 04:24:56.712956] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:17.584 [2024-11-26 04:24:56.713057] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:17.584 EAL: No free 2048 kB hugepages reported on node 1 00:13:17.584 [2024-11-26 04:24:56.790842] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:17.842 [2024-11-26 04:24:56.887621] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:17.842 [2024-11-26 04:24:56.887789] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:17.843 [2024-11-26 04:24:56.887810] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:17.843 [2024-11-26 04:24:56.887824] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:17.843 [2024-11-26 04:24:56.887958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:17.843 [2024-11-26 04:24:56.887892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:17.843 [2024-11-26 04:24:56.887954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:18.778 04:24:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:18.778 04:24:57 -- common/autotest_common.sh@862 -- # return 0 00:13:18.778 04:24:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:18.778 04:24:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:18.778 04:24:57 -- common/autotest_common.sh@10 -- # set +x 00:13:18.778 04:24:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:18.778 04:24:57 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:18.778 04:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.778 04:24:57 -- common/autotest_common.sh@10 -- # set +x 00:13:18.778 [2024-11-26 04:24:57.808428] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:18.778 04:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.778 04:24:57 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:18.778 04:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.778 04:24:57 -- common/autotest_common.sh@10 -- # set +x 00:13:18.778 Malloc0 00:13:18.778 04:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.778 04:24:57 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:18.778 04:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.778 04:24:57 -- common/autotest_common.sh@10 -- # set +x 00:13:18.778 Delay0 00:13:18.778 04:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.778 04:24:57 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:18.778 04:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.778 04:24:57 -- common/autotest_common.sh@10 -- # set +x 00:13:18.778 04:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.778 04:24:57 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:18.778 04:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.778 04:24:57 -- common/autotest_common.sh@10 -- # set +x 00:13:18.778 04:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.778 04:24:57 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:18.778 04:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.778 04:24:57 -- common/autotest_common.sh@10 -- # set +x 00:13:18.779 [2024-11-26 04:24:57.876791] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:18.779 04:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.779 04:24:57 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:18.779 04:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.779 04:24:57 -- common/autotest_common.sh@10 -- # set +x 00:13:18.779 04:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.779 04:24:57 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:18.779 EAL: No free 2048 kB hugepages reported on node 1 00:13:18.779 [2024-11-26 04:24:57.981619] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:21.316 Initializing NVMe Controllers 00:13:21.316 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:21.316 controller IO queue size 128 less than required 00:13:21.316 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:21.316 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:21.316 Initialization complete. Launching workers. 00:13:21.316 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 127, failed: 33255 00:13:21.316 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33320, failed to submit 62 00:13:21.316 success 33255, unsuccess 65, failed 0 00:13:21.316 04:25:00 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:21.316 04:25:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.316 04:25:00 -- common/autotest_common.sh@10 -- # set +x 00:13:21.316 04:25:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.316 04:25:00 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:21.316 04:25:00 -- target/abort.sh@38 -- # nvmftestfini 00:13:21.316 04:25:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:21.316 04:25:00 -- nvmf/common.sh@116 -- # sync 00:13:21.316 04:25:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:21.316 04:25:00 -- nvmf/common.sh@119 -- # set +e 00:13:21.316 04:25:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:21.316 04:25:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:21.316 rmmod nvme_tcp 00:13:21.316 rmmod nvme_fabrics 00:13:21.316 rmmod nvme_keyring 00:13:21.316 04:25:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:21.316 04:25:00 -- nvmf/common.sh@123 -- # set -e 00:13:21.316 04:25:00 -- nvmf/common.sh@124 -- # return 0 00:13:21.316 04:25:00 -- nvmf/common.sh@477 -- # '[' -n 2865848 ']' 00:13:21.316 04:25:00 -- nvmf/common.sh@478 -- # killprocess 2865848 00:13:21.316 04:25:00 -- common/autotest_common.sh@936 -- # '[' -z 2865848 ']' 00:13:21.316 04:25:00 -- common/autotest_common.sh@940 -- # kill -0 2865848 00:13:21.316 04:25:00 -- common/autotest_common.sh@941 -- # uname 00:13:21.316 04:25:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:21.316 04:25:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2865848 00:13:21.316 04:25:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:21.316 04:25:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:21.316 04:25:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2865848' 00:13:21.316 killing process with pid 2865848 00:13:21.316 04:25:00 -- common/autotest_common.sh@955 -- # kill 2865848 00:13:21.317 04:25:00 -- common/autotest_common.sh@960 -- # wait 2865848 00:13:21.317 04:25:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:21.317 04:25:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:21.317 04:25:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:21.317 04:25:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:21.317 04:25:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:21.317 04:25:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:21.317 04:25:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:21.317 04:25:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:23.859 04:25:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:23.859 00:13:23.859 real 0m8.066s 00:13:23.859 user 0m13.218s 00:13:23.859 sys 0m2.548s 00:13:23.859 04:25:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:23.859 04:25:02 -- common/autotest_common.sh@10 -- # set +x 00:13:23.859 ************************************ 00:13:23.859 END TEST nvmf_abort 00:13:23.859 ************************************ 00:13:23.859 04:25:02 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:23.859 04:25:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:23.859 04:25:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:23.859 04:25:02 -- common/autotest_common.sh@10 -- # set +x 00:13:23.859 ************************************ 00:13:23.859 START TEST nvmf_ns_hotplug_stress 00:13:23.859 ************************************ 00:13:23.859 04:25:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:23.859 * Looking for test storage... 00:13:23.859 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:23.859 04:25:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:23.859 04:25:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:23.859 04:25:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:23.859 04:25:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:23.859 04:25:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:23.859 04:25:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:23.859 04:25:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:23.859 04:25:02 -- scripts/common.sh@335 -- # IFS=.-: 00:13:23.859 04:25:02 -- scripts/common.sh@335 -- # read -ra ver1 00:13:23.859 04:25:02 -- scripts/common.sh@336 -- # IFS=.-: 00:13:23.859 04:25:02 -- scripts/common.sh@336 -- # read -ra ver2 00:13:23.859 04:25:02 -- scripts/common.sh@337 -- # local 'op=<' 00:13:23.859 04:25:02 -- scripts/common.sh@339 -- # ver1_l=2 00:13:23.859 04:25:02 -- scripts/common.sh@340 -- # ver2_l=1 00:13:23.859 04:25:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:23.859 04:25:02 -- scripts/common.sh@343 -- # case "$op" in 00:13:23.859 04:25:02 -- scripts/common.sh@344 -- # : 1 00:13:23.859 04:25:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:23.859 04:25:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:23.859 04:25:02 -- scripts/common.sh@364 -- # decimal 1 00:13:23.859 04:25:02 -- scripts/common.sh@352 -- # local d=1 00:13:23.859 04:25:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:23.859 04:25:02 -- scripts/common.sh@354 -- # echo 1 00:13:23.859 04:25:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:23.859 04:25:02 -- scripts/common.sh@365 -- # decimal 2 00:13:23.859 04:25:02 -- scripts/common.sh@352 -- # local d=2 00:13:23.859 04:25:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:23.859 04:25:02 -- scripts/common.sh@354 -- # echo 2 00:13:23.859 04:25:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:23.859 04:25:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:23.859 04:25:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:23.859 04:25:02 -- scripts/common.sh@367 -- # return 0 00:13:23.859 04:25:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:23.859 04:25:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:23.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:23.859 --rc genhtml_branch_coverage=1 00:13:23.859 --rc genhtml_function_coverage=1 00:13:23.859 --rc genhtml_legend=1 00:13:23.859 --rc geninfo_all_blocks=1 00:13:23.859 --rc geninfo_unexecuted_blocks=1 00:13:23.859 00:13:23.859 ' 00:13:23.859 04:25:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:23.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:23.859 --rc genhtml_branch_coverage=1 00:13:23.859 --rc genhtml_function_coverage=1 00:13:23.859 --rc genhtml_legend=1 00:13:23.859 --rc geninfo_all_blocks=1 00:13:23.859 --rc geninfo_unexecuted_blocks=1 00:13:23.859 00:13:23.859 ' 00:13:23.859 04:25:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:23.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:23.859 --rc genhtml_branch_coverage=1 00:13:23.859 --rc genhtml_function_coverage=1 00:13:23.859 --rc genhtml_legend=1 00:13:23.859 --rc geninfo_all_blocks=1 00:13:23.859 --rc geninfo_unexecuted_blocks=1 00:13:23.859 00:13:23.859 ' 00:13:23.859 04:25:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:23.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:23.859 --rc genhtml_branch_coverage=1 00:13:23.859 --rc genhtml_function_coverage=1 00:13:23.859 --rc genhtml_legend=1 00:13:23.859 --rc geninfo_all_blocks=1 00:13:23.859 --rc geninfo_unexecuted_blocks=1 00:13:23.859 00:13:23.859 ' 00:13:23.859 04:25:02 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:23.859 04:25:02 -- nvmf/common.sh@7 -- # uname -s 00:13:23.859 04:25:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:23.859 04:25:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:23.859 04:25:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:23.859 04:25:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:23.859 04:25:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:23.859 04:25:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:23.859 04:25:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:23.859 04:25:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:23.859 04:25:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:23.859 04:25:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:23.859 04:25:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:23.859 04:25:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:23.859 04:25:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:23.859 04:25:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:23.859 04:25:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:23.859 04:25:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:23.859 04:25:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:23.859 04:25:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:23.859 04:25:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:23.859 04:25:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:23.860 04:25:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:23.860 04:25:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:23.860 04:25:02 -- paths/export.sh@5 -- # export PATH 00:13:23.860 04:25:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:23.860 04:25:02 -- nvmf/common.sh@46 -- # : 0 00:13:23.860 04:25:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:23.860 04:25:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:23.860 04:25:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:23.860 04:25:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:23.860 04:25:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:23.860 04:25:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:23.860 04:25:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:23.860 04:25:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:23.860 04:25:02 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:23.860 04:25:02 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:23.860 04:25:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:23.860 04:25:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:23.860 04:25:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:23.860 04:25:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:23.860 04:25:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:23.860 04:25:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:23.860 04:25:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:23.860 04:25:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:23.860 04:25:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:23.860 04:25:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:23.860 04:25:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:23.860 04:25:02 -- common/autotest_common.sh@10 -- # set +x 00:13:25.772 04:25:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:25.773 04:25:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:25.773 04:25:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:25.773 04:25:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:25.773 04:25:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:25.773 04:25:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:25.773 04:25:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:25.773 04:25:04 -- nvmf/common.sh@294 -- # net_devs=() 00:13:25.773 04:25:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:25.773 04:25:04 -- nvmf/common.sh@295 -- # e810=() 00:13:25.773 04:25:04 -- nvmf/common.sh@295 -- # local -ga e810 00:13:25.773 04:25:04 -- nvmf/common.sh@296 -- # x722=() 00:13:25.773 04:25:04 -- nvmf/common.sh@296 -- # local -ga x722 00:13:25.773 04:25:04 -- nvmf/common.sh@297 -- # mlx=() 00:13:25.773 04:25:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:25.773 04:25:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:25.773 04:25:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:25.773 04:25:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:25.773 04:25:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:25.773 04:25:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:25.773 04:25:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:25.773 04:25:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:25.773 04:25:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:25.773 04:25:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:25.773 04:25:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:25.773 04:25:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:25.773 04:25:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:25.773 04:25:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:25.773 04:25:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:25.773 04:25:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:25.773 04:25:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:25.773 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:25.773 04:25:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:25.773 04:25:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:25.773 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:25.773 04:25:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:25.773 04:25:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:25.773 04:25:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:25.773 04:25:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:25.773 04:25:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:25.773 04:25:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:25.773 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:25.773 04:25:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:25.773 04:25:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:25.773 04:25:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:25.773 04:25:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:25.773 04:25:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:25.773 04:25:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:25.773 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:25.773 04:25:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:25.773 04:25:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:25.773 04:25:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:25.773 04:25:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:25.773 04:25:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:25.773 04:25:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:25.773 04:25:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:25.773 04:25:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:25.773 04:25:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:25.773 04:25:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:25.773 04:25:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:25.773 04:25:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:25.773 04:25:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:25.773 04:25:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:25.773 04:25:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:25.773 04:25:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:25.773 04:25:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:25.773 04:25:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:25.773 04:25:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:25.773 04:25:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:25.773 04:25:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:25.773 04:25:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:25.773 04:25:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:25.773 04:25:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:25.773 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:25.773 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.370 ms 00:13:25.773 00:13:25.773 --- 10.0.0.2 ping statistics --- 00:13:25.773 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:25.773 rtt min/avg/max/mdev = 0.370/0.370/0.370/0.000 ms 00:13:25.773 04:25:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:25.773 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:25.773 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:13:25.773 00:13:25.773 --- 10.0.0.1 ping statistics --- 00:13:25.773 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:25.773 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:13:25.773 04:25:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:25.773 04:25:04 -- nvmf/common.sh@410 -- # return 0 00:13:25.773 04:25:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:25.773 04:25:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:25.773 04:25:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:25.773 04:25:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:25.773 04:25:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:25.773 04:25:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:25.773 04:25:04 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:25.773 04:25:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:25.773 04:25:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:25.773 04:25:04 -- common/autotest_common.sh@10 -- # set +x 00:13:25.773 04:25:04 -- nvmf/common.sh@469 -- # nvmfpid=2868231 00:13:25.773 04:25:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:25.773 04:25:04 -- nvmf/common.sh@470 -- # waitforlisten 2868231 00:13:25.773 04:25:04 -- common/autotest_common.sh@829 -- # '[' -z 2868231 ']' 00:13:25.773 04:25:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:25.773 04:25:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:25.773 04:25:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:25.773 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:25.773 04:25:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:25.773 04:25:04 -- common/autotest_common.sh@10 -- # set +x 00:13:25.773 [2024-11-26 04:25:04.942159] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:25.773 [2024-11-26 04:25:04.942251] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:25.773 EAL: No free 2048 kB hugepages reported on node 1 00:13:26.033 [2024-11-26 04:25:05.009571] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:26.034 [2024-11-26 04:25:05.096458] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:26.034 [2024-11-26 04:25:05.096635] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:26.034 [2024-11-26 04:25:05.096668] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:26.034 [2024-11-26 04:25:05.096682] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:26.034 [2024-11-26 04:25:05.096793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:26.034 [2024-11-26 04:25:05.096835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:26.034 [2024-11-26 04:25:05.096838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:26.970 04:25:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:26.970 04:25:05 -- common/autotest_common.sh@862 -- # return 0 00:13:26.970 04:25:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:26.970 04:25:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:26.970 04:25:05 -- common/autotest_common.sh@10 -- # set +x 00:13:26.970 04:25:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:26.970 04:25:05 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:26.970 04:25:05 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:26.970 [2024-11-26 04:25:06.173393] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:27.230 04:25:06 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:27.230 04:25:06 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:27.489 [2024-11-26 04:25:06.692305] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:27.748 04:25:06 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:27.748 04:25:06 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:28.007 Malloc0 00:13:28.266 04:25:07 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:28.266 Delay0 00:13:28.266 04:25:07 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:28.524 04:25:07 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:28.782 NULL1 00:13:28.782 04:25:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:29.040 04:25:08 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=2868668 00:13:29.040 04:25:08 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:29.040 04:25:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:29.040 04:25:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.040 EAL: No free 2048 kB hugepages reported on node 1 00:13:30.417 Read completed with error (sct=0, sc=11) 00:13:30.417 04:25:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:30.417 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.417 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.417 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.417 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.417 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.417 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.417 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.675 04:25:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:13:30.675 04:25:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:30.675 true 00:13:30.934 04:25:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:30.934 04:25:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.503 04:25:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:31.762 04:25:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:13:31.762 04:25:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:32.021 true 00:13:32.021 04:25:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:32.021 04:25:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.278 04:25:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:32.536 04:25:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:13:32.536 04:25:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:32.794 true 00:13:32.794 04:25:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:32.794 04:25:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.052 04:25:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:33.310 04:25:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:13:33.310 04:25:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:13:33.568 true 00:13:33.568 04:25:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:33.568 04:25:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.947 04:25:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:34.947 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.947 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.947 04:25:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:13:34.947 04:25:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:13:35.205 true 00:13:35.205 04:25:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:35.205 04:25:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:35.463 04:25:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:35.721 04:25:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:13:35.721 04:25:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:13:35.979 true 00:13:35.979 04:25:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:35.979 04:25:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:36.915 04:25:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:36.915 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:36.915 04:25:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:13:36.915 04:25:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:13:37.173 true 00:13:37.173 04:25:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:37.173 04:25:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.430 04:25:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:37.689 04:25:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:13:37.689 04:25:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:13:37.947 true 00:13:37.947 04:25:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:37.947 04:25:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:38.881 04:25:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:38.881 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:39.139 04:25:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:13:39.139 04:25:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:13:39.398 true 00:13:39.398 04:25:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:39.398 04:25:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:39.656 04:25:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:39.966 04:25:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:13:39.966 04:25:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:13:40.254 true 00:13:40.254 04:25:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:40.254 04:25:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.186 04:25:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:41.186 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:41.186 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:41.186 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:41.186 04:25:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:13:41.186 04:25:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:41.445 true 00:13:41.705 04:25:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:41.705 04:25:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.966 04:25:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:42.225 04:25:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:13:42.225 04:25:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:42.225 true 00:13:42.225 04:25:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:42.225 04:25:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:43.160 04:25:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:43.419 04:25:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:43.419 04:25:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:43.678 true 00:13:43.678 04:25:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:43.678 04:25:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:43.936 04:25:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:44.195 04:25:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:44.195 04:25:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:44.454 true 00:13:44.454 04:25:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:44.454 04:25:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:45.392 04:25:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:45.392 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:45.392 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:45.392 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:45.651 04:25:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:45.651 04:25:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:45.912 true 00:13:45.912 04:25:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:45.912 04:25:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:45.912 04:25:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.171 04:25:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:46.171 04:25:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:46.430 true 00:13:46.430 04:25:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:46.430 04:25:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:47.368 04:25:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:47.368 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:47.628 04:25:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:47.628 04:25:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:47.887 true 00:13:47.887 04:25:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:47.887 04:25:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.145 04:25:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:48.404 04:25:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:48.404 04:25:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:48.663 true 00:13:48.663 04:25:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:48.663 04:25:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:49.603 04:25:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:49.603 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:49.603 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:49.861 04:25:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:49.861 04:25:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:50.126 true 00:13:50.126 04:25:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:50.126 04:25:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:50.388 04:25:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:50.647 04:25:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:50.647 04:25:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:50.905 true 00:13:50.905 04:25:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:50.905 04:25:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:51.866 04:25:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:51.866 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:51.866 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:51.866 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:51.866 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:51.866 04:25:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:51.866 04:25:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:52.123 true 00:13:52.123 04:25:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:52.123 04:25:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:52.381 04:25:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:52.675 04:25:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:52.675 04:25:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:52.933 true 00:13:52.933 04:25:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:52.933 04:25:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:53.866 04:25:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:53.866 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:54.125 04:25:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:54.125 04:25:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:54.383 true 00:13:54.383 04:25:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:54.383 04:25:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:54.641 04:25:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:54.899 04:25:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:54.899 04:25:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:55.158 true 00:13:55.158 04:25:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:55.158 04:25:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.097 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:56.097 04:25:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:56.097 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:56.097 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:56.355 04:25:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:56.355 04:25:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:56.613 true 00:13:56.613 04:25:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:56.613 04:25:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.872 04:25:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:57.130 04:25:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:57.130 04:25:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:57.388 true 00:13:57.388 04:25:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:57.388 04:25:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:58.323 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:58.323 04:25:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:58.323 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:58.588 04:25:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:58.588 04:25:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:58.848 true 00:13:58.848 04:25:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:58.848 04:25:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.106 04:25:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.364 04:25:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:59.364 04:25:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:59.364 true 00:13:59.623 04:25:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:13:59.623 04:25:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:00.559 04:25:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.559 Initializing NVMe Controllers 00:14:00.559 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:00.559 Controller IO queue size 128, less than required. 00:14:00.559 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:00.559 Controller IO queue size 128, less than required. 00:14:00.559 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:00.559 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:00.559 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:00.559 Initialization complete. Launching workers. 00:14:00.559 ======================================================== 00:14:00.559 Latency(us) 00:14:00.559 Device Information : IOPS MiB/s Average min max 00:14:00.559 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1074.53 0.52 67536.20 1834.11 1061310.81 00:14:00.559 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 12093.10 5.90 10585.00 2568.84 390032.49 00:14:00.559 ======================================================== 00:14:00.559 Total : 13167.63 6.43 15232.45 1834.11 1061310.81 00:14:00.559 00:14:00.559 04:25:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:14:00.559 04:25:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:00.817 true 00:14:00.817 04:25:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2868668 00:14:00.817 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (2868668) - No such process 00:14:00.817 04:25:39 -- target/ns_hotplug_stress.sh@53 -- # wait 2868668 00:14:00.817 04:25:39 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:01.076 04:25:40 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:01.334 04:25:40 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:01.334 04:25:40 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:01.334 04:25:40 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:01.334 04:25:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:01.334 04:25:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:01.592 null0 00:14:01.592 04:25:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:01.592 04:25:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:01.592 04:25:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:01.850 null1 00:14:01.850 04:25:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:01.850 04:25:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:01.850 04:25:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:02.109 null2 00:14:02.109 04:25:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:02.109 04:25:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:02.109 04:25:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:02.367 null3 00:14:02.367 04:25:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:02.367 04:25:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:02.367 04:25:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:02.625 null4 00:14:02.625 04:25:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:02.625 04:25:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:02.625 04:25:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:02.883 null5 00:14:02.883 04:25:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:02.883 04:25:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:02.883 04:25:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:03.144 null6 00:14:03.144 04:25:42 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:03.144 04:25:42 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:03.144 04:25:42 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:03.402 null7 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@66 -- # wait 2872969 2872970 2872972 2872974 2872976 2872978 2872980 2872982 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.402 04:25:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:03.660 04:25:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.660 04:25:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:03.660 04:25:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:03.660 04:25:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:03.660 04:25:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:03.660 04:25:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:03.660 04:25:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:03.660 04:25:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:03.919 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:04.177 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:04.177 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:04.178 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:04.178 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:04.178 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:04.178 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:04.178 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:04.178 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.436 04:25:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:04.694 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:04.694 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:04.694 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:04.694 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:04.694 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:04.694 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:04.694 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:04.694 04:25:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:04.952 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.952 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.952 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:04.952 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:04.953 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:05.211 04:25:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:05.211 04:25:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:05.469 04:25:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:05.469 04:25:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:05.469 04:25:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.469 04:25:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:05.469 04:25:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:05.469 04:25:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:05.728 04:25:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:05.987 04:25:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:05.987 04:25:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:05.987 04:25:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:05.987 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:05.987 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.987 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:05.987 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:05.987 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.245 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:06.504 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:06.504 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:06.504 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:06.504 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:06.504 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.504 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:06.504 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:06.504 04:25:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:06.762 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.762 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.762 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:06.762 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.762 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:06.763 04:25:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:07.022 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:07.022 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:07.022 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:07.022 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:07.022 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:07.022 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:07.022 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:07.022 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.280 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:07.539 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:07.539 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:07.539 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:07.539 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:07.539 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:07.539 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:07.539 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.539 04:25:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:07.798 04:25:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:08.058 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:08.058 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:08.058 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:08.058 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:08.058 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:08.058 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:08.058 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:08.058 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:08.316 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.316 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.316 04:25:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:08.316 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.316 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.316 04:25:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:08.316 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.316 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.316 04:25:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:08.316 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.316 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.316 04:25:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:08.317 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.317 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.317 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.317 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.317 04:25:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:08.317 04:25:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:08.596 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.596 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.596 04:25:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:08.596 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.596 04:25:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.596 04:25:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:08.596 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:08.897 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:08.897 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:08.897 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:08.897 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:08.897 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:08.897 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:08.897 04:25:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:08.897 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.897 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.897 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.897 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.897 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.897 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.897 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.897 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.897 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.897 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:08.897 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:08.897 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.156 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.156 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:09.156 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.156 04:25:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:09.156 04:25:48 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:09.156 04:25:48 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:09.156 04:25:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:09.156 04:25:48 -- nvmf/common.sh@116 -- # sync 00:14:09.156 04:25:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:09.156 04:25:48 -- nvmf/common.sh@119 -- # set +e 00:14:09.156 04:25:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:09.156 04:25:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:09.156 rmmod nvme_tcp 00:14:09.156 rmmod nvme_fabrics 00:14:09.156 rmmod nvme_keyring 00:14:09.156 04:25:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:09.156 04:25:48 -- nvmf/common.sh@123 -- # set -e 00:14:09.156 04:25:48 -- nvmf/common.sh@124 -- # return 0 00:14:09.156 04:25:48 -- nvmf/common.sh@477 -- # '[' -n 2868231 ']' 00:14:09.156 04:25:48 -- nvmf/common.sh@478 -- # killprocess 2868231 00:14:09.156 04:25:48 -- common/autotest_common.sh@936 -- # '[' -z 2868231 ']' 00:14:09.156 04:25:48 -- common/autotest_common.sh@940 -- # kill -0 2868231 00:14:09.156 04:25:48 -- common/autotest_common.sh@941 -- # uname 00:14:09.156 04:25:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:09.156 04:25:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2868231 00:14:09.156 04:25:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:09.156 04:25:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:09.156 04:25:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2868231' 00:14:09.156 killing process with pid 2868231 00:14:09.156 04:25:48 -- common/autotest_common.sh@955 -- # kill 2868231 00:14:09.156 04:25:48 -- common/autotest_common.sh@960 -- # wait 2868231 00:14:09.416 04:25:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:09.416 04:25:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:09.416 04:25:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:09.416 04:25:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:09.416 04:25:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:09.416 04:25:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:09.416 04:25:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:09.416 04:25:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:11.325 04:25:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:11.325 00:14:11.325 real 0m47.939s 00:14:11.325 user 3m37.965s 00:14:11.325 sys 0m16.112s 00:14:11.325 04:25:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:11.325 04:25:50 -- common/autotest_common.sh@10 -- # set +x 00:14:11.325 ************************************ 00:14:11.325 END TEST nvmf_ns_hotplug_stress 00:14:11.325 ************************************ 00:14:11.325 04:25:50 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:11.325 04:25:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:11.325 04:25:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:11.325 04:25:50 -- common/autotest_common.sh@10 -- # set +x 00:14:11.325 ************************************ 00:14:11.325 START TEST nvmf_connect_stress 00:14:11.325 ************************************ 00:14:11.325 04:25:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:11.325 * Looking for test storage... 00:14:11.325 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:11.325 04:25:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:11.325 04:25:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:11.325 04:25:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:11.586 04:25:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:11.586 04:25:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:11.586 04:25:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:11.586 04:25:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:11.586 04:25:50 -- scripts/common.sh@335 -- # IFS=.-: 00:14:11.586 04:25:50 -- scripts/common.sh@335 -- # read -ra ver1 00:14:11.586 04:25:50 -- scripts/common.sh@336 -- # IFS=.-: 00:14:11.586 04:25:50 -- scripts/common.sh@336 -- # read -ra ver2 00:14:11.586 04:25:50 -- scripts/common.sh@337 -- # local 'op=<' 00:14:11.586 04:25:50 -- scripts/common.sh@339 -- # ver1_l=2 00:14:11.586 04:25:50 -- scripts/common.sh@340 -- # ver2_l=1 00:14:11.586 04:25:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:11.586 04:25:50 -- scripts/common.sh@343 -- # case "$op" in 00:14:11.586 04:25:50 -- scripts/common.sh@344 -- # : 1 00:14:11.586 04:25:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:11.586 04:25:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:11.586 04:25:50 -- scripts/common.sh@364 -- # decimal 1 00:14:11.586 04:25:50 -- scripts/common.sh@352 -- # local d=1 00:14:11.586 04:25:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:11.586 04:25:50 -- scripts/common.sh@354 -- # echo 1 00:14:11.586 04:25:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:11.586 04:25:50 -- scripts/common.sh@365 -- # decimal 2 00:14:11.586 04:25:50 -- scripts/common.sh@352 -- # local d=2 00:14:11.586 04:25:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:11.586 04:25:50 -- scripts/common.sh@354 -- # echo 2 00:14:11.586 04:25:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:11.586 04:25:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:11.586 04:25:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:11.586 04:25:50 -- scripts/common.sh@367 -- # return 0 00:14:11.586 04:25:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:11.586 04:25:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:11.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:11.586 --rc genhtml_branch_coverage=1 00:14:11.586 --rc genhtml_function_coverage=1 00:14:11.586 --rc genhtml_legend=1 00:14:11.586 --rc geninfo_all_blocks=1 00:14:11.586 --rc geninfo_unexecuted_blocks=1 00:14:11.586 00:14:11.586 ' 00:14:11.586 04:25:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:11.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:11.586 --rc genhtml_branch_coverage=1 00:14:11.586 --rc genhtml_function_coverage=1 00:14:11.586 --rc genhtml_legend=1 00:14:11.586 --rc geninfo_all_blocks=1 00:14:11.586 --rc geninfo_unexecuted_blocks=1 00:14:11.586 00:14:11.586 ' 00:14:11.586 04:25:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:11.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:11.586 --rc genhtml_branch_coverage=1 00:14:11.586 --rc genhtml_function_coverage=1 00:14:11.586 --rc genhtml_legend=1 00:14:11.586 --rc geninfo_all_blocks=1 00:14:11.586 --rc geninfo_unexecuted_blocks=1 00:14:11.586 00:14:11.586 ' 00:14:11.586 04:25:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:11.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:11.586 --rc genhtml_branch_coverage=1 00:14:11.586 --rc genhtml_function_coverage=1 00:14:11.586 --rc genhtml_legend=1 00:14:11.586 --rc geninfo_all_blocks=1 00:14:11.586 --rc geninfo_unexecuted_blocks=1 00:14:11.586 00:14:11.586 ' 00:14:11.586 04:25:50 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:11.586 04:25:50 -- nvmf/common.sh@7 -- # uname -s 00:14:11.586 04:25:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:11.586 04:25:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:11.586 04:25:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:11.586 04:25:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:11.586 04:25:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:11.586 04:25:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:11.586 04:25:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:11.586 04:25:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:11.586 04:25:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:11.586 04:25:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:11.586 04:25:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:11.586 04:25:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:11.586 04:25:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:11.586 04:25:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:11.586 04:25:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:11.586 04:25:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:11.586 04:25:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:11.586 04:25:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:11.586 04:25:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:11.586 04:25:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:11.586 04:25:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:11.586 04:25:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:11.586 04:25:50 -- paths/export.sh@5 -- # export PATH 00:14:11.586 04:25:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:11.586 04:25:50 -- nvmf/common.sh@46 -- # : 0 00:14:11.586 04:25:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:11.586 04:25:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:11.586 04:25:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:11.586 04:25:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:11.586 04:25:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:11.586 04:25:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:11.586 04:25:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:11.586 04:25:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:11.586 04:25:50 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:11.586 04:25:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:11.586 04:25:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:11.586 04:25:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:11.586 04:25:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:11.586 04:25:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:11.586 04:25:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:11.586 04:25:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:11.586 04:25:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:11.586 04:25:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:11.586 04:25:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:11.587 04:25:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:11.587 04:25:50 -- common/autotest_common.sh@10 -- # set +x 00:14:13.495 04:25:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:13.495 04:25:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:13.495 04:25:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:13.495 04:25:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:13.495 04:25:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:13.495 04:25:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:13.495 04:25:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:13.495 04:25:52 -- nvmf/common.sh@294 -- # net_devs=() 00:14:13.495 04:25:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:13.495 04:25:52 -- nvmf/common.sh@295 -- # e810=() 00:14:13.495 04:25:52 -- nvmf/common.sh@295 -- # local -ga e810 00:14:13.495 04:25:52 -- nvmf/common.sh@296 -- # x722=() 00:14:13.495 04:25:52 -- nvmf/common.sh@296 -- # local -ga x722 00:14:13.495 04:25:52 -- nvmf/common.sh@297 -- # mlx=() 00:14:13.495 04:25:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:13.495 04:25:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:13.495 04:25:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:13.495 04:25:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:13.495 04:25:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:13.495 04:25:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:13.495 04:25:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:13.495 04:25:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:13.495 04:25:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:13.495 04:25:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:13.495 04:25:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:13.495 04:25:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:13.495 04:25:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:13.495 04:25:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:13.495 04:25:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:13.495 04:25:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:13.495 04:25:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:13.495 04:25:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:13.495 04:25:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:13.495 04:25:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:13.495 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:13.495 04:25:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:13.495 04:25:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:13.495 04:25:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:13.495 04:25:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:13.495 04:25:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:13.496 04:25:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:13.496 04:25:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:13.496 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:13.496 04:25:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:13.496 04:25:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:13.496 04:25:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:13.496 04:25:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:13.496 04:25:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:13.496 04:25:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:13.496 04:25:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:13.496 04:25:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:13.496 04:25:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:13.496 04:25:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:13.496 04:25:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:13.496 04:25:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:13.496 04:25:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:13.496 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:13.496 04:25:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:13.496 04:25:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:13.496 04:25:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:13.496 04:25:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:13.496 04:25:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:13.496 04:25:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:13.496 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:13.496 04:25:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:13.496 04:25:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:13.496 04:25:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:13.496 04:25:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:13.496 04:25:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:13.496 04:25:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:13.496 04:25:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:13.496 04:25:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:13.496 04:25:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:13.496 04:25:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:13.496 04:25:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:13.496 04:25:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:13.496 04:25:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:13.496 04:25:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:13.496 04:25:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:13.496 04:25:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:13.496 04:25:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:13.496 04:25:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:13.496 04:25:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:13.496 04:25:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:13.496 04:25:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:13.496 04:25:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:13.496 04:25:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:13.496 04:25:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:13.496 04:25:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:13.496 04:25:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:13.496 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:13.496 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.248 ms 00:14:13.496 00:14:13.496 --- 10.0.0.2 ping statistics --- 00:14:13.496 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:13.496 rtt min/avg/max/mdev = 0.248/0.248/0.248/0.000 ms 00:14:13.496 04:25:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:13.755 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:13.755 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:14:13.755 00:14:13.755 --- 10.0.0.1 ping statistics --- 00:14:13.755 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:13.755 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:14:13.755 04:25:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:13.755 04:25:52 -- nvmf/common.sh@410 -- # return 0 00:14:13.755 04:25:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:13.755 04:25:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:13.755 04:25:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:13.755 04:25:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:13.755 04:25:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:13.755 04:25:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:13.755 04:25:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:13.755 04:25:52 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:13.755 04:25:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:13.755 04:25:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:13.755 04:25:52 -- common/autotest_common.sh@10 -- # set +x 00:14:13.755 04:25:52 -- nvmf/common.sh@469 -- # nvmfpid=2875767 00:14:13.755 04:25:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:13.755 04:25:52 -- nvmf/common.sh@470 -- # waitforlisten 2875767 00:14:13.755 04:25:52 -- common/autotest_common.sh@829 -- # '[' -z 2875767 ']' 00:14:13.755 04:25:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:13.755 04:25:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:13.755 04:25:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:13.755 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:13.755 04:25:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:13.755 04:25:52 -- common/autotest_common.sh@10 -- # set +x 00:14:13.755 [2024-11-26 04:25:52.786150] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:13.755 [2024-11-26 04:25:52.786250] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:13.755 EAL: No free 2048 kB hugepages reported on node 1 00:14:13.755 [2024-11-26 04:25:52.854462] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:13.755 [2024-11-26 04:25:52.947179] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:13.755 [2024-11-26 04:25:52.947354] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:13.755 [2024-11-26 04:25:52.947374] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:13.755 [2024-11-26 04:25:52.947388] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:13.755 [2024-11-26 04:25:52.947493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:13.755 [2024-11-26 04:25:52.949707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:13.755 [2024-11-26 04:25:52.949719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:14.692 04:25:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:14.692 04:25:53 -- common/autotest_common.sh@862 -- # return 0 00:14:14.692 04:25:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:14.692 04:25:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:14.692 04:25:53 -- common/autotest_common.sh@10 -- # set +x 00:14:14.692 04:25:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:14.692 04:25:53 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:14.692 04:25:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:14.692 04:25:53 -- common/autotest_common.sh@10 -- # set +x 00:14:14.692 [2024-11-26 04:25:53.805819] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:14.692 04:25:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:14.692 04:25:53 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:14.692 04:25:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:14.692 04:25:53 -- common/autotest_common.sh@10 -- # set +x 00:14:14.692 04:25:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:14.692 04:25:53 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:14.692 04:25:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:14.692 04:25:53 -- common/autotest_common.sh@10 -- # set +x 00:14:14.692 [2024-11-26 04:25:53.831885] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:14.692 04:25:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:14.692 04:25:53 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:14.692 04:25:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:14.692 04:25:53 -- common/autotest_common.sh@10 -- # set +x 00:14:14.692 NULL1 00:14:14.692 04:25:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:14.692 04:25:53 -- target/connect_stress.sh@21 -- # PERF_PID=2875928 00:14:14.692 04:25:53 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:14.692 04:25:53 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:14.692 04:25:53 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 EAL: No free 2048 kB hugepages reported on node 1 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.692 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.692 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.693 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.693 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.693 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.693 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.693 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.693 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.693 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.693 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.693 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.693 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.693 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.693 04:25:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:14.693 04:25:53 -- target/connect_stress.sh@28 -- # cat 00:14:14.693 04:25:53 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:14.693 04:25:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:14.693 04:25:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:14.693 04:25:53 -- common/autotest_common.sh@10 -- # set +x 00:14:15.262 04:25:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:15.262 04:25:54 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:15.262 04:25:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:15.262 04:25:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:15.262 04:25:54 -- common/autotest_common.sh@10 -- # set +x 00:14:15.523 04:25:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:15.523 04:25:54 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:15.523 04:25:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:15.523 04:25:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:15.523 04:25:54 -- common/autotest_common.sh@10 -- # set +x 00:14:15.784 04:25:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:15.784 04:25:54 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:15.784 04:25:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:15.784 04:25:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:15.784 04:25:54 -- common/autotest_common.sh@10 -- # set +x 00:14:16.042 04:25:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:16.042 04:25:55 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:16.042 04:25:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:16.042 04:25:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:16.042 04:25:55 -- common/autotest_common.sh@10 -- # set +x 00:14:16.302 04:25:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:16.302 04:25:55 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:16.302 04:25:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:16.302 04:25:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:16.302 04:25:55 -- common/autotest_common.sh@10 -- # set +x 00:14:16.871 04:25:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:16.871 04:25:55 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:16.871 04:25:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:16.871 04:25:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:16.871 04:25:55 -- common/autotest_common.sh@10 -- # set +x 00:14:17.130 04:25:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.130 04:25:56 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:17.130 04:25:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:17.130 04:25:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.130 04:25:56 -- common/autotest_common.sh@10 -- # set +x 00:14:17.389 04:25:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.389 04:25:56 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:17.389 04:25:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:17.389 04:25:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.389 04:25:56 -- common/autotest_common.sh@10 -- # set +x 00:14:17.647 04:25:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.647 04:25:56 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:17.647 04:25:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:17.647 04:25:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.647 04:25:56 -- common/autotest_common.sh@10 -- # set +x 00:14:17.907 04:25:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.907 04:25:57 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:17.907 04:25:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:17.907 04:25:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.907 04:25:57 -- common/autotest_common.sh@10 -- # set +x 00:14:18.477 04:25:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.477 04:25:57 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:18.477 04:25:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:18.477 04:25:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.477 04:25:57 -- common/autotest_common.sh@10 -- # set +x 00:14:18.736 04:25:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.736 04:25:57 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:18.736 04:25:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:18.736 04:25:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.736 04:25:57 -- common/autotest_common.sh@10 -- # set +x 00:14:18.996 04:25:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.996 04:25:58 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:18.996 04:25:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:18.996 04:25:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.996 04:25:58 -- common/autotest_common.sh@10 -- # set +x 00:14:19.254 04:25:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:19.254 04:25:58 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:19.254 04:25:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:19.254 04:25:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:19.254 04:25:58 -- common/autotest_common.sh@10 -- # set +x 00:14:19.514 04:25:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:19.514 04:25:58 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:19.514 04:25:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:19.514 04:25:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:19.514 04:25:58 -- common/autotest_common.sh@10 -- # set +x 00:14:20.083 04:25:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.083 04:25:59 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:20.083 04:25:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:20.083 04:25:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.083 04:25:59 -- common/autotest_common.sh@10 -- # set +x 00:14:20.341 04:25:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.341 04:25:59 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:20.341 04:25:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:20.341 04:25:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.341 04:25:59 -- common/autotest_common.sh@10 -- # set +x 00:14:20.600 04:25:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.600 04:25:59 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:20.600 04:25:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:20.600 04:25:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.600 04:25:59 -- common/autotest_common.sh@10 -- # set +x 00:14:20.860 04:25:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.861 04:25:59 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:20.861 04:25:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:20.861 04:25:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.861 04:25:59 -- common/autotest_common.sh@10 -- # set +x 00:14:21.119 04:26:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.119 04:26:00 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:21.119 04:26:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:21.119 04:26:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.119 04:26:00 -- common/autotest_common.sh@10 -- # set +x 00:14:21.685 04:26:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.685 04:26:00 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:21.685 04:26:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:21.685 04:26:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.685 04:26:00 -- common/autotest_common.sh@10 -- # set +x 00:14:21.944 04:26:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.944 04:26:00 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:21.944 04:26:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:21.944 04:26:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.944 04:26:00 -- common/autotest_common.sh@10 -- # set +x 00:14:22.202 04:26:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.202 04:26:01 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:22.202 04:26:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:22.202 04:26:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.202 04:26:01 -- common/autotest_common.sh@10 -- # set +x 00:14:22.462 04:26:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.462 04:26:01 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:22.462 04:26:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:22.462 04:26:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.462 04:26:01 -- common/autotest_common.sh@10 -- # set +x 00:14:22.721 04:26:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.721 04:26:01 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:22.721 04:26:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:22.721 04:26:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.721 04:26:01 -- common/autotest_common.sh@10 -- # set +x 00:14:23.288 04:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.288 04:26:02 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:23.288 04:26:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:23.288 04:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.288 04:26:02 -- common/autotest_common.sh@10 -- # set +x 00:14:23.548 04:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.548 04:26:02 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:23.548 04:26:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:23.548 04:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.548 04:26:02 -- common/autotest_common.sh@10 -- # set +x 00:14:23.806 04:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.806 04:26:02 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:23.806 04:26:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:23.806 04:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.806 04:26:02 -- common/autotest_common.sh@10 -- # set +x 00:14:24.065 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:24.065 04:26:03 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:24.065 04:26:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:24.065 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:24.065 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:14:24.323 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:24.323 04:26:03 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:24.323 04:26:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:24.323 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:24.323 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:14:24.891 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:24.891 04:26:03 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:24.891 04:26:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:24.891 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:24.891 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:14:24.891 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:25.151 04:26:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:25.151 04:26:04 -- target/connect_stress.sh@34 -- # kill -0 2875928 00:14:25.151 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (2875928) - No such process 00:14:25.152 04:26:04 -- target/connect_stress.sh@38 -- # wait 2875928 00:14:25.152 04:26:04 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:25.152 04:26:04 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:25.152 04:26:04 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:25.152 04:26:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:25.152 04:26:04 -- nvmf/common.sh@116 -- # sync 00:14:25.152 04:26:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:25.152 04:26:04 -- nvmf/common.sh@119 -- # set +e 00:14:25.152 04:26:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:25.152 04:26:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:25.152 rmmod nvme_tcp 00:14:25.152 rmmod nvme_fabrics 00:14:25.152 rmmod nvme_keyring 00:14:25.152 04:26:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:25.152 04:26:04 -- nvmf/common.sh@123 -- # set -e 00:14:25.152 04:26:04 -- nvmf/common.sh@124 -- # return 0 00:14:25.152 04:26:04 -- nvmf/common.sh@477 -- # '[' -n 2875767 ']' 00:14:25.152 04:26:04 -- nvmf/common.sh@478 -- # killprocess 2875767 00:14:25.152 04:26:04 -- common/autotest_common.sh@936 -- # '[' -z 2875767 ']' 00:14:25.152 04:26:04 -- common/autotest_common.sh@940 -- # kill -0 2875767 00:14:25.152 04:26:04 -- common/autotest_common.sh@941 -- # uname 00:14:25.152 04:26:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:25.152 04:26:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2875767 00:14:25.152 04:26:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:25.152 04:26:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:25.152 04:26:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2875767' 00:14:25.152 killing process with pid 2875767 00:14:25.152 04:26:04 -- common/autotest_common.sh@955 -- # kill 2875767 00:14:25.152 04:26:04 -- common/autotest_common.sh@960 -- # wait 2875767 00:14:25.410 04:26:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:25.410 04:26:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:25.410 04:26:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:25.411 04:26:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:25.411 04:26:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:25.411 04:26:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:25.411 04:26:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:25.411 04:26:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:27.949 04:26:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:27.949 00:14:27.949 real 0m16.076s 00:14:27.949 user 0m40.905s 00:14:27.949 sys 0m5.809s 00:14:27.949 04:26:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:27.949 04:26:06 -- common/autotest_common.sh@10 -- # set +x 00:14:27.949 ************************************ 00:14:27.949 END TEST nvmf_connect_stress 00:14:27.949 ************************************ 00:14:27.949 04:26:06 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:27.949 04:26:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:27.949 04:26:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:27.949 04:26:06 -- common/autotest_common.sh@10 -- # set +x 00:14:27.949 ************************************ 00:14:27.949 START TEST nvmf_fused_ordering 00:14:27.949 ************************************ 00:14:27.949 04:26:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:27.949 * Looking for test storage... 00:14:27.949 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:27.949 04:26:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:27.949 04:26:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:27.949 04:26:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:27.949 04:26:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:27.949 04:26:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:27.949 04:26:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:27.949 04:26:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:27.949 04:26:06 -- scripts/common.sh@335 -- # IFS=.-: 00:14:27.949 04:26:06 -- scripts/common.sh@335 -- # read -ra ver1 00:14:27.949 04:26:06 -- scripts/common.sh@336 -- # IFS=.-: 00:14:27.950 04:26:06 -- scripts/common.sh@336 -- # read -ra ver2 00:14:27.950 04:26:06 -- scripts/common.sh@337 -- # local 'op=<' 00:14:27.950 04:26:06 -- scripts/common.sh@339 -- # ver1_l=2 00:14:27.950 04:26:06 -- scripts/common.sh@340 -- # ver2_l=1 00:14:27.950 04:26:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:27.950 04:26:06 -- scripts/common.sh@343 -- # case "$op" in 00:14:27.950 04:26:06 -- scripts/common.sh@344 -- # : 1 00:14:27.950 04:26:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:27.950 04:26:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:27.950 04:26:06 -- scripts/common.sh@364 -- # decimal 1 00:14:27.950 04:26:06 -- scripts/common.sh@352 -- # local d=1 00:14:27.950 04:26:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:27.950 04:26:06 -- scripts/common.sh@354 -- # echo 1 00:14:27.950 04:26:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:27.950 04:26:06 -- scripts/common.sh@365 -- # decimal 2 00:14:27.950 04:26:06 -- scripts/common.sh@352 -- # local d=2 00:14:27.950 04:26:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:27.950 04:26:06 -- scripts/common.sh@354 -- # echo 2 00:14:27.950 04:26:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:27.950 04:26:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:27.950 04:26:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:27.950 04:26:06 -- scripts/common.sh@367 -- # return 0 00:14:27.950 04:26:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:27.950 04:26:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:27.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:27.950 --rc genhtml_branch_coverage=1 00:14:27.950 --rc genhtml_function_coverage=1 00:14:27.950 --rc genhtml_legend=1 00:14:27.950 --rc geninfo_all_blocks=1 00:14:27.950 --rc geninfo_unexecuted_blocks=1 00:14:27.950 00:14:27.950 ' 00:14:27.950 04:26:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:27.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:27.950 --rc genhtml_branch_coverage=1 00:14:27.950 --rc genhtml_function_coverage=1 00:14:27.950 --rc genhtml_legend=1 00:14:27.950 --rc geninfo_all_blocks=1 00:14:27.950 --rc geninfo_unexecuted_blocks=1 00:14:27.950 00:14:27.950 ' 00:14:27.950 04:26:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:27.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:27.950 --rc genhtml_branch_coverage=1 00:14:27.950 --rc genhtml_function_coverage=1 00:14:27.950 --rc genhtml_legend=1 00:14:27.950 --rc geninfo_all_blocks=1 00:14:27.950 --rc geninfo_unexecuted_blocks=1 00:14:27.950 00:14:27.950 ' 00:14:27.950 04:26:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:27.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:27.950 --rc genhtml_branch_coverage=1 00:14:27.950 --rc genhtml_function_coverage=1 00:14:27.950 --rc genhtml_legend=1 00:14:27.950 --rc geninfo_all_blocks=1 00:14:27.950 --rc geninfo_unexecuted_blocks=1 00:14:27.950 00:14:27.950 ' 00:14:27.950 04:26:06 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:27.950 04:26:06 -- nvmf/common.sh@7 -- # uname -s 00:14:27.950 04:26:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:27.950 04:26:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:27.950 04:26:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:27.950 04:26:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:27.950 04:26:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:27.950 04:26:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:27.950 04:26:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:27.950 04:26:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:27.950 04:26:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:27.950 04:26:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:27.950 04:26:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:27.950 04:26:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:27.950 04:26:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:27.950 04:26:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:27.950 04:26:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:27.950 04:26:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:27.950 04:26:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:27.950 04:26:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:27.950 04:26:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:27.950 04:26:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:27.950 04:26:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:27.950 04:26:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:27.950 04:26:06 -- paths/export.sh@5 -- # export PATH 00:14:27.950 04:26:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:27.950 04:26:06 -- nvmf/common.sh@46 -- # : 0 00:14:27.950 04:26:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:27.950 04:26:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:27.950 04:26:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:27.950 04:26:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:27.950 04:26:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:27.950 04:26:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:27.950 04:26:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:27.950 04:26:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:27.950 04:26:06 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:27.950 04:26:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:27.950 04:26:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:27.950 04:26:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:27.950 04:26:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:27.950 04:26:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:27.950 04:26:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:27.950 04:26:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:27.950 04:26:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:27.950 04:26:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:27.950 04:26:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:27.950 04:26:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:27.950 04:26:06 -- common/autotest_common.sh@10 -- # set +x 00:14:29.857 04:26:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:29.857 04:26:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:29.857 04:26:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:29.857 04:26:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:29.857 04:26:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:29.857 04:26:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:29.857 04:26:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:29.857 04:26:08 -- nvmf/common.sh@294 -- # net_devs=() 00:14:29.857 04:26:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:29.857 04:26:08 -- nvmf/common.sh@295 -- # e810=() 00:14:29.857 04:26:08 -- nvmf/common.sh@295 -- # local -ga e810 00:14:29.857 04:26:08 -- nvmf/common.sh@296 -- # x722=() 00:14:29.857 04:26:08 -- nvmf/common.sh@296 -- # local -ga x722 00:14:29.857 04:26:08 -- nvmf/common.sh@297 -- # mlx=() 00:14:29.857 04:26:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:29.857 04:26:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:29.857 04:26:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:29.857 04:26:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:29.857 04:26:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:29.857 04:26:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:29.857 04:26:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:29.857 04:26:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:29.857 04:26:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:29.857 04:26:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:29.857 04:26:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:29.857 04:26:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:29.857 04:26:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:29.857 04:26:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:29.857 04:26:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:29.857 04:26:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:29.857 04:26:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:29.857 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:29.857 04:26:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:29.857 04:26:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:29.857 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:29.857 04:26:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:29.857 04:26:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:29.857 04:26:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:29.857 04:26:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:29.857 04:26:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:29.857 04:26:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:29.857 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:29.857 04:26:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:29.857 04:26:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:29.857 04:26:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:29.857 04:26:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:29.857 04:26:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:29.857 04:26:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:29.857 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:29.857 04:26:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:29.857 04:26:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:29.857 04:26:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:29.857 04:26:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:29.857 04:26:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:29.857 04:26:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:29.857 04:26:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:29.857 04:26:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:29.857 04:26:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:29.857 04:26:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:29.857 04:26:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:29.857 04:26:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:29.857 04:26:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:29.857 04:26:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:29.857 04:26:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:29.857 04:26:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:29.857 04:26:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:29.857 04:26:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:29.857 04:26:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:29.857 04:26:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:29.857 04:26:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:29.857 04:26:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:29.857 04:26:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:29.857 04:26:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:29.857 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:29.857 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.192 ms 00:14:29.857 00:14:29.857 --- 10.0.0.2 ping statistics --- 00:14:29.857 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:29.857 rtt min/avg/max/mdev = 0.192/0.192/0.192/0.000 ms 00:14:29.857 04:26:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:29.857 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:29.857 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:14:29.857 00:14:29.857 --- 10.0.0.1 ping statistics --- 00:14:29.857 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:29.857 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:14:29.857 04:26:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:29.857 04:26:08 -- nvmf/common.sh@410 -- # return 0 00:14:29.857 04:26:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:29.857 04:26:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:29.857 04:26:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:29.857 04:26:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:29.857 04:26:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:29.857 04:26:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:29.857 04:26:09 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:29.857 04:26:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:29.857 04:26:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:29.857 04:26:09 -- common/autotest_common.sh@10 -- # set +x 00:14:29.857 04:26:09 -- nvmf/common.sh@469 -- # nvmfpid=2879129 00:14:29.857 04:26:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:29.857 04:26:09 -- nvmf/common.sh@470 -- # waitforlisten 2879129 00:14:29.857 04:26:09 -- common/autotest_common.sh@829 -- # '[' -z 2879129 ']' 00:14:29.857 04:26:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:29.857 04:26:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:29.857 04:26:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:29.858 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:29.858 04:26:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:29.858 04:26:09 -- common/autotest_common.sh@10 -- # set +x 00:14:29.858 [2024-11-26 04:26:09.061412] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:29.858 [2024-11-26 04:26:09.061485] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:30.116 EAL: No free 2048 kB hugepages reported on node 1 00:14:30.116 [2024-11-26 04:26:09.124378] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:30.116 [2024-11-26 04:26:09.208768] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:30.116 [2024-11-26 04:26:09.208933] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:30.116 [2024-11-26 04:26:09.208951] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:30.116 [2024-11-26 04:26:09.208979] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:30.116 [2024-11-26 04:26:09.209008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:31.050 04:26:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:31.050 04:26:10 -- common/autotest_common.sh@862 -- # return 0 00:14:31.050 04:26:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:31.050 04:26:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:31.050 04:26:10 -- common/autotest_common.sh@10 -- # set +x 00:14:31.050 04:26:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:31.050 04:26:10 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:31.050 04:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.050 04:26:10 -- common/autotest_common.sh@10 -- # set +x 00:14:31.050 [2024-11-26 04:26:10.068524] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:31.050 04:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.050 04:26:10 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:31.050 04:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.050 04:26:10 -- common/autotest_common.sh@10 -- # set +x 00:14:31.050 04:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.050 04:26:10 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:31.050 04:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.050 04:26:10 -- common/autotest_common.sh@10 -- # set +x 00:14:31.050 [2024-11-26 04:26:10.084767] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:31.050 04:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.050 04:26:10 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:31.050 04:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.050 04:26:10 -- common/autotest_common.sh@10 -- # set +x 00:14:31.050 NULL1 00:14:31.050 04:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.050 04:26:10 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:31.050 04:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.050 04:26:10 -- common/autotest_common.sh@10 -- # set +x 00:14:31.050 04:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.050 04:26:10 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:31.050 04:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.050 04:26:10 -- common/autotest_common.sh@10 -- # set +x 00:14:31.050 04:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.050 04:26:10 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:31.050 [2024-11-26 04:26:10.128183] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:31.050 [2024-11-26 04:26:10.128222] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2879283 ] 00:14:31.050 EAL: No free 2048 kB hugepages reported on node 1 00:14:31.616 Attached to nqn.2016-06.io.spdk:cnode1 00:14:31.616 Namespace ID: 1 size: 1GB 00:14:31.616 fused_ordering(0) 00:14:31.617 fused_ordering(1) 00:14:31.617 fused_ordering(2) 00:14:31.617 fused_ordering(3) 00:14:31.617 fused_ordering(4) 00:14:31.617 fused_ordering(5) 00:14:31.617 fused_ordering(6) 00:14:31.617 fused_ordering(7) 00:14:31.617 fused_ordering(8) 00:14:31.617 fused_ordering(9) 00:14:31.617 fused_ordering(10) 00:14:31.617 fused_ordering(11) 00:14:31.617 fused_ordering(12) 00:14:31.617 fused_ordering(13) 00:14:31.617 fused_ordering(14) 00:14:31.617 fused_ordering(15) 00:14:31.617 fused_ordering(16) 00:14:31.617 fused_ordering(17) 00:14:31.617 fused_ordering(18) 00:14:31.617 fused_ordering(19) 00:14:31.617 fused_ordering(20) 00:14:31.617 fused_ordering(21) 00:14:31.617 fused_ordering(22) 00:14:31.617 fused_ordering(23) 00:14:31.617 fused_ordering(24) 00:14:31.617 fused_ordering(25) 00:14:31.617 fused_ordering(26) 00:14:31.617 fused_ordering(27) 00:14:31.617 fused_ordering(28) 00:14:31.617 fused_ordering(29) 00:14:31.617 fused_ordering(30) 00:14:31.617 fused_ordering(31) 00:14:31.617 fused_ordering(32) 00:14:31.617 fused_ordering(33) 00:14:31.617 fused_ordering(34) 00:14:31.617 fused_ordering(35) 00:14:31.617 fused_ordering(36) 00:14:31.617 fused_ordering(37) 00:14:31.617 fused_ordering(38) 00:14:31.617 fused_ordering(39) 00:14:31.617 fused_ordering(40) 00:14:31.617 fused_ordering(41) 00:14:31.617 fused_ordering(42) 00:14:31.617 fused_ordering(43) 00:14:31.617 fused_ordering(44) 00:14:31.617 fused_ordering(45) 00:14:31.617 fused_ordering(46) 00:14:31.617 fused_ordering(47) 00:14:31.617 fused_ordering(48) 00:14:31.617 fused_ordering(49) 00:14:31.617 fused_ordering(50) 00:14:31.617 fused_ordering(51) 00:14:31.617 fused_ordering(52) 00:14:31.617 fused_ordering(53) 00:14:31.617 fused_ordering(54) 00:14:31.617 fused_ordering(55) 00:14:31.617 fused_ordering(56) 00:14:31.617 fused_ordering(57) 00:14:31.617 fused_ordering(58) 00:14:31.617 fused_ordering(59) 00:14:31.617 fused_ordering(60) 00:14:31.617 fused_ordering(61) 00:14:31.617 fused_ordering(62) 00:14:31.617 fused_ordering(63) 00:14:31.617 fused_ordering(64) 00:14:31.617 fused_ordering(65) 00:14:31.617 fused_ordering(66) 00:14:31.617 fused_ordering(67) 00:14:31.617 fused_ordering(68) 00:14:31.617 fused_ordering(69) 00:14:31.617 fused_ordering(70) 00:14:31.617 fused_ordering(71) 00:14:31.617 fused_ordering(72) 00:14:31.617 fused_ordering(73) 00:14:31.617 fused_ordering(74) 00:14:31.617 fused_ordering(75) 00:14:31.617 fused_ordering(76) 00:14:31.617 fused_ordering(77) 00:14:31.617 fused_ordering(78) 00:14:31.617 fused_ordering(79) 00:14:31.617 fused_ordering(80) 00:14:31.617 fused_ordering(81) 00:14:31.617 fused_ordering(82) 00:14:31.617 fused_ordering(83) 00:14:31.617 fused_ordering(84) 00:14:31.617 fused_ordering(85) 00:14:31.617 fused_ordering(86) 00:14:31.617 fused_ordering(87) 00:14:31.617 fused_ordering(88) 00:14:31.617 fused_ordering(89) 00:14:31.617 fused_ordering(90) 00:14:31.617 fused_ordering(91) 00:14:31.617 fused_ordering(92) 00:14:31.617 fused_ordering(93) 00:14:31.617 fused_ordering(94) 00:14:31.617 fused_ordering(95) 00:14:31.617 fused_ordering(96) 00:14:31.617 fused_ordering(97) 00:14:31.617 fused_ordering(98) 00:14:31.617 fused_ordering(99) 00:14:31.617 fused_ordering(100) 00:14:31.617 fused_ordering(101) 00:14:31.617 fused_ordering(102) 00:14:31.617 fused_ordering(103) 00:14:31.617 fused_ordering(104) 00:14:31.617 fused_ordering(105) 00:14:31.617 fused_ordering(106) 00:14:31.617 fused_ordering(107) 00:14:31.617 fused_ordering(108) 00:14:31.617 fused_ordering(109) 00:14:31.617 fused_ordering(110) 00:14:31.617 fused_ordering(111) 00:14:31.617 fused_ordering(112) 00:14:31.617 fused_ordering(113) 00:14:31.617 fused_ordering(114) 00:14:31.617 fused_ordering(115) 00:14:31.617 fused_ordering(116) 00:14:31.617 fused_ordering(117) 00:14:31.617 fused_ordering(118) 00:14:31.617 fused_ordering(119) 00:14:31.617 fused_ordering(120) 00:14:31.617 fused_ordering(121) 00:14:31.617 fused_ordering(122) 00:14:31.617 fused_ordering(123) 00:14:31.617 fused_ordering(124) 00:14:31.617 fused_ordering(125) 00:14:31.617 fused_ordering(126) 00:14:31.617 fused_ordering(127) 00:14:31.617 fused_ordering(128) 00:14:31.617 fused_ordering(129) 00:14:31.617 fused_ordering(130) 00:14:31.617 fused_ordering(131) 00:14:31.617 fused_ordering(132) 00:14:31.617 fused_ordering(133) 00:14:31.617 fused_ordering(134) 00:14:31.617 fused_ordering(135) 00:14:31.617 fused_ordering(136) 00:14:31.617 fused_ordering(137) 00:14:31.617 fused_ordering(138) 00:14:31.617 fused_ordering(139) 00:14:31.617 fused_ordering(140) 00:14:31.617 fused_ordering(141) 00:14:31.617 fused_ordering(142) 00:14:31.617 fused_ordering(143) 00:14:31.617 fused_ordering(144) 00:14:31.617 fused_ordering(145) 00:14:31.617 fused_ordering(146) 00:14:31.617 fused_ordering(147) 00:14:31.617 fused_ordering(148) 00:14:31.617 fused_ordering(149) 00:14:31.617 fused_ordering(150) 00:14:31.617 fused_ordering(151) 00:14:31.617 fused_ordering(152) 00:14:31.617 fused_ordering(153) 00:14:31.617 fused_ordering(154) 00:14:31.617 fused_ordering(155) 00:14:31.617 fused_ordering(156) 00:14:31.617 fused_ordering(157) 00:14:31.617 fused_ordering(158) 00:14:31.617 fused_ordering(159) 00:14:31.617 fused_ordering(160) 00:14:31.617 fused_ordering(161) 00:14:31.617 fused_ordering(162) 00:14:31.617 fused_ordering(163) 00:14:31.617 fused_ordering(164) 00:14:31.617 fused_ordering(165) 00:14:31.617 fused_ordering(166) 00:14:31.617 fused_ordering(167) 00:14:31.617 fused_ordering(168) 00:14:31.617 fused_ordering(169) 00:14:31.617 fused_ordering(170) 00:14:31.617 fused_ordering(171) 00:14:31.617 fused_ordering(172) 00:14:31.617 fused_ordering(173) 00:14:31.617 fused_ordering(174) 00:14:31.617 fused_ordering(175) 00:14:31.617 fused_ordering(176) 00:14:31.617 fused_ordering(177) 00:14:31.617 fused_ordering(178) 00:14:31.617 fused_ordering(179) 00:14:31.617 fused_ordering(180) 00:14:31.617 fused_ordering(181) 00:14:31.617 fused_ordering(182) 00:14:31.617 fused_ordering(183) 00:14:31.617 fused_ordering(184) 00:14:31.617 fused_ordering(185) 00:14:31.617 fused_ordering(186) 00:14:31.617 fused_ordering(187) 00:14:31.617 fused_ordering(188) 00:14:31.617 fused_ordering(189) 00:14:31.617 fused_ordering(190) 00:14:31.617 fused_ordering(191) 00:14:31.617 fused_ordering(192) 00:14:31.617 fused_ordering(193) 00:14:31.617 fused_ordering(194) 00:14:31.617 fused_ordering(195) 00:14:31.617 fused_ordering(196) 00:14:31.617 fused_ordering(197) 00:14:31.617 fused_ordering(198) 00:14:31.617 fused_ordering(199) 00:14:31.617 fused_ordering(200) 00:14:31.617 fused_ordering(201) 00:14:31.617 fused_ordering(202) 00:14:31.617 fused_ordering(203) 00:14:31.617 fused_ordering(204) 00:14:31.617 fused_ordering(205) 00:14:31.876 fused_ordering(206) 00:14:31.876 fused_ordering(207) 00:14:31.876 fused_ordering(208) 00:14:31.876 fused_ordering(209) 00:14:31.876 fused_ordering(210) 00:14:31.876 fused_ordering(211) 00:14:31.876 fused_ordering(212) 00:14:31.876 fused_ordering(213) 00:14:31.876 fused_ordering(214) 00:14:31.876 fused_ordering(215) 00:14:31.876 fused_ordering(216) 00:14:31.876 fused_ordering(217) 00:14:31.876 fused_ordering(218) 00:14:31.876 fused_ordering(219) 00:14:31.876 fused_ordering(220) 00:14:31.876 fused_ordering(221) 00:14:31.876 fused_ordering(222) 00:14:31.876 fused_ordering(223) 00:14:31.876 fused_ordering(224) 00:14:31.876 fused_ordering(225) 00:14:31.876 fused_ordering(226) 00:14:31.876 fused_ordering(227) 00:14:31.876 fused_ordering(228) 00:14:31.876 fused_ordering(229) 00:14:31.876 fused_ordering(230) 00:14:31.876 fused_ordering(231) 00:14:31.876 fused_ordering(232) 00:14:31.876 fused_ordering(233) 00:14:31.876 fused_ordering(234) 00:14:31.876 fused_ordering(235) 00:14:31.876 fused_ordering(236) 00:14:31.876 fused_ordering(237) 00:14:31.876 fused_ordering(238) 00:14:31.876 fused_ordering(239) 00:14:31.876 fused_ordering(240) 00:14:31.876 fused_ordering(241) 00:14:31.876 fused_ordering(242) 00:14:31.876 fused_ordering(243) 00:14:31.876 fused_ordering(244) 00:14:31.876 fused_ordering(245) 00:14:31.876 fused_ordering(246) 00:14:31.876 fused_ordering(247) 00:14:31.876 fused_ordering(248) 00:14:31.876 fused_ordering(249) 00:14:31.876 fused_ordering(250) 00:14:31.876 fused_ordering(251) 00:14:31.876 fused_ordering(252) 00:14:31.876 fused_ordering(253) 00:14:31.876 fused_ordering(254) 00:14:31.876 fused_ordering(255) 00:14:31.876 fused_ordering(256) 00:14:31.876 fused_ordering(257) 00:14:31.876 fused_ordering(258) 00:14:31.876 fused_ordering(259) 00:14:31.876 fused_ordering(260) 00:14:31.876 fused_ordering(261) 00:14:31.876 fused_ordering(262) 00:14:31.876 fused_ordering(263) 00:14:31.876 fused_ordering(264) 00:14:31.876 fused_ordering(265) 00:14:31.876 fused_ordering(266) 00:14:31.876 fused_ordering(267) 00:14:31.876 fused_ordering(268) 00:14:31.876 fused_ordering(269) 00:14:31.876 fused_ordering(270) 00:14:31.876 fused_ordering(271) 00:14:31.876 fused_ordering(272) 00:14:31.876 fused_ordering(273) 00:14:31.876 fused_ordering(274) 00:14:31.876 fused_ordering(275) 00:14:31.876 fused_ordering(276) 00:14:31.876 fused_ordering(277) 00:14:31.876 fused_ordering(278) 00:14:31.876 fused_ordering(279) 00:14:31.876 fused_ordering(280) 00:14:31.876 fused_ordering(281) 00:14:31.876 fused_ordering(282) 00:14:31.876 fused_ordering(283) 00:14:31.876 fused_ordering(284) 00:14:31.876 fused_ordering(285) 00:14:31.876 fused_ordering(286) 00:14:31.876 fused_ordering(287) 00:14:31.876 fused_ordering(288) 00:14:31.876 fused_ordering(289) 00:14:31.876 fused_ordering(290) 00:14:31.876 fused_ordering(291) 00:14:31.876 fused_ordering(292) 00:14:31.876 fused_ordering(293) 00:14:31.876 fused_ordering(294) 00:14:31.876 fused_ordering(295) 00:14:31.876 fused_ordering(296) 00:14:31.876 fused_ordering(297) 00:14:31.876 fused_ordering(298) 00:14:31.876 fused_ordering(299) 00:14:31.876 fused_ordering(300) 00:14:31.876 fused_ordering(301) 00:14:31.876 fused_ordering(302) 00:14:31.876 fused_ordering(303) 00:14:31.876 fused_ordering(304) 00:14:31.876 fused_ordering(305) 00:14:31.876 fused_ordering(306) 00:14:31.876 fused_ordering(307) 00:14:31.876 fused_ordering(308) 00:14:31.876 fused_ordering(309) 00:14:31.876 fused_ordering(310) 00:14:31.876 fused_ordering(311) 00:14:31.876 fused_ordering(312) 00:14:31.876 fused_ordering(313) 00:14:31.876 fused_ordering(314) 00:14:31.876 fused_ordering(315) 00:14:31.876 fused_ordering(316) 00:14:31.876 fused_ordering(317) 00:14:31.876 fused_ordering(318) 00:14:31.876 fused_ordering(319) 00:14:31.876 fused_ordering(320) 00:14:31.876 fused_ordering(321) 00:14:31.876 fused_ordering(322) 00:14:31.876 fused_ordering(323) 00:14:31.876 fused_ordering(324) 00:14:31.876 fused_ordering(325) 00:14:31.876 fused_ordering(326) 00:14:31.876 fused_ordering(327) 00:14:31.876 fused_ordering(328) 00:14:31.876 fused_ordering(329) 00:14:31.876 fused_ordering(330) 00:14:31.876 fused_ordering(331) 00:14:31.876 fused_ordering(332) 00:14:31.876 fused_ordering(333) 00:14:31.876 fused_ordering(334) 00:14:31.876 fused_ordering(335) 00:14:31.876 fused_ordering(336) 00:14:31.876 fused_ordering(337) 00:14:31.876 fused_ordering(338) 00:14:31.876 fused_ordering(339) 00:14:31.876 fused_ordering(340) 00:14:31.876 fused_ordering(341) 00:14:31.876 fused_ordering(342) 00:14:31.876 fused_ordering(343) 00:14:31.876 fused_ordering(344) 00:14:31.876 fused_ordering(345) 00:14:31.876 fused_ordering(346) 00:14:31.876 fused_ordering(347) 00:14:31.876 fused_ordering(348) 00:14:31.876 fused_ordering(349) 00:14:31.876 fused_ordering(350) 00:14:31.876 fused_ordering(351) 00:14:31.876 fused_ordering(352) 00:14:31.876 fused_ordering(353) 00:14:31.876 fused_ordering(354) 00:14:31.876 fused_ordering(355) 00:14:31.876 fused_ordering(356) 00:14:31.876 fused_ordering(357) 00:14:31.876 fused_ordering(358) 00:14:31.876 fused_ordering(359) 00:14:31.876 fused_ordering(360) 00:14:31.876 fused_ordering(361) 00:14:31.876 fused_ordering(362) 00:14:31.876 fused_ordering(363) 00:14:31.876 fused_ordering(364) 00:14:31.876 fused_ordering(365) 00:14:31.876 fused_ordering(366) 00:14:31.876 fused_ordering(367) 00:14:31.876 fused_ordering(368) 00:14:31.876 fused_ordering(369) 00:14:31.876 fused_ordering(370) 00:14:31.876 fused_ordering(371) 00:14:31.876 fused_ordering(372) 00:14:31.876 fused_ordering(373) 00:14:31.876 fused_ordering(374) 00:14:31.876 fused_ordering(375) 00:14:31.876 fused_ordering(376) 00:14:31.876 fused_ordering(377) 00:14:31.876 fused_ordering(378) 00:14:31.876 fused_ordering(379) 00:14:31.876 fused_ordering(380) 00:14:31.876 fused_ordering(381) 00:14:31.876 fused_ordering(382) 00:14:31.876 fused_ordering(383) 00:14:31.876 fused_ordering(384) 00:14:31.876 fused_ordering(385) 00:14:31.876 fused_ordering(386) 00:14:31.876 fused_ordering(387) 00:14:31.876 fused_ordering(388) 00:14:31.876 fused_ordering(389) 00:14:31.876 fused_ordering(390) 00:14:31.876 fused_ordering(391) 00:14:31.876 fused_ordering(392) 00:14:31.876 fused_ordering(393) 00:14:31.876 fused_ordering(394) 00:14:31.876 fused_ordering(395) 00:14:31.876 fused_ordering(396) 00:14:31.876 fused_ordering(397) 00:14:31.876 fused_ordering(398) 00:14:31.876 fused_ordering(399) 00:14:31.876 fused_ordering(400) 00:14:31.876 fused_ordering(401) 00:14:31.876 fused_ordering(402) 00:14:31.876 fused_ordering(403) 00:14:31.876 fused_ordering(404) 00:14:31.876 fused_ordering(405) 00:14:31.876 fused_ordering(406) 00:14:31.876 fused_ordering(407) 00:14:31.876 fused_ordering(408) 00:14:31.876 fused_ordering(409) 00:14:31.876 fused_ordering(410) 00:14:32.442 fused_ordering(411) 00:14:32.442 fused_ordering(412) 00:14:32.442 fused_ordering(413) 00:14:32.442 fused_ordering(414) 00:14:32.442 fused_ordering(415) 00:14:32.442 fused_ordering(416) 00:14:32.442 fused_ordering(417) 00:14:32.442 fused_ordering(418) 00:14:32.442 fused_ordering(419) 00:14:32.442 fused_ordering(420) 00:14:32.442 fused_ordering(421) 00:14:32.442 fused_ordering(422) 00:14:32.442 fused_ordering(423) 00:14:32.442 fused_ordering(424) 00:14:32.442 fused_ordering(425) 00:14:32.442 fused_ordering(426) 00:14:32.442 fused_ordering(427) 00:14:32.442 fused_ordering(428) 00:14:32.442 fused_ordering(429) 00:14:32.442 fused_ordering(430) 00:14:32.442 fused_ordering(431) 00:14:32.442 fused_ordering(432) 00:14:32.442 fused_ordering(433) 00:14:32.442 fused_ordering(434) 00:14:32.442 fused_ordering(435) 00:14:32.442 fused_ordering(436) 00:14:32.442 fused_ordering(437) 00:14:32.442 fused_ordering(438) 00:14:32.442 fused_ordering(439) 00:14:32.442 fused_ordering(440) 00:14:32.442 fused_ordering(441) 00:14:32.442 fused_ordering(442) 00:14:32.442 fused_ordering(443) 00:14:32.442 fused_ordering(444) 00:14:32.442 fused_ordering(445) 00:14:32.442 fused_ordering(446) 00:14:32.442 fused_ordering(447) 00:14:32.442 fused_ordering(448) 00:14:32.442 fused_ordering(449) 00:14:32.442 fused_ordering(450) 00:14:32.442 fused_ordering(451) 00:14:32.442 fused_ordering(452) 00:14:32.442 fused_ordering(453) 00:14:32.442 fused_ordering(454) 00:14:32.442 fused_ordering(455) 00:14:32.442 fused_ordering(456) 00:14:32.442 fused_ordering(457) 00:14:32.442 fused_ordering(458) 00:14:32.442 fused_ordering(459) 00:14:32.442 fused_ordering(460) 00:14:32.442 fused_ordering(461) 00:14:32.442 fused_ordering(462) 00:14:32.442 fused_ordering(463) 00:14:32.442 fused_ordering(464) 00:14:32.442 fused_ordering(465) 00:14:32.442 fused_ordering(466) 00:14:32.442 fused_ordering(467) 00:14:32.442 fused_ordering(468) 00:14:32.442 fused_ordering(469) 00:14:32.442 fused_ordering(470) 00:14:32.442 fused_ordering(471) 00:14:32.442 fused_ordering(472) 00:14:32.442 fused_ordering(473) 00:14:32.442 fused_ordering(474) 00:14:32.442 fused_ordering(475) 00:14:32.442 fused_ordering(476) 00:14:32.442 fused_ordering(477) 00:14:32.442 fused_ordering(478) 00:14:32.442 fused_ordering(479) 00:14:32.442 fused_ordering(480) 00:14:32.442 fused_ordering(481) 00:14:32.442 fused_ordering(482) 00:14:32.442 fused_ordering(483) 00:14:32.442 fused_ordering(484) 00:14:32.442 fused_ordering(485) 00:14:32.442 fused_ordering(486) 00:14:32.442 fused_ordering(487) 00:14:32.442 fused_ordering(488) 00:14:32.442 fused_ordering(489) 00:14:32.442 fused_ordering(490) 00:14:32.442 fused_ordering(491) 00:14:32.442 fused_ordering(492) 00:14:32.442 fused_ordering(493) 00:14:32.442 fused_ordering(494) 00:14:32.442 fused_ordering(495) 00:14:32.442 fused_ordering(496) 00:14:32.442 fused_ordering(497) 00:14:32.442 fused_ordering(498) 00:14:32.442 fused_ordering(499) 00:14:32.442 fused_ordering(500) 00:14:32.442 fused_ordering(501) 00:14:32.442 fused_ordering(502) 00:14:32.442 fused_ordering(503) 00:14:32.442 fused_ordering(504) 00:14:32.442 fused_ordering(505) 00:14:32.442 fused_ordering(506) 00:14:32.442 fused_ordering(507) 00:14:32.442 fused_ordering(508) 00:14:32.442 fused_ordering(509) 00:14:32.442 fused_ordering(510) 00:14:32.442 fused_ordering(511) 00:14:32.442 fused_ordering(512) 00:14:32.442 fused_ordering(513) 00:14:32.442 fused_ordering(514) 00:14:32.442 fused_ordering(515) 00:14:32.442 fused_ordering(516) 00:14:32.442 fused_ordering(517) 00:14:32.442 fused_ordering(518) 00:14:32.442 fused_ordering(519) 00:14:32.442 fused_ordering(520) 00:14:32.442 fused_ordering(521) 00:14:32.442 fused_ordering(522) 00:14:32.442 fused_ordering(523) 00:14:32.442 fused_ordering(524) 00:14:32.442 fused_ordering(525) 00:14:32.442 fused_ordering(526) 00:14:32.442 fused_ordering(527) 00:14:32.442 fused_ordering(528) 00:14:32.442 fused_ordering(529) 00:14:32.442 fused_ordering(530) 00:14:32.442 fused_ordering(531) 00:14:32.442 fused_ordering(532) 00:14:32.442 fused_ordering(533) 00:14:32.442 fused_ordering(534) 00:14:32.442 fused_ordering(535) 00:14:32.442 fused_ordering(536) 00:14:32.442 fused_ordering(537) 00:14:32.442 fused_ordering(538) 00:14:32.442 fused_ordering(539) 00:14:32.442 fused_ordering(540) 00:14:32.442 fused_ordering(541) 00:14:32.442 fused_ordering(542) 00:14:32.442 fused_ordering(543) 00:14:32.442 fused_ordering(544) 00:14:32.442 fused_ordering(545) 00:14:32.442 fused_ordering(546) 00:14:32.442 fused_ordering(547) 00:14:32.442 fused_ordering(548) 00:14:32.442 fused_ordering(549) 00:14:32.442 fused_ordering(550) 00:14:32.442 fused_ordering(551) 00:14:32.442 fused_ordering(552) 00:14:32.442 fused_ordering(553) 00:14:32.442 fused_ordering(554) 00:14:32.442 fused_ordering(555) 00:14:32.442 fused_ordering(556) 00:14:32.442 fused_ordering(557) 00:14:32.442 fused_ordering(558) 00:14:32.442 fused_ordering(559) 00:14:32.442 fused_ordering(560) 00:14:32.442 fused_ordering(561) 00:14:32.442 fused_ordering(562) 00:14:32.442 fused_ordering(563) 00:14:32.442 fused_ordering(564) 00:14:32.442 fused_ordering(565) 00:14:32.442 fused_ordering(566) 00:14:32.442 fused_ordering(567) 00:14:32.442 fused_ordering(568) 00:14:32.442 fused_ordering(569) 00:14:32.442 fused_ordering(570) 00:14:32.442 fused_ordering(571) 00:14:32.442 fused_ordering(572) 00:14:32.443 fused_ordering(573) 00:14:32.443 fused_ordering(574) 00:14:32.443 fused_ordering(575) 00:14:32.443 fused_ordering(576) 00:14:32.443 fused_ordering(577) 00:14:32.443 fused_ordering(578) 00:14:32.443 fused_ordering(579) 00:14:32.443 fused_ordering(580) 00:14:32.443 fused_ordering(581) 00:14:32.443 fused_ordering(582) 00:14:32.443 fused_ordering(583) 00:14:32.443 fused_ordering(584) 00:14:32.443 fused_ordering(585) 00:14:32.443 fused_ordering(586) 00:14:32.443 fused_ordering(587) 00:14:32.443 fused_ordering(588) 00:14:32.443 fused_ordering(589) 00:14:32.443 fused_ordering(590) 00:14:32.443 fused_ordering(591) 00:14:32.443 fused_ordering(592) 00:14:32.443 fused_ordering(593) 00:14:32.443 fused_ordering(594) 00:14:32.443 fused_ordering(595) 00:14:32.443 fused_ordering(596) 00:14:32.443 fused_ordering(597) 00:14:32.443 fused_ordering(598) 00:14:32.443 fused_ordering(599) 00:14:32.443 fused_ordering(600) 00:14:32.443 fused_ordering(601) 00:14:32.443 fused_ordering(602) 00:14:32.443 fused_ordering(603) 00:14:32.443 fused_ordering(604) 00:14:32.443 fused_ordering(605) 00:14:32.443 fused_ordering(606) 00:14:32.443 fused_ordering(607) 00:14:32.443 fused_ordering(608) 00:14:32.443 fused_ordering(609) 00:14:32.443 fused_ordering(610) 00:14:32.443 fused_ordering(611) 00:14:32.443 fused_ordering(612) 00:14:32.443 fused_ordering(613) 00:14:32.443 fused_ordering(614) 00:14:32.443 fused_ordering(615) 00:14:33.008 fused_ordering(616) 00:14:33.008 fused_ordering(617) 00:14:33.008 fused_ordering(618) 00:14:33.008 fused_ordering(619) 00:14:33.008 fused_ordering(620) 00:14:33.008 fused_ordering(621) 00:14:33.008 fused_ordering(622) 00:14:33.008 fused_ordering(623) 00:14:33.008 fused_ordering(624) 00:14:33.008 fused_ordering(625) 00:14:33.008 fused_ordering(626) 00:14:33.008 fused_ordering(627) 00:14:33.008 fused_ordering(628) 00:14:33.008 fused_ordering(629) 00:14:33.008 fused_ordering(630) 00:14:33.008 fused_ordering(631) 00:14:33.008 fused_ordering(632) 00:14:33.008 fused_ordering(633) 00:14:33.008 fused_ordering(634) 00:14:33.008 fused_ordering(635) 00:14:33.008 fused_ordering(636) 00:14:33.008 fused_ordering(637) 00:14:33.008 fused_ordering(638) 00:14:33.008 fused_ordering(639) 00:14:33.008 fused_ordering(640) 00:14:33.008 fused_ordering(641) 00:14:33.008 fused_ordering(642) 00:14:33.008 fused_ordering(643) 00:14:33.008 fused_ordering(644) 00:14:33.008 fused_ordering(645) 00:14:33.008 fused_ordering(646) 00:14:33.008 fused_ordering(647) 00:14:33.008 fused_ordering(648) 00:14:33.008 fused_ordering(649) 00:14:33.008 fused_ordering(650) 00:14:33.008 fused_ordering(651) 00:14:33.008 fused_ordering(652) 00:14:33.008 fused_ordering(653) 00:14:33.008 fused_ordering(654) 00:14:33.008 fused_ordering(655) 00:14:33.008 fused_ordering(656) 00:14:33.008 fused_ordering(657) 00:14:33.008 fused_ordering(658) 00:14:33.008 fused_ordering(659) 00:14:33.008 fused_ordering(660) 00:14:33.008 fused_ordering(661) 00:14:33.008 fused_ordering(662) 00:14:33.008 fused_ordering(663) 00:14:33.008 fused_ordering(664) 00:14:33.008 fused_ordering(665) 00:14:33.008 fused_ordering(666) 00:14:33.008 fused_ordering(667) 00:14:33.008 fused_ordering(668) 00:14:33.008 fused_ordering(669) 00:14:33.008 fused_ordering(670) 00:14:33.008 fused_ordering(671) 00:14:33.008 fused_ordering(672) 00:14:33.008 fused_ordering(673) 00:14:33.008 fused_ordering(674) 00:14:33.008 fused_ordering(675) 00:14:33.008 fused_ordering(676) 00:14:33.008 fused_ordering(677) 00:14:33.008 fused_ordering(678) 00:14:33.008 fused_ordering(679) 00:14:33.008 fused_ordering(680) 00:14:33.008 fused_ordering(681) 00:14:33.008 fused_ordering(682) 00:14:33.008 fused_ordering(683) 00:14:33.008 fused_ordering(684) 00:14:33.008 fused_ordering(685) 00:14:33.008 fused_ordering(686) 00:14:33.008 fused_ordering(687) 00:14:33.008 fused_ordering(688) 00:14:33.008 fused_ordering(689) 00:14:33.008 fused_ordering(690) 00:14:33.008 fused_ordering(691) 00:14:33.008 fused_ordering(692) 00:14:33.008 fused_ordering(693) 00:14:33.008 fused_ordering(694) 00:14:33.008 fused_ordering(695) 00:14:33.008 fused_ordering(696) 00:14:33.008 fused_ordering(697) 00:14:33.008 fused_ordering(698) 00:14:33.008 fused_ordering(699) 00:14:33.008 fused_ordering(700) 00:14:33.008 fused_ordering(701) 00:14:33.008 fused_ordering(702) 00:14:33.008 fused_ordering(703) 00:14:33.008 fused_ordering(704) 00:14:33.008 fused_ordering(705) 00:14:33.008 fused_ordering(706) 00:14:33.008 fused_ordering(707) 00:14:33.008 fused_ordering(708) 00:14:33.008 fused_ordering(709) 00:14:33.008 fused_ordering(710) 00:14:33.008 fused_ordering(711) 00:14:33.008 fused_ordering(712) 00:14:33.008 fused_ordering(713) 00:14:33.008 fused_ordering(714) 00:14:33.008 fused_ordering(715) 00:14:33.008 fused_ordering(716) 00:14:33.008 fused_ordering(717) 00:14:33.008 fused_ordering(718) 00:14:33.008 fused_ordering(719) 00:14:33.008 fused_ordering(720) 00:14:33.008 fused_ordering(721) 00:14:33.008 fused_ordering(722) 00:14:33.008 fused_ordering(723) 00:14:33.008 fused_ordering(724) 00:14:33.008 fused_ordering(725) 00:14:33.008 fused_ordering(726) 00:14:33.008 fused_ordering(727) 00:14:33.008 fused_ordering(728) 00:14:33.008 fused_ordering(729) 00:14:33.008 fused_ordering(730) 00:14:33.008 fused_ordering(731) 00:14:33.008 fused_ordering(732) 00:14:33.008 fused_ordering(733) 00:14:33.008 fused_ordering(734) 00:14:33.008 fused_ordering(735) 00:14:33.008 fused_ordering(736) 00:14:33.008 fused_ordering(737) 00:14:33.008 fused_ordering(738) 00:14:33.008 fused_ordering(739) 00:14:33.008 fused_ordering(740) 00:14:33.008 fused_ordering(741) 00:14:33.008 fused_ordering(742) 00:14:33.008 fused_ordering(743) 00:14:33.008 fused_ordering(744) 00:14:33.008 fused_ordering(745) 00:14:33.008 fused_ordering(746) 00:14:33.008 fused_ordering(747) 00:14:33.008 fused_ordering(748) 00:14:33.008 fused_ordering(749) 00:14:33.008 fused_ordering(750) 00:14:33.008 fused_ordering(751) 00:14:33.008 fused_ordering(752) 00:14:33.008 fused_ordering(753) 00:14:33.008 fused_ordering(754) 00:14:33.008 fused_ordering(755) 00:14:33.008 fused_ordering(756) 00:14:33.008 fused_ordering(757) 00:14:33.008 fused_ordering(758) 00:14:33.008 fused_ordering(759) 00:14:33.008 fused_ordering(760) 00:14:33.008 fused_ordering(761) 00:14:33.008 fused_ordering(762) 00:14:33.008 fused_ordering(763) 00:14:33.008 fused_ordering(764) 00:14:33.008 fused_ordering(765) 00:14:33.008 fused_ordering(766) 00:14:33.008 fused_ordering(767) 00:14:33.008 fused_ordering(768) 00:14:33.008 fused_ordering(769) 00:14:33.008 fused_ordering(770) 00:14:33.008 fused_ordering(771) 00:14:33.008 fused_ordering(772) 00:14:33.008 fused_ordering(773) 00:14:33.008 fused_ordering(774) 00:14:33.008 fused_ordering(775) 00:14:33.008 fused_ordering(776) 00:14:33.008 fused_ordering(777) 00:14:33.008 fused_ordering(778) 00:14:33.008 fused_ordering(779) 00:14:33.008 fused_ordering(780) 00:14:33.008 fused_ordering(781) 00:14:33.008 fused_ordering(782) 00:14:33.008 fused_ordering(783) 00:14:33.008 fused_ordering(784) 00:14:33.008 fused_ordering(785) 00:14:33.008 fused_ordering(786) 00:14:33.008 fused_ordering(787) 00:14:33.008 fused_ordering(788) 00:14:33.008 fused_ordering(789) 00:14:33.008 fused_ordering(790) 00:14:33.008 fused_ordering(791) 00:14:33.008 fused_ordering(792) 00:14:33.008 fused_ordering(793) 00:14:33.008 fused_ordering(794) 00:14:33.008 fused_ordering(795) 00:14:33.008 fused_ordering(796) 00:14:33.008 fused_ordering(797) 00:14:33.008 fused_ordering(798) 00:14:33.008 fused_ordering(799) 00:14:33.008 fused_ordering(800) 00:14:33.008 fused_ordering(801) 00:14:33.008 fused_ordering(802) 00:14:33.008 fused_ordering(803) 00:14:33.008 fused_ordering(804) 00:14:33.008 fused_ordering(805) 00:14:33.008 fused_ordering(806) 00:14:33.008 fused_ordering(807) 00:14:33.008 fused_ordering(808) 00:14:33.008 fused_ordering(809) 00:14:33.008 fused_ordering(810) 00:14:33.008 fused_ordering(811) 00:14:33.008 fused_ordering(812) 00:14:33.008 fused_ordering(813) 00:14:33.008 fused_ordering(814) 00:14:33.008 fused_ordering(815) 00:14:33.008 fused_ordering(816) 00:14:33.008 fused_ordering(817) 00:14:33.008 fused_ordering(818) 00:14:33.008 fused_ordering(819) 00:14:33.008 fused_ordering(820) 00:14:33.575 fused_ordering(821) 00:14:33.575 fused_ordering(822) 00:14:33.575 fused_ordering(823) 00:14:33.575 fused_ordering(824) 00:14:33.575 fused_ordering(825) 00:14:33.575 fused_ordering(826) 00:14:33.575 fused_ordering(827) 00:14:33.575 fused_ordering(828) 00:14:33.575 fused_ordering(829) 00:14:33.575 fused_ordering(830) 00:14:33.575 fused_ordering(831) 00:14:33.575 fused_ordering(832) 00:14:33.575 fused_ordering(833) 00:14:33.575 fused_ordering(834) 00:14:33.575 fused_ordering(835) 00:14:33.575 fused_ordering(836) 00:14:33.575 fused_ordering(837) 00:14:33.575 fused_ordering(838) 00:14:33.575 fused_ordering(839) 00:14:33.575 fused_ordering(840) 00:14:33.575 fused_ordering(841) 00:14:33.575 fused_ordering(842) 00:14:33.575 fused_ordering(843) 00:14:33.575 fused_ordering(844) 00:14:33.575 fused_ordering(845) 00:14:33.575 fused_ordering(846) 00:14:33.575 fused_ordering(847) 00:14:33.575 fused_ordering(848) 00:14:33.575 fused_ordering(849) 00:14:33.575 fused_ordering(850) 00:14:33.575 fused_ordering(851) 00:14:33.575 fused_ordering(852) 00:14:33.575 fused_ordering(853) 00:14:33.575 fused_ordering(854) 00:14:33.575 fused_ordering(855) 00:14:33.575 fused_ordering(856) 00:14:33.575 fused_ordering(857) 00:14:33.575 fused_ordering(858) 00:14:33.575 fused_ordering(859) 00:14:33.575 fused_ordering(860) 00:14:33.575 fused_ordering(861) 00:14:33.575 fused_ordering(862) 00:14:33.575 fused_ordering(863) 00:14:33.575 fused_ordering(864) 00:14:33.575 fused_ordering(865) 00:14:33.575 fused_ordering(866) 00:14:33.575 fused_ordering(867) 00:14:33.575 fused_ordering(868) 00:14:33.575 fused_ordering(869) 00:14:33.575 fused_ordering(870) 00:14:33.575 fused_ordering(871) 00:14:33.575 fused_ordering(872) 00:14:33.575 fused_ordering(873) 00:14:33.575 fused_ordering(874) 00:14:33.575 fused_ordering(875) 00:14:33.575 fused_ordering(876) 00:14:33.575 fused_ordering(877) 00:14:33.575 fused_ordering(878) 00:14:33.575 fused_ordering(879) 00:14:33.575 fused_ordering(880) 00:14:33.575 fused_ordering(881) 00:14:33.575 fused_ordering(882) 00:14:33.575 fused_ordering(883) 00:14:33.575 fused_ordering(884) 00:14:33.575 fused_ordering(885) 00:14:33.575 fused_ordering(886) 00:14:33.575 fused_ordering(887) 00:14:33.575 fused_ordering(888) 00:14:33.575 fused_ordering(889) 00:14:33.575 fused_ordering(890) 00:14:33.575 fused_ordering(891) 00:14:33.575 fused_ordering(892) 00:14:33.575 fused_ordering(893) 00:14:33.575 fused_ordering(894) 00:14:33.575 fused_ordering(895) 00:14:33.575 fused_ordering(896) 00:14:33.575 fused_ordering(897) 00:14:33.575 fused_ordering(898) 00:14:33.575 fused_ordering(899) 00:14:33.575 fused_ordering(900) 00:14:33.575 fused_ordering(901) 00:14:33.575 fused_ordering(902) 00:14:33.575 fused_ordering(903) 00:14:33.575 fused_ordering(904) 00:14:33.575 fused_ordering(905) 00:14:33.575 fused_ordering(906) 00:14:33.575 fused_ordering(907) 00:14:33.575 fused_ordering(908) 00:14:33.575 fused_ordering(909) 00:14:33.575 fused_ordering(910) 00:14:33.575 fused_ordering(911) 00:14:33.575 fused_ordering(912) 00:14:33.575 fused_ordering(913) 00:14:33.575 fused_ordering(914) 00:14:33.575 fused_ordering(915) 00:14:33.575 fused_ordering(916) 00:14:33.575 fused_ordering(917) 00:14:33.575 fused_ordering(918) 00:14:33.575 fused_ordering(919) 00:14:33.575 fused_ordering(920) 00:14:33.575 fused_ordering(921) 00:14:33.575 fused_ordering(922) 00:14:33.575 fused_ordering(923) 00:14:33.575 fused_ordering(924) 00:14:33.575 fused_ordering(925) 00:14:33.575 fused_ordering(926) 00:14:33.575 fused_ordering(927) 00:14:33.575 fused_ordering(928) 00:14:33.575 fused_ordering(929) 00:14:33.575 fused_ordering(930) 00:14:33.575 fused_ordering(931) 00:14:33.575 fused_ordering(932) 00:14:33.575 fused_ordering(933) 00:14:33.575 fused_ordering(934) 00:14:33.575 fused_ordering(935) 00:14:33.575 fused_ordering(936) 00:14:33.575 fused_ordering(937) 00:14:33.575 fused_ordering(938) 00:14:33.575 fused_ordering(939) 00:14:33.575 fused_ordering(940) 00:14:33.575 fused_ordering(941) 00:14:33.575 fused_ordering(942) 00:14:33.575 fused_ordering(943) 00:14:33.575 fused_ordering(944) 00:14:33.575 fused_ordering(945) 00:14:33.575 fused_ordering(946) 00:14:33.575 fused_ordering(947) 00:14:33.575 fused_ordering(948) 00:14:33.575 fused_ordering(949) 00:14:33.575 fused_ordering(950) 00:14:33.575 fused_ordering(951) 00:14:33.575 fused_ordering(952) 00:14:33.575 fused_ordering(953) 00:14:33.575 fused_ordering(954) 00:14:33.575 fused_ordering(955) 00:14:33.575 fused_ordering(956) 00:14:33.575 fused_ordering(957) 00:14:33.575 fused_ordering(958) 00:14:33.575 fused_ordering(959) 00:14:33.575 fused_ordering(960) 00:14:33.575 fused_ordering(961) 00:14:33.575 fused_ordering(962) 00:14:33.575 fused_ordering(963) 00:14:33.575 fused_ordering(964) 00:14:33.575 fused_ordering(965) 00:14:33.575 fused_ordering(966) 00:14:33.575 fused_ordering(967) 00:14:33.575 fused_ordering(968) 00:14:33.575 fused_ordering(969) 00:14:33.575 fused_ordering(970) 00:14:33.575 fused_ordering(971) 00:14:33.575 fused_ordering(972) 00:14:33.575 fused_ordering(973) 00:14:33.575 fused_ordering(974) 00:14:33.575 fused_ordering(975) 00:14:33.575 fused_ordering(976) 00:14:33.575 fused_ordering(977) 00:14:33.575 fused_ordering(978) 00:14:33.575 fused_ordering(979) 00:14:33.575 fused_ordering(980) 00:14:33.575 fused_ordering(981) 00:14:33.575 fused_ordering(982) 00:14:33.575 fused_ordering(983) 00:14:33.575 fused_ordering(984) 00:14:33.575 fused_ordering(985) 00:14:33.575 fused_ordering(986) 00:14:33.575 fused_ordering(987) 00:14:33.575 fused_ordering(988) 00:14:33.575 fused_ordering(989) 00:14:33.575 fused_ordering(990) 00:14:33.575 fused_ordering(991) 00:14:33.575 fused_ordering(992) 00:14:33.575 fused_ordering(993) 00:14:33.575 fused_ordering(994) 00:14:33.575 fused_ordering(995) 00:14:33.575 fused_ordering(996) 00:14:33.575 fused_ordering(997) 00:14:33.575 fused_ordering(998) 00:14:33.575 fused_ordering(999) 00:14:33.575 fused_ordering(1000) 00:14:33.575 fused_ordering(1001) 00:14:33.575 fused_ordering(1002) 00:14:33.575 fused_ordering(1003) 00:14:33.575 fused_ordering(1004) 00:14:33.575 fused_ordering(1005) 00:14:33.575 fused_ordering(1006) 00:14:33.575 fused_ordering(1007) 00:14:33.575 fused_ordering(1008) 00:14:33.575 fused_ordering(1009) 00:14:33.575 fused_ordering(1010) 00:14:33.575 fused_ordering(1011) 00:14:33.575 fused_ordering(1012) 00:14:33.575 fused_ordering(1013) 00:14:33.575 fused_ordering(1014) 00:14:33.575 fused_ordering(1015) 00:14:33.575 fused_ordering(1016) 00:14:33.575 fused_ordering(1017) 00:14:33.575 fused_ordering(1018) 00:14:33.575 fused_ordering(1019) 00:14:33.576 fused_ordering(1020) 00:14:33.576 fused_ordering(1021) 00:14:33.576 fused_ordering(1022) 00:14:33.576 fused_ordering(1023) 00:14:33.576 04:26:12 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:14:33.576 04:26:12 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:14:33.576 04:26:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:33.576 04:26:12 -- nvmf/common.sh@116 -- # sync 00:14:33.576 04:26:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:33.576 04:26:12 -- nvmf/common.sh@119 -- # set +e 00:14:33.576 04:26:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:33.576 04:26:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:33.576 rmmod nvme_tcp 00:14:33.576 rmmod nvme_fabrics 00:14:33.576 rmmod nvme_keyring 00:14:33.576 04:26:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:33.576 04:26:12 -- nvmf/common.sh@123 -- # set -e 00:14:33.576 04:26:12 -- nvmf/common.sh@124 -- # return 0 00:14:33.576 04:26:12 -- nvmf/common.sh@477 -- # '[' -n 2879129 ']' 00:14:33.576 04:26:12 -- nvmf/common.sh@478 -- # killprocess 2879129 00:14:33.576 04:26:12 -- common/autotest_common.sh@936 -- # '[' -z 2879129 ']' 00:14:33.576 04:26:12 -- common/autotest_common.sh@940 -- # kill -0 2879129 00:14:33.576 04:26:12 -- common/autotest_common.sh@941 -- # uname 00:14:33.576 04:26:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:33.576 04:26:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2879129 00:14:33.835 04:26:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:33.835 04:26:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:33.835 04:26:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2879129' 00:14:33.835 killing process with pid 2879129 00:14:33.835 04:26:12 -- common/autotest_common.sh@955 -- # kill 2879129 00:14:33.835 04:26:12 -- common/autotest_common.sh@960 -- # wait 2879129 00:14:33.835 04:26:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:33.835 04:26:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:33.835 04:26:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:33.835 04:26:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:33.835 04:26:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:33.835 04:26:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:33.835 04:26:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:33.835 04:26:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:36.371 04:26:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:36.371 00:14:36.371 real 0m8.495s 00:14:36.371 user 0m6.274s 00:14:36.371 sys 0m3.382s 00:14:36.371 04:26:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:36.371 04:26:15 -- common/autotest_common.sh@10 -- # set +x 00:14:36.371 ************************************ 00:14:36.371 END TEST nvmf_fused_ordering 00:14:36.371 ************************************ 00:14:36.371 04:26:15 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:36.371 04:26:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:36.371 04:26:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:36.371 04:26:15 -- common/autotest_common.sh@10 -- # set +x 00:14:36.371 ************************************ 00:14:36.371 START TEST nvmf_delete_subsystem 00:14:36.371 ************************************ 00:14:36.371 04:26:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:36.371 * Looking for test storage... 00:14:36.371 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:36.371 04:26:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:36.371 04:26:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:36.371 04:26:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:36.371 04:26:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:36.371 04:26:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:36.371 04:26:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:36.371 04:26:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:36.371 04:26:15 -- scripts/common.sh@335 -- # IFS=.-: 00:14:36.371 04:26:15 -- scripts/common.sh@335 -- # read -ra ver1 00:14:36.371 04:26:15 -- scripts/common.sh@336 -- # IFS=.-: 00:14:36.371 04:26:15 -- scripts/common.sh@336 -- # read -ra ver2 00:14:36.371 04:26:15 -- scripts/common.sh@337 -- # local 'op=<' 00:14:36.371 04:26:15 -- scripts/common.sh@339 -- # ver1_l=2 00:14:36.371 04:26:15 -- scripts/common.sh@340 -- # ver2_l=1 00:14:36.371 04:26:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:36.371 04:26:15 -- scripts/common.sh@343 -- # case "$op" in 00:14:36.371 04:26:15 -- scripts/common.sh@344 -- # : 1 00:14:36.371 04:26:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:36.371 04:26:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:36.371 04:26:15 -- scripts/common.sh@364 -- # decimal 1 00:14:36.371 04:26:15 -- scripts/common.sh@352 -- # local d=1 00:14:36.371 04:26:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:36.371 04:26:15 -- scripts/common.sh@354 -- # echo 1 00:14:36.371 04:26:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:36.371 04:26:15 -- scripts/common.sh@365 -- # decimal 2 00:14:36.371 04:26:15 -- scripts/common.sh@352 -- # local d=2 00:14:36.371 04:26:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:36.371 04:26:15 -- scripts/common.sh@354 -- # echo 2 00:14:36.371 04:26:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:36.371 04:26:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:36.371 04:26:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:36.371 04:26:15 -- scripts/common.sh@367 -- # return 0 00:14:36.371 04:26:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:36.371 04:26:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:36.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:36.371 --rc genhtml_branch_coverage=1 00:14:36.371 --rc genhtml_function_coverage=1 00:14:36.371 --rc genhtml_legend=1 00:14:36.371 --rc geninfo_all_blocks=1 00:14:36.371 --rc geninfo_unexecuted_blocks=1 00:14:36.371 00:14:36.371 ' 00:14:36.371 04:26:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:36.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:36.371 --rc genhtml_branch_coverage=1 00:14:36.371 --rc genhtml_function_coverage=1 00:14:36.371 --rc genhtml_legend=1 00:14:36.371 --rc geninfo_all_blocks=1 00:14:36.371 --rc geninfo_unexecuted_blocks=1 00:14:36.371 00:14:36.371 ' 00:14:36.371 04:26:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:36.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:36.371 --rc genhtml_branch_coverage=1 00:14:36.371 --rc genhtml_function_coverage=1 00:14:36.371 --rc genhtml_legend=1 00:14:36.371 --rc geninfo_all_blocks=1 00:14:36.371 --rc geninfo_unexecuted_blocks=1 00:14:36.371 00:14:36.371 ' 00:14:36.371 04:26:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:36.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:36.371 --rc genhtml_branch_coverage=1 00:14:36.371 --rc genhtml_function_coverage=1 00:14:36.371 --rc genhtml_legend=1 00:14:36.371 --rc geninfo_all_blocks=1 00:14:36.371 --rc geninfo_unexecuted_blocks=1 00:14:36.371 00:14:36.371 ' 00:14:36.371 04:26:15 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:36.371 04:26:15 -- nvmf/common.sh@7 -- # uname -s 00:14:36.371 04:26:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:36.371 04:26:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:36.371 04:26:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:36.371 04:26:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:36.371 04:26:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:36.371 04:26:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:36.371 04:26:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:36.371 04:26:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:36.371 04:26:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:36.371 04:26:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:36.371 04:26:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:36.371 04:26:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:36.371 04:26:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:36.371 04:26:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:36.371 04:26:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:36.371 04:26:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:36.371 04:26:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:36.371 04:26:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:36.371 04:26:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:36.371 04:26:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:36.371 04:26:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:36.371 04:26:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:36.371 04:26:15 -- paths/export.sh@5 -- # export PATH 00:14:36.371 04:26:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:36.371 04:26:15 -- nvmf/common.sh@46 -- # : 0 00:14:36.371 04:26:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:36.371 04:26:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:36.371 04:26:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:36.371 04:26:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:36.371 04:26:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:36.371 04:26:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:36.371 04:26:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:36.371 04:26:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:36.371 04:26:15 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:14:36.371 04:26:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:36.372 04:26:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:36.372 04:26:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:36.372 04:26:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:36.372 04:26:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:36.372 04:26:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:36.372 04:26:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:36.372 04:26:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:36.372 04:26:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:36.372 04:26:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:36.372 04:26:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:36.372 04:26:15 -- common/autotest_common.sh@10 -- # set +x 00:14:38.274 04:26:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:38.274 04:26:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:38.274 04:26:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:38.274 04:26:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:38.274 04:26:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:38.274 04:26:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:38.274 04:26:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:38.274 04:26:17 -- nvmf/common.sh@294 -- # net_devs=() 00:14:38.274 04:26:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:38.274 04:26:17 -- nvmf/common.sh@295 -- # e810=() 00:14:38.274 04:26:17 -- nvmf/common.sh@295 -- # local -ga e810 00:14:38.274 04:26:17 -- nvmf/common.sh@296 -- # x722=() 00:14:38.274 04:26:17 -- nvmf/common.sh@296 -- # local -ga x722 00:14:38.274 04:26:17 -- nvmf/common.sh@297 -- # mlx=() 00:14:38.274 04:26:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:38.274 04:26:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:38.275 04:26:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:38.275 04:26:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:38.275 04:26:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:38.275 04:26:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:38.275 04:26:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:38.275 04:26:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:38.275 04:26:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:38.275 04:26:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:38.275 04:26:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:38.275 04:26:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:38.275 04:26:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:38.275 04:26:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:38.275 04:26:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:38.275 04:26:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:38.275 04:26:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:38.275 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:38.275 04:26:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:38.275 04:26:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:38.275 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:38.275 04:26:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:38.275 04:26:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:38.275 04:26:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:38.275 04:26:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:38.275 04:26:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:38.275 04:26:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:38.275 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:38.275 04:26:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:38.275 04:26:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:38.275 04:26:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:38.275 04:26:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:38.275 04:26:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:38.275 04:26:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:38.275 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:38.275 04:26:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:38.275 04:26:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:38.275 04:26:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:38.275 04:26:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:38.275 04:26:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:38.275 04:26:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:38.275 04:26:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:38.275 04:26:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:38.275 04:26:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:38.275 04:26:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:38.275 04:26:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:38.275 04:26:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:38.275 04:26:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:38.275 04:26:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:38.275 04:26:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:38.275 04:26:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:38.275 04:26:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:38.275 04:26:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:38.275 04:26:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:38.275 04:26:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:38.275 04:26:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:38.275 04:26:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:38.275 04:26:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:38.275 04:26:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:38.534 04:26:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:38.534 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:38.534 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.385 ms 00:14:38.534 00:14:38.534 --- 10.0.0.2 ping statistics --- 00:14:38.534 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:38.534 rtt min/avg/max/mdev = 0.385/0.385/0.385/0.000 ms 00:14:38.534 04:26:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:38.535 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:38.535 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:14:38.535 00:14:38.535 --- 10.0.0.1 ping statistics --- 00:14:38.535 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:38.535 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:14:38.535 04:26:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:38.535 04:26:17 -- nvmf/common.sh@410 -- # return 0 00:14:38.535 04:26:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:38.535 04:26:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:38.535 04:26:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:38.535 04:26:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:38.535 04:26:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:38.535 04:26:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:38.535 04:26:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:38.535 04:26:17 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:14:38.535 04:26:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:38.535 04:26:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:38.535 04:26:17 -- common/autotest_common.sh@10 -- # set +x 00:14:38.535 04:26:17 -- nvmf/common.sh@469 -- # nvmfpid=2881635 00:14:38.535 04:26:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:38.535 04:26:17 -- nvmf/common.sh@470 -- # waitforlisten 2881635 00:14:38.535 04:26:17 -- common/autotest_common.sh@829 -- # '[' -z 2881635 ']' 00:14:38.535 04:26:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:38.535 04:26:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:38.535 04:26:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:38.535 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:38.535 04:26:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:38.535 04:26:17 -- common/autotest_common.sh@10 -- # set +x 00:14:38.535 [2024-11-26 04:26:17.580386] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:38.535 [2024-11-26 04:26:17.580456] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:38.535 EAL: No free 2048 kB hugepages reported on node 1 00:14:38.535 [2024-11-26 04:26:17.643266] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:38.535 [2024-11-26 04:26:17.726774] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:38.535 [2024-11-26 04:26:17.726930] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:38.535 [2024-11-26 04:26:17.726963] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:38.535 [2024-11-26 04:26:17.726976] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:38.535 [2024-11-26 04:26:17.727042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:38.535 [2024-11-26 04:26:17.727043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:38.794 04:26:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:38.794 04:26:17 -- common/autotest_common.sh@862 -- # return 0 00:14:38.794 04:26:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:38.794 04:26:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:38.794 04:26:17 -- common/autotest_common.sh@10 -- # set +x 00:14:38.794 04:26:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:38.794 04:26:17 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:38.794 04:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.794 04:26:17 -- common/autotest_common.sh@10 -- # set +x 00:14:38.794 [2024-11-26 04:26:17.871286] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:38.794 04:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.794 04:26:17 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:38.794 04:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.794 04:26:17 -- common/autotest_common.sh@10 -- # set +x 00:14:38.794 04:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.794 04:26:17 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:38.794 04:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.794 04:26:17 -- common/autotest_common.sh@10 -- # set +x 00:14:38.794 [2024-11-26 04:26:17.887645] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:38.794 04:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.794 04:26:17 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:38.794 04:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.794 04:26:17 -- common/autotest_common.sh@10 -- # set +x 00:14:38.794 NULL1 00:14:38.794 04:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.794 04:26:17 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:38.794 04:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.794 04:26:17 -- common/autotest_common.sh@10 -- # set +x 00:14:38.794 Delay0 00:14:38.794 04:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.794 04:26:17 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:38.794 04:26:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.794 04:26:17 -- common/autotest_common.sh@10 -- # set +x 00:14:38.794 04:26:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.794 04:26:17 -- target/delete_subsystem.sh@28 -- # perf_pid=2881660 00:14:38.794 04:26:17 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:38.794 04:26:17 -- target/delete_subsystem.sh@30 -- # sleep 2 00:14:38.794 EAL: No free 2048 kB hugepages reported on node 1 00:14:38.794 [2024-11-26 04:26:17.962192] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:40.716 04:26:19 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:40.716 04:26:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.716 04:26:19 -- common/autotest_common.sh@10 -- # set +x 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 [2024-11-26 04:26:20.093182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2043f90 is same with the state(5) to be set 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 starting I/O failed: -6 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 [2024-11-26 04:26:20.093804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fc938000c00 is same with the state(5) to be set 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Read completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.975 Write completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:40.976 Write completed with error (sct=0, sc=8) 00:14:40.976 Read completed with error (sct=0, sc=8) 00:14:41.914 [2024-11-26 04:26:21.059290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20459c0 is same with the state(5) to be set 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 [2024-11-26 04:26:21.096418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2044240 is same with the state(5) to be set 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 [2024-11-26 04:26:21.096626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20439e0 is same with the state(5) to be set 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 [2024-11-26 04:26:21.096767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fc93800c1d0 is same with the state(5) to be set 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Write completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.914 Read completed with error (sct=0, sc=8) 00:14:41.915 Write completed with error (sct=0, sc=8) 00:14:41.915 Write completed with error (sct=0, sc=8) 00:14:41.915 Read completed with error (sct=0, sc=8) 00:14:41.915 Read completed with error (sct=0, sc=8) 00:14:41.915 Read completed with error (sct=0, sc=8) 00:14:41.915 Read completed with error (sct=0, sc=8) 00:14:41.915 Write completed with error (sct=0, sc=8) 00:14:41.915 Read completed with error (sct=0, sc=8) 00:14:41.915 Read completed with error (sct=0, sc=8) 00:14:41.915 Write completed with error (sct=0, sc=8) 00:14:41.915 Read completed with error (sct=0, sc=8) 00:14:41.915 [2024-11-26 04:26:21.097347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2043ce0 is same with the state(5) to be set 00:14:41.915 [2024-11-26 04:26:21.098360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20459c0 (9): Bad file descriptor 00:14:41.915 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:41.915 04:26:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.915 04:26:21 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:41.915 04:26:21 -- target/delete_subsystem.sh@35 -- # kill -0 2881660 00:14:41.915 04:26:21 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:41.915 Initializing NVMe Controllers 00:14:41.915 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:41.915 Controller IO queue size 128, less than required. 00:14:41.915 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:41.915 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:41.915 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:41.915 Initialization complete. Launching workers. 00:14:41.915 ======================================================== 00:14:41.915 Latency(us) 00:14:41.915 Device Information : IOPS MiB/s Average min max 00:14:41.915 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 183.62 0.09 954162.68 866.91 1012115.12 00:14:41.915 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 155.33 0.08 878734.08 362.86 1014054.99 00:14:41.915 ======================================================== 00:14:41.915 Total : 338.95 0.17 919595.84 362.86 1014054.99 00:14:41.915 00:14:42.567 04:26:21 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:42.567 04:26:21 -- target/delete_subsystem.sh@35 -- # kill -0 2881660 00:14:42.567 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2881660) - No such process 00:14:42.567 04:26:21 -- target/delete_subsystem.sh@45 -- # NOT wait 2881660 00:14:42.567 04:26:21 -- common/autotest_common.sh@650 -- # local es=0 00:14:42.567 04:26:21 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 2881660 00:14:42.567 04:26:21 -- common/autotest_common.sh@638 -- # local arg=wait 00:14:42.567 04:26:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:42.567 04:26:21 -- common/autotest_common.sh@642 -- # type -t wait 00:14:42.567 04:26:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:42.567 04:26:21 -- common/autotest_common.sh@653 -- # wait 2881660 00:14:42.567 04:26:21 -- common/autotest_common.sh@653 -- # es=1 00:14:42.567 04:26:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:42.567 04:26:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:42.567 04:26:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:42.567 04:26:21 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:42.567 04:26:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.567 04:26:21 -- common/autotest_common.sh@10 -- # set +x 00:14:42.567 04:26:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.567 04:26:21 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:42.567 04:26:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.567 04:26:21 -- common/autotest_common.sh@10 -- # set +x 00:14:42.567 [2024-11-26 04:26:21.620019] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:42.567 04:26:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.567 04:26:21 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:42.567 04:26:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.567 04:26:21 -- common/autotest_common.sh@10 -- # set +x 00:14:42.567 04:26:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.567 04:26:21 -- target/delete_subsystem.sh@54 -- # perf_pid=2882084 00:14:42.567 04:26:21 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:42.567 04:26:21 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:42.567 04:26:21 -- target/delete_subsystem.sh@57 -- # kill -0 2882084 00:14:42.567 04:26:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:42.567 EAL: No free 2048 kB hugepages reported on node 1 00:14:42.567 [2024-11-26 04:26:21.683983] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:43.133 04:26:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:43.133 04:26:22 -- target/delete_subsystem.sh@57 -- # kill -0 2882084 00:14:43.133 04:26:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:43.699 04:26:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:43.699 04:26:22 -- target/delete_subsystem.sh@57 -- # kill -0 2882084 00:14:43.699 04:26:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:43.957 04:26:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:43.957 04:26:23 -- target/delete_subsystem.sh@57 -- # kill -0 2882084 00:14:43.957 04:26:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:44.523 04:26:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:44.523 04:26:23 -- target/delete_subsystem.sh@57 -- # kill -0 2882084 00:14:44.523 04:26:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:45.088 04:26:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:45.088 04:26:24 -- target/delete_subsystem.sh@57 -- # kill -0 2882084 00:14:45.088 04:26:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:45.653 04:26:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:45.653 04:26:24 -- target/delete_subsystem.sh@57 -- # kill -0 2882084 00:14:45.653 04:26:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:45.911 Initializing NVMe Controllers 00:14:45.911 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:45.911 Controller IO queue size 128, less than required. 00:14:45.911 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:45.911 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:45.911 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:45.911 Initialization complete. Launching workers. 00:14:45.911 ======================================================== 00:14:45.911 Latency(us) 00:14:45.911 Device Information : IOPS MiB/s Average min max 00:14:45.911 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004430.49 1000220.59 1042474.24 00:14:45.911 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005067.31 1000170.41 1042376.69 00:14:45.911 ======================================================== 00:14:45.911 Total : 256.00 0.12 1004748.90 1000170.41 1042474.24 00:14:45.911 00:14:46.170 04:26:25 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:46.170 04:26:25 -- target/delete_subsystem.sh@57 -- # kill -0 2882084 00:14:46.170 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2882084) - No such process 00:14:46.170 04:26:25 -- target/delete_subsystem.sh@67 -- # wait 2882084 00:14:46.170 04:26:25 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:46.170 04:26:25 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:46.170 04:26:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:46.170 04:26:25 -- nvmf/common.sh@116 -- # sync 00:14:46.170 04:26:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:46.170 04:26:25 -- nvmf/common.sh@119 -- # set +e 00:14:46.170 04:26:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:46.170 04:26:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:46.170 rmmod nvme_tcp 00:14:46.170 rmmod nvme_fabrics 00:14:46.170 rmmod nvme_keyring 00:14:46.170 04:26:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:46.170 04:26:25 -- nvmf/common.sh@123 -- # set -e 00:14:46.170 04:26:25 -- nvmf/common.sh@124 -- # return 0 00:14:46.170 04:26:25 -- nvmf/common.sh@477 -- # '[' -n 2881635 ']' 00:14:46.170 04:26:25 -- nvmf/common.sh@478 -- # killprocess 2881635 00:14:46.170 04:26:25 -- common/autotest_common.sh@936 -- # '[' -z 2881635 ']' 00:14:46.171 04:26:25 -- common/autotest_common.sh@940 -- # kill -0 2881635 00:14:46.171 04:26:25 -- common/autotest_common.sh@941 -- # uname 00:14:46.171 04:26:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:46.171 04:26:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2881635 00:14:46.171 04:26:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:46.171 04:26:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:46.171 04:26:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2881635' 00:14:46.171 killing process with pid 2881635 00:14:46.171 04:26:25 -- common/autotest_common.sh@955 -- # kill 2881635 00:14:46.171 04:26:25 -- common/autotest_common.sh@960 -- # wait 2881635 00:14:46.431 04:26:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:46.431 04:26:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:46.431 04:26:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:46.431 04:26:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:46.431 04:26:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:46.431 04:26:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:46.431 04:26:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:46.431 04:26:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:48.339 04:26:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:48.339 00:14:48.339 real 0m12.438s 00:14:48.339 user 0m28.007s 00:14:48.339 sys 0m2.945s 00:14:48.339 04:26:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:48.339 04:26:27 -- common/autotest_common.sh@10 -- # set +x 00:14:48.339 ************************************ 00:14:48.339 END TEST nvmf_delete_subsystem 00:14:48.339 ************************************ 00:14:48.597 04:26:27 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:48.597 04:26:27 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:48.597 04:26:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:48.597 04:26:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:48.597 04:26:27 -- common/autotest_common.sh@10 -- # set +x 00:14:48.597 ************************************ 00:14:48.597 START TEST nvmf_nvme_cli 00:14:48.597 ************************************ 00:14:48.597 04:26:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:48.597 * Looking for test storage... 00:14:48.597 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:48.597 04:26:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:48.597 04:26:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:48.597 04:26:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:48.597 04:26:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:48.597 04:26:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:48.597 04:26:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:48.597 04:26:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:48.597 04:26:27 -- scripts/common.sh@335 -- # IFS=.-: 00:14:48.597 04:26:27 -- scripts/common.sh@335 -- # read -ra ver1 00:14:48.597 04:26:27 -- scripts/common.sh@336 -- # IFS=.-: 00:14:48.597 04:26:27 -- scripts/common.sh@336 -- # read -ra ver2 00:14:48.597 04:26:27 -- scripts/common.sh@337 -- # local 'op=<' 00:14:48.597 04:26:27 -- scripts/common.sh@339 -- # ver1_l=2 00:14:48.597 04:26:27 -- scripts/common.sh@340 -- # ver2_l=1 00:14:48.597 04:26:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:48.597 04:26:27 -- scripts/common.sh@343 -- # case "$op" in 00:14:48.597 04:26:27 -- scripts/common.sh@344 -- # : 1 00:14:48.597 04:26:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:48.597 04:26:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:48.597 04:26:27 -- scripts/common.sh@364 -- # decimal 1 00:14:48.597 04:26:27 -- scripts/common.sh@352 -- # local d=1 00:14:48.597 04:26:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:48.597 04:26:27 -- scripts/common.sh@354 -- # echo 1 00:14:48.597 04:26:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:48.597 04:26:27 -- scripts/common.sh@365 -- # decimal 2 00:14:48.597 04:26:27 -- scripts/common.sh@352 -- # local d=2 00:14:48.597 04:26:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:48.597 04:26:27 -- scripts/common.sh@354 -- # echo 2 00:14:48.597 04:26:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:48.597 04:26:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:48.597 04:26:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:48.597 04:26:27 -- scripts/common.sh@367 -- # return 0 00:14:48.597 04:26:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:48.597 04:26:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:48.598 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:48.598 --rc genhtml_branch_coverage=1 00:14:48.598 --rc genhtml_function_coverage=1 00:14:48.598 --rc genhtml_legend=1 00:14:48.598 --rc geninfo_all_blocks=1 00:14:48.598 --rc geninfo_unexecuted_blocks=1 00:14:48.598 00:14:48.598 ' 00:14:48.598 04:26:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:48.598 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:48.598 --rc genhtml_branch_coverage=1 00:14:48.598 --rc genhtml_function_coverage=1 00:14:48.598 --rc genhtml_legend=1 00:14:48.598 --rc geninfo_all_blocks=1 00:14:48.598 --rc geninfo_unexecuted_blocks=1 00:14:48.598 00:14:48.598 ' 00:14:48.598 04:26:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:48.598 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:48.598 --rc genhtml_branch_coverage=1 00:14:48.598 --rc genhtml_function_coverage=1 00:14:48.598 --rc genhtml_legend=1 00:14:48.598 --rc geninfo_all_blocks=1 00:14:48.598 --rc geninfo_unexecuted_blocks=1 00:14:48.598 00:14:48.598 ' 00:14:48.598 04:26:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:48.598 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:48.598 --rc genhtml_branch_coverage=1 00:14:48.598 --rc genhtml_function_coverage=1 00:14:48.598 --rc genhtml_legend=1 00:14:48.598 --rc geninfo_all_blocks=1 00:14:48.598 --rc geninfo_unexecuted_blocks=1 00:14:48.598 00:14:48.598 ' 00:14:48.598 04:26:27 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:48.598 04:26:27 -- nvmf/common.sh@7 -- # uname -s 00:14:48.598 04:26:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:48.598 04:26:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:48.598 04:26:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:48.598 04:26:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:48.598 04:26:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:48.598 04:26:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:48.598 04:26:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:48.598 04:26:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:48.598 04:26:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:48.598 04:26:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:48.598 04:26:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:48.598 04:26:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:48.598 04:26:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:48.598 04:26:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:48.598 04:26:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:48.598 04:26:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:48.598 04:26:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:48.598 04:26:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:48.598 04:26:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:48.598 04:26:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:48.598 04:26:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:48.598 04:26:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:48.598 04:26:27 -- paths/export.sh@5 -- # export PATH 00:14:48.598 04:26:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:48.598 04:26:27 -- nvmf/common.sh@46 -- # : 0 00:14:48.598 04:26:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:48.598 04:26:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:48.598 04:26:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:48.598 04:26:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:48.598 04:26:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:48.598 04:26:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:48.598 04:26:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:48.598 04:26:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:48.598 04:26:27 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:48.598 04:26:27 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:48.598 04:26:27 -- target/nvme_cli.sh@14 -- # devs=() 00:14:48.598 04:26:27 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:48.598 04:26:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:48.598 04:26:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:48.598 04:26:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:48.598 04:26:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:48.598 04:26:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:48.598 04:26:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:48.598 04:26:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:48.598 04:26:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:48.598 04:26:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:48.598 04:26:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:48.598 04:26:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:48.598 04:26:27 -- common/autotest_common.sh@10 -- # set +x 00:14:50.504 04:26:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:50.504 04:26:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:50.504 04:26:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:50.504 04:26:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:50.504 04:26:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:50.504 04:26:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:50.504 04:26:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:50.504 04:26:29 -- nvmf/common.sh@294 -- # net_devs=() 00:14:50.504 04:26:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:50.504 04:26:29 -- nvmf/common.sh@295 -- # e810=() 00:14:50.504 04:26:29 -- nvmf/common.sh@295 -- # local -ga e810 00:14:50.504 04:26:29 -- nvmf/common.sh@296 -- # x722=() 00:14:50.504 04:26:29 -- nvmf/common.sh@296 -- # local -ga x722 00:14:50.504 04:26:29 -- nvmf/common.sh@297 -- # mlx=() 00:14:50.504 04:26:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:50.504 04:26:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:50.504 04:26:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:50.504 04:26:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:50.504 04:26:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:50.504 04:26:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:50.504 04:26:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:50.504 04:26:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:50.504 04:26:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:50.504 04:26:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:50.504 04:26:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:50.504 04:26:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:50.504 04:26:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:50.504 04:26:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:50.504 04:26:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:50.504 04:26:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:50.504 04:26:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:50.504 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:50.504 04:26:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:50.504 04:26:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:50.504 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:50.504 04:26:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:50.504 04:26:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:50.504 04:26:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:50.504 04:26:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:50.504 04:26:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:50.504 04:26:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:50.504 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:50.504 04:26:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:50.504 04:26:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:50.504 04:26:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:50.504 04:26:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:50.504 04:26:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:50.504 04:26:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:50.504 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:50.504 04:26:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:50.504 04:26:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:50.504 04:26:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:50.504 04:26:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:50.504 04:26:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:50.504 04:26:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:50.504 04:26:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:50.504 04:26:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:50.504 04:26:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:50.504 04:26:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:50.504 04:26:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:50.504 04:26:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:50.504 04:26:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:50.504 04:26:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:50.504 04:26:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:50.764 04:26:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:50.764 04:26:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:50.764 04:26:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:50.764 04:26:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:50.764 04:26:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:50.764 04:26:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:50.764 04:26:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:50.764 04:26:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:50.764 04:26:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:50.764 04:26:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:50.764 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:50.764 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.284 ms 00:14:50.764 00:14:50.764 --- 10.0.0.2 ping statistics --- 00:14:50.764 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:50.764 rtt min/avg/max/mdev = 0.284/0.284/0.284/0.000 ms 00:14:50.764 04:26:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:50.764 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:50.764 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.049 ms 00:14:50.764 00:14:50.764 --- 10.0.0.1 ping statistics --- 00:14:50.764 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:50.764 rtt min/avg/max/mdev = 0.049/0.049/0.049/0.000 ms 00:14:50.764 04:26:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:50.764 04:26:29 -- nvmf/common.sh@410 -- # return 0 00:14:50.764 04:26:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:50.764 04:26:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:50.764 04:26:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:50.764 04:26:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:50.764 04:26:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:50.764 04:26:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:50.764 04:26:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:50.764 04:26:29 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:50.764 04:26:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:50.764 04:26:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:50.764 04:26:29 -- common/autotest_common.sh@10 -- # set +x 00:14:50.764 04:26:29 -- nvmf/common.sh@469 -- # nvmfpid=2884559 00:14:50.764 04:26:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:50.764 04:26:29 -- nvmf/common.sh@470 -- # waitforlisten 2884559 00:14:50.764 04:26:29 -- common/autotest_common.sh@829 -- # '[' -z 2884559 ']' 00:14:50.764 04:26:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:50.764 04:26:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:50.764 04:26:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:50.764 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:50.764 04:26:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:50.764 04:26:29 -- common/autotest_common.sh@10 -- # set +x 00:14:50.764 [2024-11-26 04:26:29.926805] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:50.764 [2024-11-26 04:26:29.926893] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:50.764 EAL: No free 2048 kB hugepages reported on node 1 00:14:51.025 [2024-11-26 04:26:29.993542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:51.025 [2024-11-26 04:26:30.089832] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:51.025 [2024-11-26 04:26:30.090006] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:51.025 [2024-11-26 04:26:30.090028] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:51.025 [2024-11-26 04:26:30.090042] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:51.025 [2024-11-26 04:26:30.090108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:51.025 [2024-11-26 04:26:30.090177] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:51.025 [2024-11-26 04:26:30.090227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:51.025 [2024-11-26 04:26:30.090229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:51.963 04:26:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:51.963 04:26:30 -- common/autotest_common.sh@862 -- # return 0 00:14:51.963 04:26:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:51.963 04:26:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:51.963 04:26:30 -- common/autotest_common.sh@10 -- # set +x 00:14:51.963 04:26:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:51.963 04:26:30 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:51.963 04:26:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.963 04:26:30 -- common/autotest_common.sh@10 -- # set +x 00:14:51.963 [2024-11-26 04:26:30.961514] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:51.963 04:26:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.963 04:26:30 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:51.963 04:26:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.963 04:26:30 -- common/autotest_common.sh@10 -- # set +x 00:14:51.963 Malloc0 00:14:51.963 04:26:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.963 04:26:30 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:51.963 04:26:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.963 04:26:30 -- common/autotest_common.sh@10 -- # set +x 00:14:51.963 Malloc1 00:14:51.963 04:26:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.963 04:26:31 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:51.963 04:26:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.963 04:26:31 -- common/autotest_common.sh@10 -- # set +x 00:14:51.963 04:26:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.963 04:26:31 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:51.963 04:26:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.963 04:26:31 -- common/autotest_common.sh@10 -- # set +x 00:14:51.963 04:26:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.963 04:26:31 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:51.963 04:26:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.963 04:26:31 -- common/autotest_common.sh@10 -- # set +x 00:14:51.963 04:26:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.963 04:26:31 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:51.963 04:26:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.963 04:26:31 -- common/autotest_common.sh@10 -- # set +x 00:14:51.963 [2024-11-26 04:26:31.044781] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:51.963 04:26:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.963 04:26:31 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:51.963 04:26:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.963 04:26:31 -- common/autotest_common.sh@10 -- # set +x 00:14:51.963 04:26:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.963 04:26:31 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:52.223 00:14:52.223 Discovery Log Number of Records 2, Generation counter 2 00:14:52.223 =====Discovery Log Entry 0====== 00:14:52.223 trtype: tcp 00:14:52.223 adrfam: ipv4 00:14:52.223 subtype: current discovery subsystem 00:14:52.223 treq: not required 00:14:52.223 portid: 0 00:14:52.223 trsvcid: 4420 00:14:52.223 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:52.223 traddr: 10.0.0.2 00:14:52.223 eflags: explicit discovery connections, duplicate discovery information 00:14:52.223 sectype: none 00:14:52.223 =====Discovery Log Entry 1====== 00:14:52.223 trtype: tcp 00:14:52.223 adrfam: ipv4 00:14:52.223 subtype: nvme subsystem 00:14:52.223 treq: not required 00:14:52.223 portid: 0 00:14:52.223 trsvcid: 4420 00:14:52.223 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:52.223 traddr: 10.0.0.2 00:14:52.223 eflags: none 00:14:52.223 sectype: none 00:14:52.223 04:26:31 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:52.223 04:26:31 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:52.223 04:26:31 -- nvmf/common.sh@510 -- # local dev _ 00:14:52.223 04:26:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:52.223 04:26:31 -- nvmf/common.sh@509 -- # nvme list 00:14:52.223 04:26:31 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:52.223 04:26:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:52.223 04:26:31 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:52.223 04:26:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:52.223 04:26:31 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:52.223 04:26:31 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:52.790 04:26:31 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:52.790 04:26:31 -- common/autotest_common.sh@1187 -- # local i=0 00:14:52.790 04:26:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:52.790 04:26:31 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:52.790 04:26:31 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:52.790 04:26:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:54.700 04:26:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:54.700 04:26:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:54.700 04:26:33 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:54.700 04:26:33 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:54.700 04:26:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:54.700 04:26:33 -- common/autotest_common.sh@1197 -- # return 0 00:14:54.700 04:26:33 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:54.700 04:26:33 -- nvmf/common.sh@510 -- # local dev _ 00:14:54.700 04:26:33 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:54.700 04:26:33 -- nvmf/common.sh@509 -- # nvme list 00:14:54.959 04:26:34 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:54.959 04:26:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:54.959 04:26:34 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:54.959 04:26:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:54.959 04:26:34 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:54.959 04:26:34 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:54.959 04:26:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:54.959 04:26:34 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:54.959 04:26:34 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:54.959 04:26:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:54.959 04:26:34 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:54.959 /dev/nvme0n2 ]] 00:14:54.959 04:26:34 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:54.959 04:26:34 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:54.959 04:26:34 -- nvmf/common.sh@510 -- # local dev _ 00:14:54.959 04:26:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:54.959 04:26:34 -- nvmf/common.sh@509 -- # nvme list 00:14:54.959 04:26:34 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:54.959 04:26:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:54.959 04:26:34 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:54.959 04:26:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:54.959 04:26:34 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:54.959 04:26:34 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:54.959 04:26:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:54.959 04:26:34 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:54.959 04:26:34 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:54.959 04:26:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:54.959 04:26:34 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:54.959 04:26:34 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:55.219 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:55.219 04:26:34 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:55.219 04:26:34 -- common/autotest_common.sh@1208 -- # local i=0 00:14:55.219 04:26:34 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:55.219 04:26:34 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:55.219 04:26:34 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:55.219 04:26:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:55.219 04:26:34 -- common/autotest_common.sh@1220 -- # return 0 00:14:55.219 04:26:34 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:55.219 04:26:34 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:55.219 04:26:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.219 04:26:34 -- common/autotest_common.sh@10 -- # set +x 00:14:55.479 04:26:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.479 04:26:34 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:55.479 04:26:34 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:55.479 04:26:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:55.479 04:26:34 -- nvmf/common.sh@116 -- # sync 00:14:55.479 04:26:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:55.479 04:26:34 -- nvmf/common.sh@119 -- # set +e 00:14:55.479 04:26:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:55.479 04:26:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:55.479 rmmod nvme_tcp 00:14:55.479 rmmod nvme_fabrics 00:14:55.479 rmmod nvme_keyring 00:14:55.479 04:26:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:55.479 04:26:34 -- nvmf/common.sh@123 -- # set -e 00:14:55.479 04:26:34 -- nvmf/common.sh@124 -- # return 0 00:14:55.479 04:26:34 -- nvmf/common.sh@477 -- # '[' -n 2884559 ']' 00:14:55.479 04:26:34 -- nvmf/common.sh@478 -- # killprocess 2884559 00:14:55.479 04:26:34 -- common/autotest_common.sh@936 -- # '[' -z 2884559 ']' 00:14:55.479 04:26:34 -- common/autotest_common.sh@940 -- # kill -0 2884559 00:14:55.479 04:26:34 -- common/autotest_common.sh@941 -- # uname 00:14:55.479 04:26:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:55.479 04:26:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2884559 00:14:55.479 04:26:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:55.479 04:26:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:55.479 04:26:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2884559' 00:14:55.479 killing process with pid 2884559 00:14:55.479 04:26:34 -- common/autotest_common.sh@955 -- # kill 2884559 00:14:55.479 04:26:34 -- common/autotest_common.sh@960 -- # wait 2884559 00:14:55.739 04:26:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:55.739 04:26:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:55.739 04:26:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:55.740 04:26:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:55.740 04:26:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:55.740 04:26:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:55.740 04:26:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:55.740 04:26:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:57.646 04:26:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:57.646 00:14:57.646 real 0m9.270s 00:14:57.646 user 0m19.592s 00:14:57.646 sys 0m2.230s 00:14:57.646 04:26:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:57.646 04:26:36 -- common/autotest_common.sh@10 -- # set +x 00:14:57.646 ************************************ 00:14:57.646 END TEST nvmf_nvme_cli 00:14:57.646 ************************************ 00:14:57.646 04:26:36 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:14:57.646 04:26:36 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:14:57.646 04:26:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:57.646 04:26:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:57.646 04:26:36 -- common/autotest_common.sh@10 -- # set +x 00:14:57.646 ************************************ 00:14:57.646 START TEST nvmf_vfio_user 00:14:57.646 ************************************ 00:14:57.646 04:26:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:14:57.905 * Looking for test storage... 00:14:57.905 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:57.905 04:26:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:57.905 04:26:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:57.905 04:26:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:57.905 04:26:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:57.905 04:26:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:57.905 04:26:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:57.905 04:26:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:57.905 04:26:36 -- scripts/common.sh@335 -- # IFS=.-: 00:14:57.905 04:26:36 -- scripts/common.sh@335 -- # read -ra ver1 00:14:57.905 04:26:36 -- scripts/common.sh@336 -- # IFS=.-: 00:14:57.905 04:26:36 -- scripts/common.sh@336 -- # read -ra ver2 00:14:57.905 04:26:36 -- scripts/common.sh@337 -- # local 'op=<' 00:14:57.905 04:26:36 -- scripts/common.sh@339 -- # ver1_l=2 00:14:57.905 04:26:36 -- scripts/common.sh@340 -- # ver2_l=1 00:14:57.905 04:26:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:57.905 04:26:36 -- scripts/common.sh@343 -- # case "$op" in 00:14:57.905 04:26:36 -- scripts/common.sh@344 -- # : 1 00:14:57.905 04:26:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:57.905 04:26:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:57.905 04:26:36 -- scripts/common.sh@364 -- # decimal 1 00:14:57.905 04:26:36 -- scripts/common.sh@352 -- # local d=1 00:14:57.905 04:26:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:57.905 04:26:36 -- scripts/common.sh@354 -- # echo 1 00:14:57.905 04:26:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:57.905 04:26:37 -- scripts/common.sh@365 -- # decimal 2 00:14:57.905 04:26:37 -- scripts/common.sh@352 -- # local d=2 00:14:57.905 04:26:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:57.905 04:26:37 -- scripts/common.sh@354 -- # echo 2 00:14:57.905 04:26:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:57.905 04:26:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:57.905 04:26:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:57.905 04:26:37 -- scripts/common.sh@367 -- # return 0 00:14:57.905 04:26:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:57.905 04:26:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:57.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.905 --rc genhtml_branch_coverage=1 00:14:57.905 --rc genhtml_function_coverage=1 00:14:57.905 --rc genhtml_legend=1 00:14:57.905 --rc geninfo_all_blocks=1 00:14:57.905 --rc geninfo_unexecuted_blocks=1 00:14:57.905 00:14:57.905 ' 00:14:57.905 04:26:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:57.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.905 --rc genhtml_branch_coverage=1 00:14:57.905 --rc genhtml_function_coverage=1 00:14:57.905 --rc genhtml_legend=1 00:14:57.905 --rc geninfo_all_blocks=1 00:14:57.905 --rc geninfo_unexecuted_blocks=1 00:14:57.905 00:14:57.905 ' 00:14:57.905 04:26:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:57.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.905 --rc genhtml_branch_coverage=1 00:14:57.905 --rc genhtml_function_coverage=1 00:14:57.906 --rc genhtml_legend=1 00:14:57.906 --rc geninfo_all_blocks=1 00:14:57.906 --rc geninfo_unexecuted_blocks=1 00:14:57.906 00:14:57.906 ' 00:14:57.906 04:26:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:57.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.906 --rc genhtml_branch_coverage=1 00:14:57.906 --rc genhtml_function_coverage=1 00:14:57.906 --rc genhtml_legend=1 00:14:57.906 --rc geninfo_all_blocks=1 00:14:57.906 --rc geninfo_unexecuted_blocks=1 00:14:57.906 00:14:57.906 ' 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:57.906 04:26:37 -- nvmf/common.sh@7 -- # uname -s 00:14:57.906 04:26:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:57.906 04:26:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:57.906 04:26:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:57.906 04:26:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:57.906 04:26:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:57.906 04:26:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:57.906 04:26:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:57.906 04:26:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:57.906 04:26:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:57.906 04:26:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:57.906 04:26:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:57.906 04:26:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:57.906 04:26:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:57.906 04:26:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:57.906 04:26:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:57.906 04:26:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:57.906 04:26:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:57.906 04:26:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:57.906 04:26:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:57.906 04:26:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.906 04:26:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.906 04:26:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.906 04:26:37 -- paths/export.sh@5 -- # export PATH 00:14:57.906 04:26:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.906 04:26:37 -- nvmf/common.sh@46 -- # : 0 00:14:57.906 04:26:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:57.906 04:26:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:57.906 04:26:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:57.906 04:26:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:57.906 04:26:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:57.906 04:26:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:57.906 04:26:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:57.906 04:26:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2885529 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2885529' 00:14:57.906 Process pid: 2885529 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:14:57.906 04:26:37 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2885529 00:14:57.906 04:26:37 -- common/autotest_common.sh@829 -- # '[' -z 2885529 ']' 00:14:57.906 04:26:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:57.906 04:26:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:57.906 04:26:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:57.906 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:57.906 04:26:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:57.906 04:26:37 -- common/autotest_common.sh@10 -- # set +x 00:14:57.906 [2024-11-26 04:26:37.067837] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:57.906 [2024-11-26 04:26:37.067954] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:57.906 EAL: No free 2048 kB hugepages reported on node 1 00:14:58.165 [2024-11-26 04:26:37.129416] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:58.165 [2024-11-26 04:26:37.213666] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:58.165 [2024-11-26 04:26:37.213849] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:58.165 [2024-11-26 04:26:37.213868] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:58.165 [2024-11-26 04:26:37.213880] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:58.165 [2024-11-26 04:26:37.213933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:58.165 [2024-11-26 04:26:37.213996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:58.165 [2024-11-26 04:26:37.214062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:58.165 [2024-11-26 04:26:37.214065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:59.099 04:26:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:59.099 04:26:38 -- common/autotest_common.sh@862 -- # return 0 00:14:59.099 04:26:38 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:00.034 04:26:39 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:00.291 04:26:39 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:00.291 04:26:39 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:00.291 04:26:39 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:00.291 04:26:39 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:00.291 04:26:39 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:00.548 Malloc1 00:15:00.548 04:26:39 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:00.806 04:26:39 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:01.064 04:26:40 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:01.323 04:26:40 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:01.323 04:26:40 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:01.323 04:26:40 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:01.581 Malloc2 00:15:01.581 04:26:40 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:01.839 04:26:40 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:02.097 04:26:41 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:02.357 04:26:41 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:02.357 04:26:41 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:02.357 04:26:41 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:02.357 04:26:41 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:02.357 04:26:41 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:02.357 04:26:41 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:02.357 [2024-11-26 04:26:41.404043] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:02.357 [2024-11-26 04:26:41.404084] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2886092 ] 00:15:02.357 EAL: No free 2048 kB hugepages reported on node 1 00:15:02.357 [2024-11-26 04:26:41.435139] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:02.357 [2024-11-26 04:26:41.440567] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:02.357 [2024-11-26 04:26:41.440594] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f61ea1e2000 00:15:02.357 [2024-11-26 04:26:41.441560] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:02.357 [2024-11-26 04:26:41.442550] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:02.357 [2024-11-26 04:26:41.443556] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:02.357 [2024-11-26 04:26:41.444566] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:02.357 [2024-11-26 04:26:41.445572] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:02.357 [2024-11-26 04:26:41.446578] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:02.357 [2024-11-26 04:26:41.447584] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:02.357 [2024-11-26 04:26:41.448591] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:02.357 [2024-11-26 04:26:41.449598] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:02.357 [2024-11-26 04:26:41.449618] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f61e8edc000 00:15:02.357 [2024-11-26 04:26:41.450765] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:02.357 [2024-11-26 04:26:41.466327] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:02.357 [2024-11-26 04:26:41.466360] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:02.357 [2024-11-26 04:26:41.470769] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:02.357 [2024-11-26 04:26:41.470826] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:02.357 [2024-11-26 04:26:41.470913] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:02.357 [2024-11-26 04:26:41.470945] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:02.357 [2024-11-26 04:26:41.470956] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:02.357 [2024-11-26 04:26:41.471757] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:02.357 [2024-11-26 04:26:41.471788] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:02.357 [2024-11-26 04:26:41.471809] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:02.357 [2024-11-26 04:26:41.472766] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:02.357 [2024-11-26 04:26:41.472787] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:02.357 [2024-11-26 04:26:41.472801] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:02.357 [2024-11-26 04:26:41.473766] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:02.357 [2024-11-26 04:26:41.473785] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:02.357 [2024-11-26 04:26:41.474777] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:02.357 [2024-11-26 04:26:41.474796] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:02.357 [2024-11-26 04:26:41.474805] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:02.358 [2024-11-26 04:26:41.474816] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:02.358 [2024-11-26 04:26:41.474925] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:02.358 [2024-11-26 04:26:41.474933] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:02.358 [2024-11-26 04:26:41.474941] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:02.358 [2024-11-26 04:26:41.475785] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:02.358 [2024-11-26 04:26:41.476790] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:02.358 [2024-11-26 04:26:41.477797] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:02.358 [2024-11-26 04:26:41.478845] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:02.358 [2024-11-26 04:26:41.479810] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:02.358 [2024-11-26 04:26:41.479829] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:02.358 [2024-11-26 04:26:41.479838] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.479861] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:02.358 [2024-11-26 04:26:41.479880] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.479902] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:02.358 [2024-11-26 04:26:41.479912] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:02.358 [2024-11-26 04:26:41.479930] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:02.358 [2024-11-26 04:26:41.480008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:02.358 [2024-11-26 04:26:41.480024] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:02.358 [2024-11-26 04:26:41.480032] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:02.358 [2024-11-26 04:26:41.480039] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:02.358 [2024-11-26 04:26:41.480046] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:02.358 [2024-11-26 04:26:41.480054] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:02.358 [2024-11-26 04:26:41.480060] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:02.358 [2024-11-26 04:26:41.480068] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480083] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480099] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:02.358 [2024-11-26 04:26:41.480115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:02.358 [2024-11-26 04:26:41.480135] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:02.358 [2024-11-26 04:26:41.480149] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:02.358 [2024-11-26 04:26:41.480160] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:02.358 [2024-11-26 04:26:41.480171] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:02.358 [2024-11-26 04:26:41.480179] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480193] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480207] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:02.358 [2024-11-26 04:26:41.480218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:02.358 [2024-11-26 04:26:41.480228] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:02.358 [2024-11-26 04:26:41.480235] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480245] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480260] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480273] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:02.358 [2024-11-26 04:26:41.480288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:02.358 [2024-11-26 04:26:41.480348] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480362] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480374] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:02.358 [2024-11-26 04:26:41.480382] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:02.358 [2024-11-26 04:26:41.480391] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:02.358 [2024-11-26 04:26:41.480402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:02.358 [2024-11-26 04:26:41.480420] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:02.358 [2024-11-26 04:26:41.480435] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480448] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480459] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:02.358 [2024-11-26 04:26:41.480467] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:02.358 [2024-11-26 04:26:41.480476] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:02.358 [2024-11-26 04:26:41.480498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:02.358 [2024-11-26 04:26:41.480518] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480531] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480542] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:02.358 [2024-11-26 04:26:41.480550] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:02.358 [2024-11-26 04:26:41.480559] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:02.358 [2024-11-26 04:26:41.480574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:02.358 [2024-11-26 04:26:41.480587] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480598] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480611] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480620] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480628] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480636] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:02.358 [2024-11-26 04:26:41.480646] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:02.358 [2024-11-26 04:26:41.480654] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:02.358 [2024-11-26 04:26:41.480703] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:02.358 [2024-11-26 04:26:41.480725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:02.358 [2024-11-26 04:26:41.480745] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:02.358 [2024-11-26 04:26:41.480757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:02.358 [2024-11-26 04:26:41.480773] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:02.358 [2024-11-26 04:26:41.480788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:02.358 [2024-11-26 04:26:41.480804] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:02.358 [2024-11-26 04:26:41.480816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:02.358 [2024-11-26 04:26:41.480834] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:02.358 [2024-11-26 04:26:41.480843] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:02.358 [2024-11-26 04:26:41.480849] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:02.358 [2024-11-26 04:26:41.480855] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:02.359 [2024-11-26 04:26:41.480865] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:02.359 [2024-11-26 04:26:41.480876] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:02.359 [2024-11-26 04:26:41.480884] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:02.359 [2024-11-26 04:26:41.480894] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:02.359 [2024-11-26 04:26:41.480905] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:02.359 [2024-11-26 04:26:41.480913] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:02.359 [2024-11-26 04:26:41.480921] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:02.359 [2024-11-26 04:26:41.480934] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:02.359 [2024-11-26 04:26:41.480942] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:02.359 [2024-11-26 04:26:41.480951] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:02.359 [2024-11-26 04:26:41.480962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:02.359 [2024-11-26 04:26:41.480998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:02.359 [2024-11-26 04:26:41.481015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:02.359 [2024-11-26 04:26:41.481029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:02.359 ===================================================== 00:15:02.359 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:02.359 ===================================================== 00:15:02.359 Controller Capabilities/Features 00:15:02.359 ================================ 00:15:02.359 Vendor ID: 4e58 00:15:02.359 Subsystem Vendor ID: 4e58 00:15:02.359 Serial Number: SPDK1 00:15:02.359 Model Number: SPDK bdev Controller 00:15:02.359 Firmware Version: 24.01.1 00:15:02.359 Recommended Arb Burst: 6 00:15:02.359 IEEE OUI Identifier: 8d 6b 50 00:15:02.359 Multi-path I/O 00:15:02.359 May have multiple subsystem ports: Yes 00:15:02.359 May have multiple controllers: Yes 00:15:02.359 Associated with SR-IOV VF: No 00:15:02.359 Max Data Transfer Size: 131072 00:15:02.359 Max Number of Namespaces: 32 00:15:02.359 Max Number of I/O Queues: 127 00:15:02.359 NVMe Specification Version (VS): 1.3 00:15:02.359 NVMe Specification Version (Identify): 1.3 00:15:02.359 Maximum Queue Entries: 256 00:15:02.359 Contiguous Queues Required: Yes 00:15:02.359 Arbitration Mechanisms Supported 00:15:02.359 Weighted Round Robin: Not Supported 00:15:02.359 Vendor Specific: Not Supported 00:15:02.359 Reset Timeout: 15000 ms 00:15:02.359 Doorbell Stride: 4 bytes 00:15:02.359 NVM Subsystem Reset: Not Supported 00:15:02.359 Command Sets Supported 00:15:02.359 NVM Command Set: Supported 00:15:02.359 Boot Partition: Not Supported 00:15:02.359 Memory Page Size Minimum: 4096 bytes 00:15:02.359 Memory Page Size Maximum: 4096 bytes 00:15:02.359 Persistent Memory Region: Not Supported 00:15:02.359 Optional Asynchronous Events Supported 00:15:02.359 Namespace Attribute Notices: Supported 00:15:02.359 Firmware Activation Notices: Not Supported 00:15:02.359 ANA Change Notices: Not Supported 00:15:02.359 PLE Aggregate Log Change Notices: Not Supported 00:15:02.359 LBA Status Info Alert Notices: Not Supported 00:15:02.359 EGE Aggregate Log Change Notices: Not Supported 00:15:02.359 Normal NVM Subsystem Shutdown event: Not Supported 00:15:02.359 Zone Descriptor Change Notices: Not Supported 00:15:02.359 Discovery Log Change Notices: Not Supported 00:15:02.359 Controller Attributes 00:15:02.359 128-bit Host Identifier: Supported 00:15:02.359 Non-Operational Permissive Mode: Not Supported 00:15:02.359 NVM Sets: Not Supported 00:15:02.359 Read Recovery Levels: Not Supported 00:15:02.359 Endurance Groups: Not Supported 00:15:02.359 Predictable Latency Mode: Not Supported 00:15:02.359 Traffic Based Keep ALive: Not Supported 00:15:02.359 Namespace Granularity: Not Supported 00:15:02.359 SQ Associations: Not Supported 00:15:02.359 UUID List: Not Supported 00:15:02.359 Multi-Domain Subsystem: Not Supported 00:15:02.359 Fixed Capacity Management: Not Supported 00:15:02.359 Variable Capacity Management: Not Supported 00:15:02.359 Delete Endurance Group: Not Supported 00:15:02.359 Delete NVM Set: Not Supported 00:15:02.359 Extended LBA Formats Supported: Not Supported 00:15:02.359 Flexible Data Placement Supported: Not Supported 00:15:02.359 00:15:02.359 Controller Memory Buffer Support 00:15:02.359 ================================ 00:15:02.359 Supported: No 00:15:02.359 00:15:02.359 Persistent Memory Region Support 00:15:02.359 ================================ 00:15:02.359 Supported: No 00:15:02.359 00:15:02.359 Admin Command Set Attributes 00:15:02.359 ============================ 00:15:02.359 Security Send/Receive: Not Supported 00:15:02.359 Format NVM: Not Supported 00:15:02.359 Firmware Activate/Download: Not Supported 00:15:02.359 Namespace Management: Not Supported 00:15:02.359 Device Self-Test: Not Supported 00:15:02.359 Directives: Not Supported 00:15:02.359 NVMe-MI: Not Supported 00:15:02.359 Virtualization Management: Not Supported 00:15:02.359 Doorbell Buffer Config: Not Supported 00:15:02.359 Get LBA Status Capability: Not Supported 00:15:02.359 Command & Feature Lockdown Capability: Not Supported 00:15:02.359 Abort Command Limit: 4 00:15:02.359 Async Event Request Limit: 4 00:15:02.359 Number of Firmware Slots: N/A 00:15:02.359 Firmware Slot 1 Read-Only: N/A 00:15:02.359 Firmware Activation Without Reset: N/A 00:15:02.359 Multiple Update Detection Support: N/A 00:15:02.359 Firmware Update Granularity: No Information Provided 00:15:02.359 Per-Namespace SMART Log: No 00:15:02.359 Asymmetric Namespace Access Log Page: Not Supported 00:15:02.359 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:02.359 Command Effects Log Page: Supported 00:15:02.359 Get Log Page Extended Data: Supported 00:15:02.359 Telemetry Log Pages: Not Supported 00:15:02.359 Persistent Event Log Pages: Not Supported 00:15:02.359 Supported Log Pages Log Page: May Support 00:15:02.359 Commands Supported & Effects Log Page: Not Supported 00:15:02.359 Feature Identifiers & Effects Log Page:May Support 00:15:02.359 NVMe-MI Commands & Effects Log Page: May Support 00:15:02.359 Data Area 4 for Telemetry Log: Not Supported 00:15:02.359 Error Log Page Entries Supported: 128 00:15:02.359 Keep Alive: Supported 00:15:02.359 Keep Alive Granularity: 10000 ms 00:15:02.359 00:15:02.359 NVM Command Set Attributes 00:15:02.359 ========================== 00:15:02.359 Submission Queue Entry Size 00:15:02.359 Max: 64 00:15:02.359 Min: 64 00:15:02.359 Completion Queue Entry Size 00:15:02.359 Max: 16 00:15:02.359 Min: 16 00:15:02.359 Number of Namespaces: 32 00:15:02.359 Compare Command: Supported 00:15:02.359 Write Uncorrectable Command: Not Supported 00:15:02.359 Dataset Management Command: Supported 00:15:02.359 Write Zeroes Command: Supported 00:15:02.359 Set Features Save Field: Not Supported 00:15:02.359 Reservations: Not Supported 00:15:02.359 Timestamp: Not Supported 00:15:02.359 Copy: Supported 00:15:02.359 Volatile Write Cache: Present 00:15:02.359 Atomic Write Unit (Normal): 1 00:15:02.359 Atomic Write Unit (PFail): 1 00:15:02.359 Atomic Compare & Write Unit: 1 00:15:02.359 Fused Compare & Write: Supported 00:15:02.359 Scatter-Gather List 00:15:02.359 SGL Command Set: Supported (Dword aligned) 00:15:02.359 SGL Keyed: Not Supported 00:15:02.359 SGL Bit Bucket Descriptor: Not Supported 00:15:02.359 SGL Metadata Pointer: Not Supported 00:15:02.359 Oversized SGL: Not Supported 00:15:02.359 SGL Metadata Address: Not Supported 00:15:02.359 SGL Offset: Not Supported 00:15:02.359 Transport SGL Data Block: Not Supported 00:15:02.359 Replay Protected Memory Block: Not Supported 00:15:02.359 00:15:02.359 Firmware Slot Information 00:15:02.359 ========================= 00:15:02.359 Active slot: 1 00:15:02.359 Slot 1 Firmware Revision: 24.01.1 00:15:02.359 00:15:02.359 00:15:02.359 Commands Supported and Effects 00:15:02.359 ============================== 00:15:02.359 Admin Commands 00:15:02.359 -------------- 00:15:02.359 Get Log Page (02h): Supported 00:15:02.359 Identify (06h): Supported 00:15:02.359 Abort (08h): Supported 00:15:02.359 Set Features (09h): Supported 00:15:02.359 Get Features (0Ah): Supported 00:15:02.359 Asynchronous Event Request (0Ch): Supported 00:15:02.359 Keep Alive (18h): Supported 00:15:02.359 I/O Commands 00:15:02.359 ------------ 00:15:02.359 Flush (00h): Supported LBA-Change 00:15:02.359 Write (01h): Supported LBA-Change 00:15:02.360 Read (02h): Supported 00:15:02.360 Compare (05h): Supported 00:15:02.360 Write Zeroes (08h): Supported LBA-Change 00:15:02.360 Dataset Management (09h): Supported LBA-Change 00:15:02.360 Copy (19h): Supported LBA-Change 00:15:02.360 Unknown (79h): Supported LBA-Change 00:15:02.360 Unknown (7Ah): Supported 00:15:02.360 00:15:02.360 Error Log 00:15:02.360 ========= 00:15:02.360 00:15:02.360 Arbitration 00:15:02.360 =========== 00:15:02.360 Arbitration Burst: 1 00:15:02.360 00:15:02.360 Power Management 00:15:02.360 ================ 00:15:02.360 Number of Power States: 1 00:15:02.360 Current Power State: Power State #0 00:15:02.360 Power State #0: 00:15:02.360 Max Power: 0.00 W 00:15:02.360 Non-Operational State: Operational 00:15:02.360 Entry Latency: Not Reported 00:15:02.360 Exit Latency: Not Reported 00:15:02.360 Relative Read Throughput: 0 00:15:02.360 Relative Read Latency: 0 00:15:02.360 Relative Write Throughput: 0 00:15:02.360 Relative Write Latency: 0 00:15:02.360 Idle Power: Not Reported 00:15:02.360 Active Power: Not Reported 00:15:02.360 Non-Operational Permissive Mode: Not Supported 00:15:02.360 00:15:02.360 Health Information 00:15:02.360 ================== 00:15:02.360 Critical Warnings: 00:15:02.360 Available Spare Space: OK 00:15:02.360 Temperature: OK 00:15:02.360 Device Reliability: OK 00:15:02.360 Read Only: No 00:15:02.360 Volatile Memory Backup: OK 00:15:02.360 Current Temperature: 0 Kelvin[2024-11-26 04:26:41.481179] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:02.360 [2024-11-26 04:26:41.481195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:02.360 [2024-11-26 04:26:41.481233] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:02.360 [2024-11-26 04:26:41.481250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.360 [2024-11-26 04:26:41.481260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.360 [2024-11-26 04:26:41.481270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.360 [2024-11-26 04:26:41.481279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.360 [2024-11-26 04:26:41.482700] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:02.360 [2024-11-26 04:26:41.482722] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:02.360 [2024-11-26 04:26:41.482881] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:02.360 [2024-11-26 04:26:41.482894] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:02.360 [2024-11-26 04:26:41.483836] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:02.360 [2024-11-26 04:26:41.483858] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:02.360 [2024-11-26 04:26:41.483913] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:02.360 [2024-11-26 04:26:41.487696] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:02.360 (-273 Celsius) 00:15:02.360 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:02.360 Available Spare: 0% 00:15:02.360 Available Spare Threshold: 0% 00:15:02.360 Life Percentage Used: 0% 00:15:02.360 Data Units Read: 0 00:15:02.360 Data Units Written: 0 00:15:02.360 Host Read Commands: 0 00:15:02.360 Host Write Commands: 0 00:15:02.360 Controller Busy Time: 0 minutes 00:15:02.360 Power Cycles: 0 00:15:02.360 Power On Hours: 0 hours 00:15:02.360 Unsafe Shutdowns: 0 00:15:02.360 Unrecoverable Media Errors: 0 00:15:02.360 Lifetime Error Log Entries: 0 00:15:02.360 Warning Temperature Time: 0 minutes 00:15:02.360 Critical Temperature Time: 0 minutes 00:15:02.360 00:15:02.360 Number of Queues 00:15:02.360 ================ 00:15:02.360 Number of I/O Submission Queues: 127 00:15:02.360 Number of I/O Completion Queues: 127 00:15:02.360 00:15:02.360 Active Namespaces 00:15:02.360 ================= 00:15:02.360 Namespace ID:1 00:15:02.360 Error Recovery Timeout: Unlimited 00:15:02.360 Command Set Identifier: NVM (00h) 00:15:02.360 Deallocate: Supported 00:15:02.360 Deallocated/Unwritten Error: Not Supported 00:15:02.360 Deallocated Read Value: Unknown 00:15:02.360 Deallocate in Write Zeroes: Not Supported 00:15:02.360 Deallocated Guard Field: 0xFFFF 00:15:02.360 Flush: Supported 00:15:02.360 Reservation: Supported 00:15:02.360 Namespace Sharing Capabilities: Multiple Controllers 00:15:02.360 Size (in LBAs): 131072 (0GiB) 00:15:02.360 Capacity (in LBAs): 131072 (0GiB) 00:15:02.360 Utilization (in LBAs): 131072 (0GiB) 00:15:02.360 NGUID: C6D004B22C0D49E6AEB1D4ACC5707493 00:15:02.360 UUID: c6d004b2-2c0d-49e6-aeb1-d4acc5707493 00:15:02.360 Thin Provisioning: Not Supported 00:15:02.360 Per-NS Atomic Units: Yes 00:15:02.360 Atomic Boundary Size (Normal): 0 00:15:02.360 Atomic Boundary Size (PFail): 0 00:15:02.360 Atomic Boundary Offset: 0 00:15:02.360 Maximum Single Source Range Length: 65535 00:15:02.360 Maximum Copy Length: 65535 00:15:02.360 Maximum Source Range Count: 1 00:15:02.360 NGUID/EUI64 Never Reused: No 00:15:02.360 Namespace Write Protected: No 00:15:02.360 Number of LBA Formats: 1 00:15:02.360 Current LBA Format: LBA Format #00 00:15:02.360 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:02.360 00:15:02.360 04:26:41 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:02.360 EAL: No free 2048 kB hugepages reported on node 1 00:15:07.642 Initializing NVMe Controllers 00:15:07.642 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:07.642 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:07.642 Initialization complete. Launching workers. 00:15:07.642 ======================================================== 00:15:07.642 Latency(us) 00:15:07.642 Device Information : IOPS MiB/s Average min max 00:15:07.642 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 38096.55 148.81 3360.68 1139.84 7505.54 00:15:07.642 ======================================================== 00:15:07.642 Total : 38096.55 148.81 3360.68 1139.84 7505.54 00:15:07.642 00:15:07.642 04:26:46 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:07.642 EAL: No free 2048 kB hugepages reported on node 1 00:15:12.916 Initializing NVMe Controllers 00:15:12.916 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:12.916 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:12.916 Initialization complete. Launching workers. 00:15:12.916 ======================================================== 00:15:12.917 Latency(us) 00:15:12.917 Device Information : IOPS MiB/s Average min max 00:15:12.917 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 15910.16 62.15 8050.46 4964.66 16010.98 00:15:12.917 ======================================================== 00:15:12.917 Total : 15910.16 62.15 8050.46 4964.66 16010.98 00:15:12.917 00:15:12.917 04:26:52 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:12.917 EAL: No free 2048 kB hugepages reported on node 1 00:15:18.193 Initializing NVMe Controllers 00:15:18.193 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:18.193 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:18.193 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:18.193 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:18.193 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:18.193 Initialization complete. Launching workers. 00:15:18.193 Starting thread on core 2 00:15:18.193 Starting thread on core 3 00:15:18.193 Starting thread on core 1 00:15:18.193 04:26:57 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:18.193 EAL: No free 2048 kB hugepages reported on node 1 00:15:22.396 Initializing NVMe Controllers 00:15:22.396 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:22.396 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:22.396 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:22.396 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:22.396 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:22.396 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:22.396 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:22.396 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:22.396 Initialization complete. Launching workers. 00:15:22.396 Starting thread on core 1 with urgent priority queue 00:15:22.396 Starting thread on core 2 with urgent priority queue 00:15:22.396 Starting thread on core 3 with urgent priority queue 00:15:22.396 Starting thread on core 0 with urgent priority queue 00:15:22.396 SPDK bdev Controller (SPDK1 ) core 0: 5029.00 IO/s 19.88 secs/100000 ios 00:15:22.396 SPDK bdev Controller (SPDK1 ) core 1: 5255.67 IO/s 19.03 secs/100000 ios 00:15:22.396 SPDK bdev Controller (SPDK1 ) core 2: 5100.00 IO/s 19.61 secs/100000 ios 00:15:22.396 SPDK bdev Controller (SPDK1 ) core 3: 5223.67 IO/s 19.14 secs/100000 ios 00:15:22.396 ======================================================== 00:15:22.396 00:15:22.396 04:27:00 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:22.396 EAL: No free 2048 kB hugepages reported on node 1 00:15:22.396 Initializing NVMe Controllers 00:15:22.396 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:22.396 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:22.396 Namespace ID: 1 size: 0GB 00:15:22.396 Initialization complete. 00:15:22.396 INFO: using host memory buffer for IO 00:15:22.396 Hello world! 00:15:22.396 04:27:01 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:22.396 EAL: No free 2048 kB hugepages reported on node 1 00:15:23.335 Initializing NVMe Controllers 00:15:23.335 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:23.335 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:23.335 Initialization complete. Launching workers. 00:15:23.335 submit (in ns) avg, min, max = 9322.4, 3445.6, 4023070.0 00:15:23.335 complete (in ns) avg, min, max = 24266.9, 2032.2, 4016675.6 00:15:23.335 00:15:23.335 Submit histogram 00:15:23.335 ================ 00:15:23.335 Range in us Cumulative Count 00:15:23.335 3.437 - 3.461: 0.1149% ( 16) 00:15:23.335 3.461 - 3.484: 0.6966% ( 81) 00:15:23.335 3.484 - 3.508: 3.4760% ( 387) 00:15:23.335 3.508 - 3.532: 7.4404% ( 552) 00:15:23.335 3.532 - 3.556: 15.7498% ( 1157) 00:15:23.335 3.556 - 3.579: 26.6087% ( 1512) 00:15:23.335 3.579 - 3.603: 35.6004% ( 1252) 00:15:23.335 3.603 - 3.627: 43.0336% ( 1035) 00:15:23.335 3.627 - 3.650: 50.3591% ( 1020) 00:15:23.335 3.650 - 3.674: 56.9305% ( 915) 00:15:23.335 3.674 - 3.698: 62.4605% ( 770) 00:15:23.335 3.698 - 3.721: 66.9348% ( 623) 00:15:23.335 3.721 - 3.745: 69.6639% ( 380) 00:15:23.335 3.745 - 3.769: 72.5007% ( 395) 00:15:23.335 3.769 - 3.793: 75.5458% ( 424) 00:15:23.335 3.793 - 3.816: 78.9787% ( 478) 00:15:23.335 3.816 - 3.840: 82.3398% ( 468) 00:15:23.335 3.840 - 3.864: 85.4568% ( 434) 00:15:23.335 3.864 - 3.887: 87.3887% ( 269) 00:15:23.335 3.887 - 3.911: 89.2201% ( 255) 00:15:23.335 3.911 - 3.935: 90.7857% ( 218) 00:15:23.335 3.935 - 3.959: 92.1287% ( 187) 00:15:23.335 3.959 - 3.982: 93.2275% ( 153) 00:15:23.335 3.982 - 4.006: 94.0750% ( 118) 00:15:23.335 4.006 - 4.030: 94.6926% ( 86) 00:15:23.335 4.030 - 4.053: 95.1810% ( 68) 00:15:23.335 4.053 - 4.077: 95.6478% ( 65) 00:15:23.335 4.077 - 4.101: 95.9925% ( 48) 00:15:23.335 4.101 - 4.124: 96.1793% ( 26) 00:15:23.335 4.124 - 4.148: 96.2942% ( 16) 00:15:23.335 4.148 - 4.172: 96.4091% ( 16) 00:15:23.335 4.172 - 4.196: 96.4953% ( 12) 00:15:23.335 4.196 - 4.219: 96.5814% ( 12) 00:15:23.335 4.219 - 4.243: 96.6676% ( 12) 00:15:23.335 4.243 - 4.267: 96.7394% ( 10) 00:15:23.335 4.267 - 4.290: 96.7897% ( 7) 00:15:23.335 4.290 - 4.314: 96.8256% ( 5) 00:15:23.335 4.314 - 4.338: 96.8831% ( 8) 00:15:23.335 4.338 - 4.361: 96.9190% ( 5) 00:15:23.335 4.361 - 4.385: 96.9477% ( 4) 00:15:23.335 4.385 - 4.409: 96.9693% ( 3) 00:15:23.335 4.409 - 4.433: 96.9764% ( 1) 00:15:23.335 4.433 - 4.456: 96.9836% ( 1) 00:15:23.335 4.456 - 4.480: 96.9908% ( 1) 00:15:23.335 4.504 - 4.527: 97.0052% ( 2) 00:15:23.335 4.527 - 4.551: 97.0124% ( 1) 00:15:23.335 4.575 - 4.599: 97.0195% ( 1) 00:15:23.335 4.599 - 4.622: 97.0267% ( 1) 00:15:23.335 4.622 - 4.646: 97.0411% ( 2) 00:15:23.335 4.646 - 4.670: 97.0483% ( 1) 00:15:23.335 4.670 - 4.693: 97.0698% ( 3) 00:15:23.335 4.693 - 4.717: 97.0842% ( 2) 00:15:23.335 4.717 - 4.741: 97.1201% ( 5) 00:15:23.335 4.741 - 4.764: 97.1560% ( 5) 00:15:23.335 4.764 - 4.788: 97.1991% ( 6) 00:15:23.335 4.788 - 4.812: 97.2350% ( 5) 00:15:23.335 4.812 - 4.836: 97.2924% ( 8) 00:15:23.335 4.836 - 4.859: 97.3355% ( 6) 00:15:23.335 4.859 - 4.883: 97.3930% ( 8) 00:15:23.335 4.883 - 4.907: 97.4289% ( 5) 00:15:23.335 4.907 - 4.930: 97.4720% ( 6) 00:15:23.335 4.930 - 4.954: 97.5079% ( 5) 00:15:23.335 4.954 - 4.978: 97.5510% ( 6) 00:15:23.335 4.978 - 5.001: 97.5941% ( 6) 00:15:23.335 5.001 - 5.025: 97.6084% ( 2) 00:15:23.335 5.025 - 5.049: 97.6515% ( 6) 00:15:23.335 5.049 - 5.073: 97.6731% ( 3) 00:15:23.335 5.073 - 5.096: 97.6946% ( 3) 00:15:23.335 5.096 - 5.120: 97.7090% ( 2) 00:15:23.335 5.120 - 5.144: 97.7377% ( 4) 00:15:23.335 5.144 - 5.167: 97.7664% ( 4) 00:15:23.335 5.167 - 5.191: 97.7808% ( 2) 00:15:23.335 5.191 - 5.215: 97.7880% ( 1) 00:15:23.335 5.262 - 5.286: 97.7952% ( 1) 00:15:23.335 5.310 - 5.333: 97.8167% ( 3) 00:15:23.335 5.333 - 5.357: 97.8239% ( 1) 00:15:23.335 5.428 - 5.452: 97.8311% ( 1) 00:15:23.335 5.594 - 5.618: 97.8383% ( 1) 00:15:23.335 5.618 - 5.641: 97.8454% ( 1) 00:15:23.335 5.641 - 5.665: 97.8598% ( 2) 00:15:23.335 5.665 - 5.689: 97.8742% ( 2) 00:15:23.335 5.713 - 5.736: 97.8814% ( 1) 00:15:23.335 5.736 - 5.760: 97.8885% ( 1) 00:15:23.335 5.807 - 5.831: 97.8957% ( 1) 00:15:23.335 5.902 - 5.926: 97.9029% ( 1) 00:15:23.335 5.997 - 6.021: 97.9101% ( 1) 00:15:23.335 6.210 - 6.258: 97.9244% ( 2) 00:15:23.335 6.305 - 6.353: 97.9316% ( 1) 00:15:23.335 6.353 - 6.400: 97.9388% ( 1) 00:15:23.335 6.495 - 6.542: 97.9460% ( 1) 00:15:23.335 6.542 - 6.590: 97.9532% ( 1) 00:15:23.335 6.590 - 6.637: 97.9675% ( 2) 00:15:23.335 6.637 - 6.684: 97.9819% ( 2) 00:15:23.335 6.921 - 6.969: 97.9891% ( 1) 00:15:23.335 6.969 - 7.016: 97.9963% ( 1) 00:15:23.335 7.016 - 7.064: 98.0034% ( 1) 00:15:23.335 7.111 - 7.159: 98.0106% ( 1) 00:15:23.335 7.159 - 7.206: 98.0178% ( 1) 00:15:23.335 7.443 - 7.490: 98.0250% ( 1) 00:15:23.335 7.585 - 7.633: 98.0322% ( 1) 00:15:23.335 7.633 - 7.680: 98.0465% ( 2) 00:15:23.336 7.727 - 7.775: 98.0609% ( 2) 00:15:23.336 7.775 - 7.822: 98.0681% ( 1) 00:15:23.336 7.870 - 7.917: 98.0753% ( 1) 00:15:23.336 7.917 - 7.964: 98.0896% ( 2) 00:15:23.336 8.059 - 8.107: 98.0968% ( 1) 00:15:23.336 8.107 - 8.154: 98.1255% ( 4) 00:15:23.336 8.154 - 8.201: 98.1399% ( 2) 00:15:23.336 8.344 - 8.391: 98.1471% ( 1) 00:15:23.336 8.391 - 8.439: 98.1614% ( 2) 00:15:23.336 8.533 - 8.581: 98.1758% ( 2) 00:15:23.336 8.581 - 8.628: 98.1830% ( 1) 00:15:23.336 8.628 - 8.676: 98.1902% ( 1) 00:15:23.336 8.676 - 8.723: 98.2045% ( 2) 00:15:23.336 8.818 - 8.865: 98.2261% ( 3) 00:15:23.336 8.865 - 8.913: 98.2404% ( 2) 00:15:23.336 8.913 - 8.960: 98.2476% ( 1) 00:15:23.336 9.007 - 9.055: 98.2692% ( 3) 00:15:23.336 9.055 - 9.102: 98.2835% ( 2) 00:15:23.336 9.150 - 9.197: 98.2907% ( 1) 00:15:23.336 9.292 - 9.339: 98.3194% ( 4) 00:15:23.336 9.339 - 9.387: 98.3410% ( 3) 00:15:23.336 9.434 - 9.481: 98.3554% ( 2) 00:15:23.336 9.529 - 9.576: 98.3625% ( 1) 00:15:23.336 9.576 - 9.624: 98.3697% ( 1) 00:15:23.336 9.624 - 9.671: 98.3841% ( 2) 00:15:23.336 9.671 - 9.719: 98.3984% ( 2) 00:15:23.336 9.719 - 9.766: 98.4056% ( 1) 00:15:23.336 9.766 - 9.813: 98.4200% ( 2) 00:15:23.336 9.813 - 9.861: 98.4272% ( 1) 00:15:23.336 9.861 - 9.908: 98.4344% ( 1) 00:15:23.336 9.908 - 9.956: 98.4487% ( 2) 00:15:23.336 10.003 - 10.050: 98.4559% ( 1) 00:15:23.336 10.050 - 10.098: 98.4631% ( 1) 00:15:23.336 10.098 - 10.145: 98.4703% ( 1) 00:15:23.336 10.145 - 10.193: 98.4846% ( 2) 00:15:23.336 10.193 - 10.240: 98.4990% ( 2) 00:15:23.336 10.287 - 10.335: 98.5205% ( 3) 00:15:23.336 10.335 - 10.382: 98.5421% ( 3) 00:15:23.336 10.477 - 10.524: 98.5636% ( 3) 00:15:23.336 10.524 - 10.572: 98.5708% ( 1) 00:15:23.336 10.572 - 10.619: 98.5780% ( 1) 00:15:23.336 10.619 - 10.667: 98.5852% ( 1) 00:15:23.336 10.714 - 10.761: 98.5924% ( 1) 00:15:23.336 10.809 - 10.856: 98.6067% ( 2) 00:15:23.336 10.904 - 10.951: 98.6139% ( 1) 00:15:23.336 10.951 - 10.999: 98.6354% ( 3) 00:15:23.336 10.999 - 11.046: 98.6426% ( 1) 00:15:23.336 11.046 - 11.093: 98.6570% ( 2) 00:15:23.336 11.093 - 11.141: 98.6642% ( 1) 00:15:23.336 11.236 - 11.283: 98.6785% ( 2) 00:15:23.336 11.283 - 11.330: 98.6857% ( 1) 00:15:23.336 11.378 - 11.425: 98.6929% ( 1) 00:15:23.336 11.473 - 11.520: 98.7001% ( 1) 00:15:23.336 11.520 - 11.567: 98.7144% ( 2) 00:15:23.336 11.804 - 11.852: 98.7288% ( 2) 00:15:23.336 11.994 - 12.041: 98.7360% ( 1) 00:15:23.336 12.136 - 12.231: 98.7432% ( 1) 00:15:23.336 12.231 - 12.326: 98.7504% ( 1) 00:15:23.336 12.326 - 12.421: 98.7575% ( 1) 00:15:23.336 12.421 - 12.516: 98.7647% ( 1) 00:15:23.336 12.610 - 12.705: 98.7719% ( 1) 00:15:23.336 12.705 - 12.800: 98.7863% ( 2) 00:15:23.336 12.895 - 12.990: 98.8006% ( 2) 00:15:23.336 13.084 - 13.179: 98.8222% ( 3) 00:15:23.336 13.179 - 13.274: 98.8294% ( 1) 00:15:23.336 13.274 - 13.369: 98.8509% ( 3) 00:15:23.336 13.369 - 13.464: 98.8581% ( 1) 00:15:23.336 13.464 - 13.559: 98.8653% ( 1) 00:15:23.336 13.559 - 13.653: 98.8725% ( 1) 00:15:23.336 13.748 - 13.843: 98.9012% ( 4) 00:15:23.336 14.127 - 14.222: 98.9155% ( 2) 00:15:23.336 14.222 - 14.317: 98.9227% ( 1) 00:15:23.336 14.317 - 14.412: 98.9443% ( 3) 00:15:23.336 14.412 - 14.507: 98.9586% ( 2) 00:15:23.336 14.507 - 14.601: 98.9658% ( 1) 00:15:23.336 14.696 - 14.791: 98.9945% ( 4) 00:15:23.336 14.791 - 14.886: 99.0017% ( 1) 00:15:23.336 14.981 - 15.076: 99.0233% ( 3) 00:15:23.336 15.170 - 15.265: 99.0305% ( 1) 00:15:23.336 15.360 - 15.455: 99.0376% ( 1) 00:15:23.336 15.550 - 15.644: 99.0448% ( 1) 00:15:23.336 17.067 - 17.161: 99.0520% ( 1) 00:15:23.336 17.161 - 17.256: 99.0592% ( 1) 00:15:23.336 17.256 - 17.351: 99.0735% ( 2) 00:15:23.336 17.351 - 17.446: 99.0807% ( 1) 00:15:23.336 17.446 - 17.541: 99.1023% ( 3) 00:15:23.336 17.541 - 17.636: 99.1597% ( 8) 00:15:23.336 17.636 - 17.730: 99.2028% ( 6) 00:15:23.336 17.730 - 17.825: 99.2387% ( 5) 00:15:23.336 17.825 - 17.920: 99.3249% ( 12) 00:15:23.336 17.920 - 18.015: 99.3824% ( 8) 00:15:23.336 18.015 - 18.110: 99.4542% ( 10) 00:15:23.336 18.110 - 18.204: 99.4901% ( 5) 00:15:23.336 18.204 - 18.299: 99.5260% ( 5) 00:15:23.336 18.299 - 18.394: 99.5906% ( 9) 00:15:23.336 18.394 - 18.489: 99.6050% ( 2) 00:15:23.336 18.489 - 18.584: 99.6337% ( 4) 00:15:23.336 18.584 - 18.679: 99.6984% ( 9) 00:15:23.336 18.679 - 18.773: 99.7199% ( 3) 00:15:23.336 18.773 - 18.868: 99.7271% ( 1) 00:15:23.336 18.868 - 18.963: 99.7343% ( 1) 00:15:23.336 19.058 - 19.153: 99.7558% ( 3) 00:15:23.336 19.153 - 19.247: 99.7630% ( 1) 00:15:23.336 19.342 - 19.437: 99.7702% ( 1) 00:15:23.336 20.480 - 20.575: 99.7774% ( 1) 00:15:23.336 21.807 - 21.902: 99.7845% ( 1) 00:15:23.336 22.092 - 22.187: 99.7917% ( 1) 00:15:23.336 22.661 - 22.756: 99.8061% ( 2) 00:15:23.336 22.850 - 22.945: 99.8133% ( 1) 00:15:23.336 23.135 - 23.230: 99.8205% ( 1) 00:15:23.336 25.979 - 26.169: 99.8348% ( 2) 00:15:23.336 26.927 - 27.117: 99.8420% ( 1) 00:15:23.336 28.065 - 28.255: 99.8492% ( 1) 00:15:23.336 28.444 - 28.634: 99.8564% ( 1) 00:15:23.336 28.634 - 28.824: 99.8635% ( 1) 00:15:23.336 3495.253 - 3519.526: 99.8707% ( 1) 00:15:23.336 3980.705 - 4004.978: 99.9641% ( 13) 00:15:23.336 4004.978 - 4029.250: 100.0000% ( 5) 00:15:23.336 00:15:23.336 Complete histogram 00:15:23.336 ================== 00:15:23.336 Range in us Cumulative Count 00:15:23.336 2.027 - 2.039: 0.8259% ( 115) 00:15:23.336 2.039 - 2.050: 12.7262% ( 1657) 00:15:23.336 2.050 - 2.062: 15.2830% ( 356) 00:15:23.336 2.062 - 2.074: 29.2229% ( 1941) 00:15:23.336 2.074 - 2.086: 56.6719% ( 3822) 00:15:23.336 2.086 - 2.098: 61.1319% ( 621) 00:15:23.336 2.098 - 2.110: 63.8538% ( 379) 00:15:23.336 2.110 - 2.121: 67.4950% ( 507) 00:15:23.336 2.121 - 2.133: 68.4358% ( 131) 00:15:23.336 2.133 - 2.145: 78.7920% ( 1442) 00:15:23.336 2.145 - 2.157: 87.4318% ( 1203) 00:15:23.336 2.157 - 2.169: 89.1267% ( 236) 00:15:23.336 2.169 - 2.181: 90.8719% ( 243) 00:15:23.336 2.181 - 2.193: 91.7552% ( 123) 00:15:23.336 2.193 - 2.204: 92.5883% ( 116) 00:15:23.336 2.204 - 2.216: 94.2402% ( 230) 00:15:23.336 2.216 - 2.228: 95.1810% ( 131) 00:15:23.336 2.228 - 2.240: 95.4754% ( 41) 00:15:23.336 2.240 - 2.252: 95.7914% ( 44) 00:15:23.336 2.252 - 2.264: 95.8992% ( 15) 00:15:23.336 2.264 - 2.276: 96.0500% ( 21) 00:15:23.336 2.276 - 2.287: 96.1864% ( 19) 00:15:23.336 2.287 - 2.299: 96.2295% ( 6) 00:15:23.336 2.299 - 2.311: 96.2654% ( 5) 00:15:23.336 2.311 - 2.323: 96.3875% ( 17) 00:15:23.336 2.323 - 2.335: 96.5168% ( 18) 00:15:23.336 2.335 - 2.347: 96.7825% ( 37) 00:15:23.336 2.347 - 2.359: 97.1344% ( 49) 00:15:23.336 2.359 - 2.370: 97.4433% ( 43) 00:15:23.336 2.370 - 2.382: 97.6874% ( 34) 00:15:23.336 2.382 - 2.394: 97.8454% ( 22) 00:15:23.336 2.394 - 2.406: 98.0106% ( 23) 00:15:23.336 2.406 - 2.418: 98.0896% ( 11) 00:15:23.336 2.418 - 2.430: 98.1471% ( 8) 00:15:23.336 2.430 - 2.441: 98.2692% ( 17) 00:15:23.336 2.441 - 2.453: 98.3194% ( 7) 00:15:23.336 2.453 - 2.465: 98.3410% ( 3) 00:15:23.336 2.465 - 2.477: 98.3984% ( 8) 00:15:23.336 2.477 - 2.489: 98.4128% ( 2) 00:15:23.336 2.489 - 2.501: 98.4200% ( 1) 00:15:23.336 2.501 - 2.513: 98.4344% ( 2) 00:15:23.336 2.524 - 2.536: 98.4415% ( 1) 00:15:23.336 2.536 - 2.548: 98.4487% ( 1) 00:15:23.336 2.560 - 2.572: 98.4631% ( 2) 00:15:23.336 2.596 - 2.607: 98.4703% ( 1) 00:15:23.336 2.631 - 2.643: 98.4846% ( 2) 00:15:23.336 3.224 - 3.247: 98.4918% ( 1) 00:15:23.336 3.342 - 3.366: 98.4990% ( 1) 00:15:23.336 3.366 - 3.390: 98.5062% ( 1) 00:15:23.336 3.390 - 3.413: 98.5134% ( 1) 00:15:23.336 3.413 - 3.437: 98.5349% ( 3) 00:15:23.336 3.437 - 3.461: 98.5493% ( 2) 00:15:23.336 3.461 - 3.484: 98.5564% ( 1) 00:15:23.337 3.484 - 3.508: 98.5636% ( 1) 00:15:23.337 3.508 - 3.532: 98.5780% ( 2) 00:15:23.337 3.532 - 3.556: 98.5924% ( 2) 00:15:23.337 3.556 - 3.579: 98.5995% ( 1) 00:15:23.337 3.579 - 3.603: 98.6139% ( 2) 00:15:23.337 3.650 - 3.674: 98.6211% ( 1) 00:15:23.337 3.674 - 3.698: 98.6283% ( 1) 00:15:23.337 3.698 - 3.721: 98.6354% ( 1) 00:15:23.337 3.721 - 3.745: 98.6498% ( 2) 00:15:23.337 3.793 - 3.816: 98.6570% ( 1) 00:15:23.337 3.840 - 3.864: 98.6642% ( 1) 00:15:23.337 3.959 - 3.982: 98.6714% ( 1) 00:15:23.337 4.219 - 4.243: 98.6785% ( 1) 00:15:23.337 4.314 - 4.338: 98.6857% ( 1) 00:15:23.337 6.305 - 6.353: 98.7001% ( 2) 00:15:23.337 6.447 - 6.495: 98.7073% ( 1) 00:15:23.337 6.779 - 6.827: 98.7144% ( 1) 00:15:23.337 6.874 - 6.921: 98.7216% ( 1) 00:15:23.337 6.921 - 6.969: 98.7288% ( 1) 00:15:23.337 7.159 - 7.206: 98.7432% ( 2) 00:15:23.337 7.206 - 7.253: 98.7504% ( 1) 00:15:23.337 7.253 - 7.301: 98.7575% ( 1) 00:15:23.337 7.301 - 7.348: 98.7647% ( 1) 00:15:23.337 7.348 - 7.396: 98.7719% ( 1) 00:15:23.337 7.443 - 7.490: 98.7791% ( 1) 00:15:23.337 7.490 - 7.538: 98.7863% ( 1) 00:15:23.337 7.585 - 7.633: 98.7935% ( 1) 00:15:23.337 7.680 - 7.727: 98.8006% ( 1) 00:15:23.337 7.822 - 7.870: 98.8078% ( 1) 00:15:23.337 8.533 - 8.581: 98.8150% ( 1) 00:15:23.337 8.581 - 8.628: 98.8222% ( 1) 00:15:23.337 8.676 - 8.723: 98.8294% ( 1) 00:15:23.337 9.150 - 9.197: 98.8365% ( 1) 00:15:23.337 9.434 - 9.481: 98.8437% ( 1) 00:15:23.337 12.421 - 12.516: 98.8509% ( 1) 00:15:23.337 12.800 - 12.895: 98.8581% ( 1) 00:15:23.337 15.550 - 15.644: 98.8653% ( 1) 00:15:23.337 15.644 - 15.739: 98.8940% ( 4) 00:15:23.337 15.739 - 15.834: 98.9084% ( 2) 00:15:23.337 15.834 - 15.929: 98.9371% ( 4) 00:15:23.337 15.929 - 16.024: 98.9586% ( 3) 00:15:23.337 16.024 - 16.119: 98.9874% ( 4) 00:15:23.337 16.119 - 16.213: 99.0520% ( 9) 00:15:23.337 16.213 - 16.308: 99.0951% ( 6) 00:15:23.337 16.308 - 16.403: 99.1525% ( 8) 00:15:23.337 16.403 - 16.498: 99.1813% ( 4) 00:15:23.337 16.498 - 16.593: 99.2100% ( 4) 00:15:23.337 16.593 - 16.687: 99.2531% ( 6) 00:15:23.337 16.687 - 16.782: 99.2890% ( 5) 00:15:23.337 16.782 - 16.877: 99.3105% ( 3) 00:15:23.337 16.877 - 16.972: 99.3465% ( 5) 00:15:23.337 16.972 - 17.067: 99.3752% ( 4) 00:15:23.337 17.067 - 17.161: 99.4111% ( 5) 00:15:23.337 17.256 - 17.351: 99.4183% ( 1) 00:15:23.337 17.351 - 17.446: 99.4326% ( 2) 00:15:23.337 17.730 - 17.825: 99.4398% ( 1) 00:15:23.337 18.299 - 18.394: 99.4470% ( 1) 00:15:23.337 3131.164 - 3155.437: 99.4542% ( 1) 00:15:23.337 3980.705 - 4004.978: 99.9210% ( 65) 00:15:23.337 4004.978 - 4029.250: 100.0000% ( 11) 00:15:23.337 00:15:23.337 04:27:02 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:23.337 04:27:02 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:23.337 04:27:02 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:23.337 04:27:02 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:23.337 04:27:02 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:23.595 [2024-11-26 04:27:02.628827] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:23.595 [ 00:15:23.595 { 00:15:23.595 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:23.595 "subtype": "Discovery", 00:15:23.595 "listen_addresses": [], 00:15:23.595 "allow_any_host": true, 00:15:23.595 "hosts": [] 00:15:23.596 }, 00:15:23.596 { 00:15:23.596 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:23.596 "subtype": "NVMe", 00:15:23.596 "listen_addresses": [ 00:15:23.596 { 00:15:23.596 "transport": "VFIOUSER", 00:15:23.596 "trtype": "VFIOUSER", 00:15:23.596 "adrfam": "IPv4", 00:15:23.596 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:23.596 "trsvcid": "0" 00:15:23.596 } 00:15:23.596 ], 00:15:23.596 "allow_any_host": true, 00:15:23.596 "hosts": [], 00:15:23.596 "serial_number": "SPDK1", 00:15:23.596 "model_number": "SPDK bdev Controller", 00:15:23.596 "max_namespaces": 32, 00:15:23.596 "min_cntlid": 1, 00:15:23.596 "max_cntlid": 65519, 00:15:23.596 "namespaces": [ 00:15:23.596 { 00:15:23.596 "nsid": 1, 00:15:23.596 "bdev_name": "Malloc1", 00:15:23.596 "name": "Malloc1", 00:15:23.596 "nguid": "C6D004B22C0D49E6AEB1D4ACC5707493", 00:15:23.596 "uuid": "c6d004b2-2c0d-49e6-aeb1-d4acc5707493" 00:15:23.596 } 00:15:23.596 ] 00:15:23.596 }, 00:15:23.596 { 00:15:23.596 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:23.596 "subtype": "NVMe", 00:15:23.596 "listen_addresses": [ 00:15:23.596 { 00:15:23.596 "transport": "VFIOUSER", 00:15:23.596 "trtype": "VFIOUSER", 00:15:23.596 "adrfam": "IPv4", 00:15:23.596 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:23.596 "trsvcid": "0" 00:15:23.596 } 00:15:23.596 ], 00:15:23.596 "allow_any_host": true, 00:15:23.596 "hosts": [], 00:15:23.596 "serial_number": "SPDK2", 00:15:23.596 "model_number": "SPDK bdev Controller", 00:15:23.596 "max_namespaces": 32, 00:15:23.596 "min_cntlid": 1, 00:15:23.596 "max_cntlid": 65519, 00:15:23.596 "namespaces": [ 00:15:23.596 { 00:15:23.596 "nsid": 1, 00:15:23.596 "bdev_name": "Malloc2", 00:15:23.596 "name": "Malloc2", 00:15:23.596 "nguid": "0984CEC10AD045258321C2EDDE9C5975", 00:15:23.596 "uuid": "0984cec1-0ad0-4525-8321-c2edde9c5975" 00:15:23.596 } 00:15:23.596 ] 00:15:23.596 } 00:15:23.596 ] 00:15:23.596 04:27:02 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:23.596 04:27:02 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2888798 00:15:23.596 04:27:02 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:23.596 04:27:02 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:23.596 04:27:02 -- common/autotest_common.sh@1254 -- # local i=0 00:15:23.596 04:27:02 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:23.596 04:27:02 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:23.596 04:27:02 -- common/autotest_common.sh@1265 -- # return 0 00:15:23.596 04:27:02 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:23.596 04:27:02 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:23.596 EAL: No free 2048 kB hugepages reported on node 1 00:15:23.854 Malloc3 00:15:23.854 04:27:02 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:24.129 04:27:03 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:24.129 Asynchronous Event Request test 00:15:24.129 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:24.129 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:24.129 Registering asynchronous event callbacks... 00:15:24.129 Starting namespace attribute notice tests for all controllers... 00:15:24.129 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:24.129 aer_cb - Changed Namespace 00:15:24.129 Cleaning up... 00:15:24.415 [ 00:15:24.415 { 00:15:24.415 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:24.415 "subtype": "Discovery", 00:15:24.415 "listen_addresses": [], 00:15:24.415 "allow_any_host": true, 00:15:24.415 "hosts": [] 00:15:24.415 }, 00:15:24.415 { 00:15:24.415 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:24.415 "subtype": "NVMe", 00:15:24.415 "listen_addresses": [ 00:15:24.415 { 00:15:24.415 "transport": "VFIOUSER", 00:15:24.415 "trtype": "VFIOUSER", 00:15:24.415 "adrfam": "IPv4", 00:15:24.415 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:24.415 "trsvcid": "0" 00:15:24.415 } 00:15:24.415 ], 00:15:24.415 "allow_any_host": true, 00:15:24.415 "hosts": [], 00:15:24.415 "serial_number": "SPDK1", 00:15:24.415 "model_number": "SPDK bdev Controller", 00:15:24.415 "max_namespaces": 32, 00:15:24.415 "min_cntlid": 1, 00:15:24.415 "max_cntlid": 65519, 00:15:24.415 "namespaces": [ 00:15:24.415 { 00:15:24.415 "nsid": 1, 00:15:24.415 "bdev_name": "Malloc1", 00:15:24.415 "name": "Malloc1", 00:15:24.415 "nguid": "C6D004B22C0D49E6AEB1D4ACC5707493", 00:15:24.415 "uuid": "c6d004b2-2c0d-49e6-aeb1-d4acc5707493" 00:15:24.415 }, 00:15:24.415 { 00:15:24.415 "nsid": 2, 00:15:24.415 "bdev_name": "Malloc3", 00:15:24.415 "name": "Malloc3", 00:15:24.415 "nguid": "4DA91A7CBFE248368F6EC573BB8D68B6", 00:15:24.415 "uuid": "4da91a7c-bfe2-4836-8f6e-c573bb8d68b6" 00:15:24.415 } 00:15:24.415 ] 00:15:24.415 }, 00:15:24.415 { 00:15:24.415 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:24.415 "subtype": "NVMe", 00:15:24.415 "listen_addresses": [ 00:15:24.415 { 00:15:24.415 "transport": "VFIOUSER", 00:15:24.415 "trtype": "VFIOUSER", 00:15:24.415 "adrfam": "IPv4", 00:15:24.415 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:24.415 "trsvcid": "0" 00:15:24.415 } 00:15:24.415 ], 00:15:24.415 "allow_any_host": true, 00:15:24.415 "hosts": [], 00:15:24.415 "serial_number": "SPDK2", 00:15:24.415 "model_number": "SPDK bdev Controller", 00:15:24.415 "max_namespaces": 32, 00:15:24.415 "min_cntlid": 1, 00:15:24.415 "max_cntlid": 65519, 00:15:24.415 "namespaces": [ 00:15:24.415 { 00:15:24.415 "nsid": 1, 00:15:24.415 "bdev_name": "Malloc2", 00:15:24.415 "name": "Malloc2", 00:15:24.415 "nguid": "0984CEC10AD045258321C2EDDE9C5975", 00:15:24.415 "uuid": "0984cec1-0ad0-4525-8321-c2edde9c5975" 00:15:24.415 } 00:15:24.415 ] 00:15:24.415 } 00:15:24.415 ] 00:15:24.415 04:27:03 -- target/nvmf_vfio_user.sh@44 -- # wait 2888798 00:15:24.415 04:27:03 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:24.415 04:27:03 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:24.415 04:27:03 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:24.415 04:27:03 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:24.415 [2024-11-26 04:27:03.482639] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:24.415 [2024-11-26 04:27:03.482700] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2888819 ] 00:15:24.415 EAL: No free 2048 kB hugepages reported on node 1 00:15:24.415 [2024-11-26 04:27:03.516639] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:24.415 [2024-11-26 04:27:03.522935] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:24.415 [2024-11-26 04:27:03.522964] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7fb1eb4e5000 00:15:24.415 [2024-11-26 04:27:03.523934] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:24.415 [2024-11-26 04:27:03.524944] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:24.415 [2024-11-26 04:27:03.525948] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:24.415 [2024-11-26 04:27:03.526958] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:24.415 [2024-11-26 04:27:03.527964] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:24.415 [2024-11-26 04:27:03.528974] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:24.415 [2024-11-26 04:27:03.529989] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:24.415 [2024-11-26 04:27:03.530988] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:24.415 [2024-11-26 04:27:03.532011] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:24.415 [2024-11-26 04:27:03.532033] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7fb1ea1df000 00:15:24.415 [2024-11-26 04:27:03.533152] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:24.415 [2024-11-26 04:27:03.547330] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:24.415 [2024-11-26 04:27:03.547362] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:24.415 [2024-11-26 04:27:03.552476] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:24.415 [2024-11-26 04:27:03.552525] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:24.415 [2024-11-26 04:27:03.552609] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:24.415 [2024-11-26 04:27:03.552633] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:24.415 [2024-11-26 04:27:03.552643] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:24.415 [2024-11-26 04:27:03.553475] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:24.415 [2024-11-26 04:27:03.553496] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:24.415 [2024-11-26 04:27:03.553515] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:24.415 [2024-11-26 04:27:03.554481] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:24.415 [2024-11-26 04:27:03.554501] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:24.415 [2024-11-26 04:27:03.554514] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:24.415 [2024-11-26 04:27:03.555488] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:24.415 [2024-11-26 04:27:03.555508] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:24.416 [2024-11-26 04:27:03.556488] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:24.416 [2024-11-26 04:27:03.556508] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:24.416 [2024-11-26 04:27:03.556517] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:24.416 [2024-11-26 04:27:03.556528] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:24.416 [2024-11-26 04:27:03.556637] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:24.416 [2024-11-26 04:27:03.556645] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:24.416 [2024-11-26 04:27:03.556652] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:24.416 [2024-11-26 04:27:03.557500] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:24.416 [2024-11-26 04:27:03.558502] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:24.416 [2024-11-26 04:27:03.559510] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:24.416 [2024-11-26 04:27:03.560543] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:24.416 [2024-11-26 04:27:03.561522] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:24.416 [2024-11-26 04:27:03.561541] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:24.416 [2024-11-26 04:27:03.561550] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.561573] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:24.416 [2024-11-26 04:27:03.561586] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.561603] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:24.416 [2024-11-26 04:27:03.561613] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:24.416 [2024-11-26 04:27:03.561628] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:24.416 [2024-11-26 04:27:03.569699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:24.416 [2024-11-26 04:27:03.569721] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:24.416 [2024-11-26 04:27:03.569730] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:24.416 [2024-11-26 04:27:03.569737] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:24.416 [2024-11-26 04:27:03.569744] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:24.416 [2024-11-26 04:27:03.569752] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:24.416 [2024-11-26 04:27:03.569759] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:24.416 [2024-11-26 04:27:03.569767] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.569783] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.569800] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:24.416 [2024-11-26 04:27:03.577699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:24.416 [2024-11-26 04:27:03.577728] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:24.416 [2024-11-26 04:27:03.577742] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:24.416 [2024-11-26 04:27:03.577754] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:24.416 [2024-11-26 04:27:03.577766] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:24.416 [2024-11-26 04:27:03.577774] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.577789] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.577804] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:24.416 [2024-11-26 04:27:03.585701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:24.416 [2024-11-26 04:27:03.585721] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:24.416 [2024-11-26 04:27:03.585729] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.585746] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.585760] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.585774] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:24.416 [2024-11-26 04:27:03.593718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:24.416 [2024-11-26 04:27:03.593793] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.593808] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.593820] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:24.416 [2024-11-26 04:27:03.593828] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:24.416 [2024-11-26 04:27:03.593838] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:24.416 [2024-11-26 04:27:03.601700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:24.416 [2024-11-26 04:27:03.601728] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:24.416 [2024-11-26 04:27:03.601747] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.601761] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.601773] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:24.416 [2024-11-26 04:27:03.601782] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:24.416 [2024-11-26 04:27:03.601791] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:24.416 [2024-11-26 04:27:03.609697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:24.416 [2024-11-26 04:27:03.609726] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.609742] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.609754] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:24.416 [2024-11-26 04:27:03.609763] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:24.416 [2024-11-26 04:27:03.609772] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:24.416 [2024-11-26 04:27:03.615715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:24.416 [2024-11-26 04:27:03.615737] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.615750] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.615765] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.615776] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.615784] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.615791] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:24.416 [2024-11-26 04:27:03.615803] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:24.416 [2024-11-26 04:27:03.615812] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:24.416 [2024-11-26 04:27:03.615834] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:24.416 [2024-11-26 04:27:03.625713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:24.416 [2024-11-26 04:27:03.625741] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:24.688 [2024-11-26 04:27:03.633697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:24.688 [2024-11-26 04:27:03.633726] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:24.688 [2024-11-26 04:27:03.641698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:24.688 [2024-11-26 04:27:03.641725] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:24.688 [2024-11-26 04:27:03.649699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:24.688 [2024-11-26 04:27:03.649726] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:24.688 [2024-11-26 04:27:03.649736] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:24.688 [2024-11-26 04:27:03.649757] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:24.688 [2024-11-26 04:27:03.649763] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:24.688 [2024-11-26 04:27:03.649772] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:24.688 [2024-11-26 04:27:03.649784] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:24.688 [2024-11-26 04:27:03.649792] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:24.688 [2024-11-26 04:27:03.649816] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:24.688 [2024-11-26 04:27:03.649828] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:24.688 [2024-11-26 04:27:03.649836] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:24.688 [2024-11-26 04:27:03.649845] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:24.688 [2024-11-26 04:27:03.649857] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:24.688 [2024-11-26 04:27:03.649865] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:24.688 [2024-11-26 04:27:03.649874] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:24.688 [2024-11-26 04:27:03.657702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:24.688 [2024-11-26 04:27:03.657740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:24.688 [2024-11-26 04:27:03.657756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:24.688 [2024-11-26 04:27:03.657768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:24.688 ===================================================== 00:15:24.688 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:24.688 ===================================================== 00:15:24.688 Controller Capabilities/Features 00:15:24.688 ================================ 00:15:24.688 Vendor ID: 4e58 00:15:24.688 Subsystem Vendor ID: 4e58 00:15:24.688 Serial Number: SPDK2 00:15:24.688 Model Number: SPDK bdev Controller 00:15:24.688 Firmware Version: 24.01.1 00:15:24.688 Recommended Arb Burst: 6 00:15:24.688 IEEE OUI Identifier: 8d 6b 50 00:15:24.688 Multi-path I/O 00:15:24.688 May have multiple subsystem ports: Yes 00:15:24.688 May have multiple controllers: Yes 00:15:24.688 Associated with SR-IOV VF: No 00:15:24.688 Max Data Transfer Size: 131072 00:15:24.688 Max Number of Namespaces: 32 00:15:24.688 Max Number of I/O Queues: 127 00:15:24.688 NVMe Specification Version (VS): 1.3 00:15:24.688 NVMe Specification Version (Identify): 1.3 00:15:24.688 Maximum Queue Entries: 256 00:15:24.688 Contiguous Queues Required: Yes 00:15:24.688 Arbitration Mechanisms Supported 00:15:24.688 Weighted Round Robin: Not Supported 00:15:24.688 Vendor Specific: Not Supported 00:15:24.688 Reset Timeout: 15000 ms 00:15:24.688 Doorbell Stride: 4 bytes 00:15:24.688 NVM Subsystem Reset: Not Supported 00:15:24.688 Command Sets Supported 00:15:24.688 NVM Command Set: Supported 00:15:24.688 Boot Partition: Not Supported 00:15:24.688 Memory Page Size Minimum: 4096 bytes 00:15:24.688 Memory Page Size Maximum: 4096 bytes 00:15:24.688 Persistent Memory Region: Not Supported 00:15:24.688 Optional Asynchronous Events Supported 00:15:24.688 Namespace Attribute Notices: Supported 00:15:24.688 Firmware Activation Notices: Not Supported 00:15:24.688 ANA Change Notices: Not Supported 00:15:24.688 PLE Aggregate Log Change Notices: Not Supported 00:15:24.688 LBA Status Info Alert Notices: Not Supported 00:15:24.688 EGE Aggregate Log Change Notices: Not Supported 00:15:24.688 Normal NVM Subsystem Shutdown event: Not Supported 00:15:24.688 Zone Descriptor Change Notices: Not Supported 00:15:24.688 Discovery Log Change Notices: Not Supported 00:15:24.688 Controller Attributes 00:15:24.688 128-bit Host Identifier: Supported 00:15:24.688 Non-Operational Permissive Mode: Not Supported 00:15:24.688 NVM Sets: Not Supported 00:15:24.688 Read Recovery Levels: Not Supported 00:15:24.688 Endurance Groups: Not Supported 00:15:24.688 Predictable Latency Mode: Not Supported 00:15:24.688 Traffic Based Keep ALive: Not Supported 00:15:24.688 Namespace Granularity: Not Supported 00:15:24.688 SQ Associations: Not Supported 00:15:24.688 UUID List: Not Supported 00:15:24.688 Multi-Domain Subsystem: Not Supported 00:15:24.688 Fixed Capacity Management: Not Supported 00:15:24.688 Variable Capacity Management: Not Supported 00:15:24.688 Delete Endurance Group: Not Supported 00:15:24.688 Delete NVM Set: Not Supported 00:15:24.688 Extended LBA Formats Supported: Not Supported 00:15:24.688 Flexible Data Placement Supported: Not Supported 00:15:24.688 00:15:24.688 Controller Memory Buffer Support 00:15:24.688 ================================ 00:15:24.688 Supported: No 00:15:24.688 00:15:24.688 Persistent Memory Region Support 00:15:24.688 ================================ 00:15:24.688 Supported: No 00:15:24.688 00:15:24.688 Admin Command Set Attributes 00:15:24.688 ============================ 00:15:24.688 Security Send/Receive: Not Supported 00:15:24.688 Format NVM: Not Supported 00:15:24.688 Firmware Activate/Download: Not Supported 00:15:24.688 Namespace Management: Not Supported 00:15:24.688 Device Self-Test: Not Supported 00:15:24.688 Directives: Not Supported 00:15:24.688 NVMe-MI: Not Supported 00:15:24.688 Virtualization Management: Not Supported 00:15:24.689 Doorbell Buffer Config: Not Supported 00:15:24.689 Get LBA Status Capability: Not Supported 00:15:24.689 Command & Feature Lockdown Capability: Not Supported 00:15:24.689 Abort Command Limit: 4 00:15:24.689 Async Event Request Limit: 4 00:15:24.689 Number of Firmware Slots: N/A 00:15:24.689 Firmware Slot 1 Read-Only: N/A 00:15:24.689 Firmware Activation Without Reset: N/A 00:15:24.689 Multiple Update Detection Support: N/A 00:15:24.689 Firmware Update Granularity: No Information Provided 00:15:24.689 Per-Namespace SMART Log: No 00:15:24.689 Asymmetric Namespace Access Log Page: Not Supported 00:15:24.689 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:24.689 Command Effects Log Page: Supported 00:15:24.689 Get Log Page Extended Data: Supported 00:15:24.689 Telemetry Log Pages: Not Supported 00:15:24.689 Persistent Event Log Pages: Not Supported 00:15:24.689 Supported Log Pages Log Page: May Support 00:15:24.689 Commands Supported & Effects Log Page: Not Supported 00:15:24.689 Feature Identifiers & Effects Log Page:May Support 00:15:24.689 NVMe-MI Commands & Effects Log Page: May Support 00:15:24.689 Data Area 4 for Telemetry Log: Not Supported 00:15:24.689 Error Log Page Entries Supported: 128 00:15:24.689 Keep Alive: Supported 00:15:24.689 Keep Alive Granularity: 10000 ms 00:15:24.689 00:15:24.689 NVM Command Set Attributes 00:15:24.689 ========================== 00:15:24.689 Submission Queue Entry Size 00:15:24.689 Max: 64 00:15:24.689 Min: 64 00:15:24.689 Completion Queue Entry Size 00:15:24.689 Max: 16 00:15:24.689 Min: 16 00:15:24.689 Number of Namespaces: 32 00:15:24.689 Compare Command: Supported 00:15:24.689 Write Uncorrectable Command: Not Supported 00:15:24.689 Dataset Management Command: Supported 00:15:24.689 Write Zeroes Command: Supported 00:15:24.689 Set Features Save Field: Not Supported 00:15:24.689 Reservations: Not Supported 00:15:24.689 Timestamp: Not Supported 00:15:24.689 Copy: Supported 00:15:24.689 Volatile Write Cache: Present 00:15:24.689 Atomic Write Unit (Normal): 1 00:15:24.689 Atomic Write Unit (PFail): 1 00:15:24.689 Atomic Compare & Write Unit: 1 00:15:24.689 Fused Compare & Write: Supported 00:15:24.689 Scatter-Gather List 00:15:24.689 SGL Command Set: Supported (Dword aligned) 00:15:24.689 SGL Keyed: Not Supported 00:15:24.689 SGL Bit Bucket Descriptor: Not Supported 00:15:24.689 SGL Metadata Pointer: Not Supported 00:15:24.689 Oversized SGL: Not Supported 00:15:24.689 SGL Metadata Address: Not Supported 00:15:24.689 SGL Offset: Not Supported 00:15:24.689 Transport SGL Data Block: Not Supported 00:15:24.689 Replay Protected Memory Block: Not Supported 00:15:24.689 00:15:24.689 Firmware Slot Information 00:15:24.689 ========================= 00:15:24.689 Active slot: 1 00:15:24.689 Slot 1 Firmware Revision: 24.01.1 00:15:24.689 00:15:24.689 00:15:24.689 Commands Supported and Effects 00:15:24.689 ============================== 00:15:24.689 Admin Commands 00:15:24.689 -------------- 00:15:24.689 Get Log Page (02h): Supported 00:15:24.689 Identify (06h): Supported 00:15:24.689 Abort (08h): Supported 00:15:24.689 Set Features (09h): Supported 00:15:24.689 Get Features (0Ah): Supported 00:15:24.689 Asynchronous Event Request (0Ch): Supported 00:15:24.689 Keep Alive (18h): Supported 00:15:24.689 I/O Commands 00:15:24.689 ------------ 00:15:24.689 Flush (00h): Supported LBA-Change 00:15:24.689 Write (01h): Supported LBA-Change 00:15:24.689 Read (02h): Supported 00:15:24.689 Compare (05h): Supported 00:15:24.689 Write Zeroes (08h): Supported LBA-Change 00:15:24.689 Dataset Management (09h): Supported LBA-Change 00:15:24.689 Copy (19h): Supported LBA-Change 00:15:24.689 Unknown (79h): Supported LBA-Change 00:15:24.689 Unknown (7Ah): Supported 00:15:24.689 00:15:24.689 Error Log 00:15:24.689 ========= 00:15:24.689 00:15:24.689 Arbitration 00:15:24.689 =========== 00:15:24.689 Arbitration Burst: 1 00:15:24.689 00:15:24.689 Power Management 00:15:24.689 ================ 00:15:24.689 Number of Power States: 1 00:15:24.689 Current Power State: Power State #0 00:15:24.689 Power State #0: 00:15:24.689 Max Power: 0.00 W 00:15:24.689 Non-Operational State: Operational 00:15:24.689 Entry Latency: Not Reported 00:15:24.689 Exit Latency: Not Reported 00:15:24.689 Relative Read Throughput: 0 00:15:24.689 Relative Read Latency: 0 00:15:24.689 Relative Write Throughput: 0 00:15:24.689 Relative Write Latency: 0 00:15:24.689 Idle Power: Not Reported 00:15:24.689 Active Power: Not Reported 00:15:24.689 Non-Operational Permissive Mode: Not Supported 00:15:24.689 00:15:24.689 Health Information 00:15:24.689 ================== 00:15:24.689 Critical Warnings: 00:15:24.689 Available Spare Space: OK 00:15:24.689 Temperature: OK 00:15:24.689 Device Reliability: OK 00:15:24.689 Read Only: No 00:15:24.689 Volatile Memory Backup: OK 00:15:24.689 Current Temperature: 0 Kelvin[2024-11-26 04:27:03.657896] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:24.689 [2024-11-26 04:27:03.665699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:24.689 [2024-11-26 04:27:03.665744] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:24.689 [2024-11-26 04:27:03.665761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:24.689 [2024-11-26 04:27:03.665771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:24.689 [2024-11-26 04:27:03.665781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:24.689 [2024-11-26 04:27:03.665790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:24.689 [2024-11-26 04:27:03.665868] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:24.689 [2024-11-26 04:27:03.665889] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:24.689 [2024-11-26 04:27:03.666907] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:24.689 [2024-11-26 04:27:03.666923] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:24.689 [2024-11-26 04:27:03.667874] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:24.689 [2024-11-26 04:27:03.667899] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:24.689 [2024-11-26 04:27:03.667950] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:24.690 [2024-11-26 04:27:03.669146] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:24.690 (-273 Celsius) 00:15:24.690 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:24.690 Available Spare: 0% 00:15:24.690 Available Spare Threshold: 0% 00:15:24.690 Life Percentage Used: 0% 00:15:24.690 Data Units Read: 0 00:15:24.690 Data Units Written: 0 00:15:24.690 Host Read Commands: 0 00:15:24.690 Host Write Commands: 0 00:15:24.690 Controller Busy Time: 0 minutes 00:15:24.690 Power Cycles: 0 00:15:24.690 Power On Hours: 0 hours 00:15:24.690 Unsafe Shutdowns: 0 00:15:24.690 Unrecoverable Media Errors: 0 00:15:24.690 Lifetime Error Log Entries: 0 00:15:24.690 Warning Temperature Time: 0 minutes 00:15:24.690 Critical Temperature Time: 0 minutes 00:15:24.690 00:15:24.690 Number of Queues 00:15:24.690 ================ 00:15:24.690 Number of I/O Submission Queues: 127 00:15:24.690 Number of I/O Completion Queues: 127 00:15:24.690 00:15:24.690 Active Namespaces 00:15:24.690 ================= 00:15:24.690 Namespace ID:1 00:15:24.690 Error Recovery Timeout: Unlimited 00:15:24.690 Command Set Identifier: NVM (00h) 00:15:24.690 Deallocate: Supported 00:15:24.690 Deallocated/Unwritten Error: Not Supported 00:15:24.690 Deallocated Read Value: Unknown 00:15:24.690 Deallocate in Write Zeroes: Not Supported 00:15:24.690 Deallocated Guard Field: 0xFFFF 00:15:24.690 Flush: Supported 00:15:24.690 Reservation: Supported 00:15:24.690 Namespace Sharing Capabilities: Multiple Controllers 00:15:24.690 Size (in LBAs): 131072 (0GiB) 00:15:24.690 Capacity (in LBAs): 131072 (0GiB) 00:15:24.690 Utilization (in LBAs): 131072 (0GiB) 00:15:24.690 NGUID: 0984CEC10AD045258321C2EDDE9C5975 00:15:24.690 UUID: 0984cec1-0ad0-4525-8321-c2edde9c5975 00:15:24.690 Thin Provisioning: Not Supported 00:15:24.690 Per-NS Atomic Units: Yes 00:15:24.690 Atomic Boundary Size (Normal): 0 00:15:24.690 Atomic Boundary Size (PFail): 0 00:15:24.690 Atomic Boundary Offset: 0 00:15:24.690 Maximum Single Source Range Length: 65535 00:15:24.690 Maximum Copy Length: 65535 00:15:24.690 Maximum Source Range Count: 1 00:15:24.690 NGUID/EUI64 Never Reused: No 00:15:24.690 Namespace Write Protected: No 00:15:24.690 Number of LBA Formats: 1 00:15:24.690 Current LBA Format: LBA Format #00 00:15:24.690 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:24.690 00:15:24.690 04:27:03 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:24.690 EAL: No free 2048 kB hugepages reported on node 1 00:15:30.000 Initializing NVMe Controllers 00:15:30.000 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:30.000 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:30.000 Initialization complete. Launching workers. 00:15:30.000 ======================================================== 00:15:30.000 Latency(us) 00:15:30.000 Device Information : IOPS MiB/s Average min max 00:15:30.000 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 38506.29 150.42 3323.80 1149.02 9653.03 00:15:30.000 ======================================================== 00:15:30.000 Total : 38506.29 150.42 3323.80 1149.02 9653.03 00:15:30.000 00:15:30.000 04:27:09 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:30.000 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.280 Initializing NVMe Controllers 00:15:35.280 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:35.280 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:35.280 Initialization complete. Launching workers. 00:15:35.280 ======================================================== 00:15:35.280 Latency(us) 00:15:35.280 Device Information : IOPS MiB/s Average min max 00:15:35.280 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36536.12 142.72 3502.96 1175.64 10554.58 00:15:35.280 ======================================================== 00:15:35.280 Total : 36536.12 142.72 3502.96 1175.64 10554.58 00:15:35.280 00:15:35.280 04:27:14 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:35.280 EAL: No free 2048 kB hugepages reported on node 1 00:15:40.554 Initializing NVMe Controllers 00:15:40.554 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:40.554 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:40.554 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:15:40.554 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:15:40.554 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:15:40.554 Initialization complete. Launching workers. 00:15:40.554 Starting thread on core 2 00:15:40.554 Starting thread on core 3 00:15:40.554 Starting thread on core 1 00:15:40.554 04:27:19 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:15:40.554 EAL: No free 2048 kB hugepages reported on node 1 00:15:43.847 Initializing NVMe Controllers 00:15:43.847 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:43.847 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:43.847 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:15:43.847 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:15:43.847 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:15:43.847 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:15:43.847 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:43.848 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:43.848 Initialization complete. Launching workers. 00:15:43.848 Starting thread on core 1 with urgent priority queue 00:15:43.848 Starting thread on core 2 with urgent priority queue 00:15:43.848 Starting thread on core 3 with urgent priority queue 00:15:43.848 Starting thread on core 0 with urgent priority queue 00:15:43.848 SPDK bdev Controller (SPDK2 ) core 0: 6043.33 IO/s 16.55 secs/100000 ios 00:15:43.848 SPDK bdev Controller (SPDK2 ) core 1: 6247.67 IO/s 16.01 secs/100000 ios 00:15:43.848 SPDK bdev Controller (SPDK2 ) core 2: 6430.33 IO/s 15.55 secs/100000 ios 00:15:43.848 SPDK bdev Controller (SPDK2 ) core 3: 4787.67 IO/s 20.89 secs/100000 ios 00:15:43.848 ======================================================== 00:15:43.848 00:15:43.848 04:27:23 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:44.107 EAL: No free 2048 kB hugepages reported on node 1 00:15:44.366 Initializing NVMe Controllers 00:15:44.366 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:44.366 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:44.366 Namespace ID: 1 size: 0GB 00:15:44.366 Initialization complete. 00:15:44.366 INFO: using host memory buffer for IO 00:15:44.366 Hello world! 00:15:44.366 04:27:23 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:44.366 EAL: No free 2048 kB hugepages reported on node 1 00:15:45.745 Initializing NVMe Controllers 00:15:45.745 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:45.745 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:45.745 Initialization complete. Launching workers. 00:15:45.745 submit (in ns) avg, min, max = 9337.2, 3481.1, 6995387.8 00:15:45.745 complete (in ns) avg, min, max = 23842.0, 2051.1, 5996697.8 00:15:45.745 00:15:45.745 Submit histogram 00:15:45.745 ================ 00:15:45.745 Range in us Cumulative Count 00:15:45.745 3.461 - 3.484: 0.0147% ( 2) 00:15:45.745 3.484 - 3.508: 0.3088% ( 40) 00:15:45.745 3.508 - 3.532: 1.5806% ( 173) 00:15:45.745 3.532 - 3.556: 4.4479% ( 390) 00:15:45.745 3.556 - 3.579: 10.5205% ( 826) 00:15:45.745 3.579 - 3.603: 19.2619% ( 1189) 00:15:45.745 3.603 - 3.627: 29.9221% ( 1450) 00:15:45.745 3.627 - 3.650: 41.0013% ( 1507) 00:15:45.745 3.650 - 3.674: 48.9928% ( 1087) 00:15:45.745 3.674 - 3.698: 55.4992% ( 885) 00:15:45.745 3.698 - 3.721: 60.4911% ( 679) 00:15:45.745 3.721 - 3.745: 65.3801% ( 665) 00:15:45.745 3.745 - 3.769: 69.4236% ( 550) 00:15:45.745 3.769 - 3.793: 72.7172% ( 448) 00:15:45.745 3.793 - 3.816: 75.6580% ( 400) 00:15:45.745 3.816 - 3.840: 78.5693% ( 396) 00:15:45.745 3.840 - 3.864: 82.3555% ( 515) 00:15:45.745 3.864 - 3.887: 85.7668% ( 464) 00:15:45.745 3.887 - 3.911: 87.9577% ( 298) 00:15:45.745 3.911 - 3.935: 89.7809% ( 248) 00:15:45.745 3.935 - 3.959: 91.3910% ( 219) 00:15:45.745 3.959 - 3.982: 92.8908% ( 204) 00:15:45.745 3.982 - 4.006: 94.2435% ( 184) 00:15:45.745 4.006 - 4.030: 95.2875% ( 142) 00:15:45.745 4.030 - 4.053: 95.9418% ( 89) 00:15:45.745 4.053 - 4.077: 96.3682% ( 58) 00:15:45.745 4.077 - 4.101: 96.6108% ( 33) 00:15:45.745 4.101 - 4.124: 96.8387% ( 31) 00:15:45.745 4.124 - 4.148: 96.9343% ( 13) 00:15:45.745 4.148 - 4.172: 96.9931% ( 8) 00:15:45.745 4.172 - 4.196: 97.0446% ( 7) 00:15:45.745 4.196 - 4.219: 97.1401% ( 13) 00:15:45.745 4.219 - 4.243: 97.3166% ( 24) 00:15:45.745 4.243 - 4.267: 97.3901% ( 10) 00:15:45.745 4.267 - 4.290: 97.4636% ( 10) 00:15:45.745 4.290 - 4.314: 97.4930% ( 4) 00:15:45.745 4.314 - 4.338: 97.5224% ( 4) 00:15:45.745 4.361 - 4.385: 97.5298% ( 1) 00:15:45.745 4.409 - 4.433: 97.5371% ( 1) 00:15:45.745 4.433 - 4.456: 97.5592% ( 3) 00:15:45.745 4.504 - 4.527: 97.5665% ( 1) 00:15:45.745 4.551 - 4.575: 97.5812% ( 2) 00:15:45.745 4.575 - 4.599: 97.5886% ( 1) 00:15:45.745 4.599 - 4.622: 97.5959% ( 1) 00:15:45.745 4.622 - 4.646: 97.6180% ( 3) 00:15:45.745 4.670 - 4.693: 97.6401% ( 3) 00:15:45.745 4.693 - 4.717: 97.6548% ( 2) 00:15:45.745 4.717 - 4.741: 97.6842% ( 4) 00:15:45.745 4.764 - 4.788: 97.7283% ( 6) 00:15:45.745 4.788 - 4.812: 97.7503% ( 3) 00:15:45.745 4.812 - 4.836: 97.8165% ( 9) 00:15:45.745 4.836 - 4.859: 97.8900% ( 10) 00:15:45.745 4.859 - 4.883: 97.9562% ( 9) 00:15:45.745 4.883 - 4.907: 97.9929% ( 5) 00:15:45.745 4.907 - 4.930: 98.0665% ( 10) 00:15:45.745 4.930 - 4.954: 98.1326% ( 9) 00:15:45.745 4.954 - 4.978: 98.1473% ( 2) 00:15:45.745 4.978 - 5.001: 98.1988% ( 7) 00:15:45.745 5.001 - 5.025: 98.2208% ( 3) 00:15:45.745 5.025 - 5.049: 98.2576% ( 5) 00:15:45.745 5.049 - 5.073: 98.2797% ( 3) 00:15:45.745 5.073 - 5.096: 98.2944% ( 2) 00:15:45.745 5.096 - 5.120: 98.3017% ( 1) 00:15:45.745 5.120 - 5.144: 98.3164% ( 2) 00:15:45.745 5.144 - 5.167: 98.3311% ( 2) 00:15:45.745 5.167 - 5.191: 98.3385% ( 1) 00:15:45.745 5.191 - 5.215: 98.3458% ( 1) 00:15:45.745 5.215 - 5.239: 98.3532% ( 1) 00:15:45.745 5.239 - 5.262: 98.3679% ( 2) 00:15:45.745 5.262 - 5.286: 98.3752% ( 1) 00:15:45.745 5.310 - 5.333: 98.3826% ( 1) 00:15:45.745 5.641 - 5.665: 98.3899% ( 1) 00:15:45.745 5.784 - 5.807: 98.3973% ( 1) 00:15:45.745 5.855 - 5.879: 98.4046% ( 1) 00:15:45.745 6.068 - 6.116: 98.4120% ( 1) 00:15:45.745 6.163 - 6.210: 98.4194% ( 1) 00:15:45.745 6.305 - 6.353: 98.4267% ( 1) 00:15:45.745 6.542 - 6.590: 98.4341% ( 1) 00:15:45.745 6.684 - 6.732: 98.4488% ( 2) 00:15:45.745 7.064 - 7.111: 98.4561% ( 1) 00:15:45.745 7.159 - 7.206: 98.4635% ( 1) 00:15:45.745 7.206 - 7.253: 98.4708% ( 1) 00:15:45.745 7.253 - 7.301: 98.4782% ( 1) 00:15:45.745 7.348 - 7.396: 98.4929% ( 2) 00:15:45.745 7.396 - 7.443: 98.5002% ( 1) 00:15:45.745 7.490 - 7.538: 98.5076% ( 1) 00:15:45.745 7.538 - 7.585: 98.5149% ( 1) 00:15:45.745 7.585 - 7.633: 98.5223% ( 1) 00:15:45.745 7.633 - 7.680: 98.5296% ( 1) 00:15:45.745 7.727 - 7.775: 98.5370% ( 1) 00:15:45.745 7.775 - 7.822: 98.5443% ( 1) 00:15:45.745 7.870 - 7.917: 98.5590% ( 2) 00:15:45.745 7.964 - 8.012: 98.5737% ( 2) 00:15:45.745 8.059 - 8.107: 98.6031% ( 4) 00:15:45.745 8.249 - 8.296: 98.6105% ( 1) 00:15:45.745 8.296 - 8.344: 98.6179% ( 1) 00:15:45.745 8.391 - 8.439: 98.6252% ( 1) 00:15:45.745 8.439 - 8.486: 98.6326% ( 1) 00:15:45.745 8.533 - 8.581: 98.6473% ( 2) 00:15:45.745 8.723 - 8.770: 98.6546% ( 1) 00:15:45.745 8.818 - 8.865: 98.6620% ( 1) 00:15:45.745 8.960 - 9.007: 98.6767% ( 2) 00:15:45.745 9.150 - 9.197: 98.6840% ( 1) 00:15:45.745 9.197 - 9.244: 98.7061% ( 3) 00:15:45.745 9.387 - 9.434: 98.7355% ( 4) 00:15:45.745 9.434 - 9.481: 98.7428% ( 1) 00:15:45.745 9.671 - 9.719: 98.7502% ( 1) 00:15:45.745 9.719 - 9.766: 98.7575% ( 1) 00:15:45.745 9.813 - 9.861: 98.7722% ( 2) 00:15:45.745 9.861 - 9.908: 98.7796% ( 1) 00:15:45.745 9.956 - 10.003: 98.7869% ( 1) 00:15:45.745 10.193 - 10.240: 98.7943% ( 1) 00:15:45.745 10.382 - 10.430: 98.8090% ( 2) 00:15:45.745 10.430 - 10.477: 98.8164% ( 1) 00:15:45.745 10.477 - 10.524: 98.8237% ( 1) 00:15:45.745 10.572 - 10.619: 98.8384% ( 2) 00:15:45.745 10.714 - 10.761: 98.8531% ( 2) 00:15:45.745 10.951 - 10.999: 98.8605% ( 1) 00:15:45.745 11.188 - 11.236: 98.8678% ( 1) 00:15:45.745 11.378 - 11.425: 98.8752% ( 1) 00:15:45.745 11.425 - 11.473: 98.8899% ( 2) 00:15:45.745 11.662 - 11.710: 98.8972% ( 1) 00:15:45.745 11.804 - 11.852: 98.9046% ( 1) 00:15:45.745 11.899 - 11.947: 98.9119% ( 1) 00:15:45.745 12.041 - 12.089: 98.9193% ( 1) 00:15:45.745 12.231 - 12.326: 98.9340% ( 2) 00:15:45.745 12.516 - 12.610: 98.9487% ( 2) 00:15:45.745 12.610 - 12.705: 98.9560% ( 1) 00:15:45.745 12.895 - 12.990: 98.9634% ( 1) 00:15:45.745 13.084 - 13.179: 98.9707% ( 1) 00:15:45.745 13.179 - 13.274: 98.9854% ( 2) 00:15:45.745 13.369 - 13.464: 98.9928% ( 1) 00:15:45.745 13.748 - 13.843: 99.0075% ( 2) 00:15:45.745 13.938 - 14.033: 99.0149% ( 1) 00:15:45.745 14.222 - 14.317: 99.0296% ( 2) 00:15:45.745 14.412 - 14.507: 99.0369% ( 1) 00:15:45.745 16.972 - 17.067: 99.0516% ( 2) 00:15:45.745 17.067 - 17.161: 99.0663% ( 2) 00:15:45.745 17.256 - 17.351: 99.0810% ( 2) 00:15:45.745 17.351 - 17.446: 99.0957% ( 2) 00:15:45.745 17.446 - 17.541: 99.1325% ( 5) 00:15:45.745 17.541 - 17.636: 99.1472% ( 2) 00:15:45.745 17.636 - 17.730: 99.1913% ( 6) 00:15:45.745 17.730 - 17.825: 99.2281% ( 5) 00:15:45.745 17.825 - 17.920: 99.2942% ( 9) 00:15:45.745 17.920 - 18.015: 99.3016% ( 1) 00:15:45.745 18.015 - 18.110: 99.3457% ( 6) 00:15:45.745 18.110 - 18.204: 99.4266% ( 11) 00:15:45.745 18.204 - 18.299: 99.4854% ( 8) 00:15:45.745 18.299 - 18.394: 99.5442% ( 8) 00:15:45.745 18.394 - 18.489: 99.5883% ( 6) 00:15:45.745 18.489 - 18.584: 99.6398% ( 7) 00:15:45.745 18.584 - 18.679: 99.6986% ( 8) 00:15:45.745 18.773 - 18.868: 99.7133% ( 2) 00:15:45.746 18.868 - 18.963: 99.7574% ( 6) 00:15:45.746 19.247 - 19.342: 99.7647% ( 1) 00:15:45.746 19.342 - 19.437: 99.7794% ( 2) 00:15:45.746 20.764 - 20.859: 99.7868% ( 1) 00:15:45.746 21.618 - 21.713: 99.7941% ( 1) 00:15:45.746 22.566 - 22.661: 99.8162% ( 3) 00:15:45.746 22.756 - 22.850: 99.8236% ( 1) 00:15:45.746 23.324 - 23.419: 99.8309% ( 1) 00:15:45.746 23.514 - 23.609: 99.8383% ( 1) 00:15:45.746 24.273 - 24.462: 99.8456% ( 1) 00:15:45.746 25.410 - 25.600: 99.8530% ( 1) 00:15:45.746 25.600 - 25.790: 99.8603% ( 1) 00:15:45.746 27.117 - 27.307: 99.8677% ( 1) 00:15:45.746 3021.938 - 3034.074: 99.8750% ( 1) 00:15:45.746 3980.705 - 4004.978: 99.9191% ( 6) 00:15:45.746 4004.978 - 4029.250: 99.9926% ( 10) 00:15:45.746 6990.507 - 7039.052: 100.0000% ( 1) 00:15:45.746 00:15:45.746 Complete histogram 00:15:45.746 ================== 00:15:45.746 Range in us Cumulative Count 00:15:45.746 2.050 - 2.062: 2.0071% ( 273) 00:15:45.746 2.062 - 2.074: 14.4317% ( 1690) 00:15:45.746 2.074 - 2.086: 18.2326% ( 517) 00:15:45.746 2.086 - 2.098: 35.0684% ( 2290) 00:15:45.746 2.098 - 2.110: 59.8074% ( 3365) 00:15:45.746 2.110 - 2.121: 64.4538% ( 632) 00:15:45.746 2.121 - 2.133: 67.4607% ( 409) 00:15:45.746 2.133 - 2.145: 71.0631% ( 490) 00:15:45.746 2.145 - 2.157: 72.4893% ( 194) 00:15:45.746 2.157 - 2.169: 81.4733% ( 1222) 00:15:45.746 2.169 - 2.181: 88.8619% ( 1005) 00:15:45.746 2.181 - 2.193: 90.6484% ( 243) 00:15:45.746 2.193 - 2.204: 92.1923% ( 210) 00:15:45.746 2.204 - 2.216: 93.0598% ( 118) 00:15:45.746 2.216 - 2.228: 93.7803% ( 98) 00:15:45.746 2.228 - 2.240: 95.0228% ( 169) 00:15:45.746 2.240 - 2.252: 95.7212% ( 95) 00:15:45.746 2.252 - 2.264: 95.9197% ( 27) 00:15:45.746 2.264 - 2.276: 96.0447% ( 17) 00:15:45.746 2.276 - 2.287: 96.1550% ( 15) 00:15:45.746 2.287 - 2.299: 96.2211% ( 9) 00:15:45.746 2.299 - 2.311: 96.3020% ( 11) 00:15:45.746 2.311 - 2.323: 96.3829% ( 11) 00:15:45.746 2.323 - 2.335: 96.4858% ( 14) 00:15:45.746 2.335 - 2.347: 96.6255% ( 19) 00:15:45.746 2.347 - 2.359: 96.8093% ( 25) 00:15:45.746 2.359 - 2.370: 97.0298% ( 30) 00:15:45.746 2.370 - 2.382: 97.2651% ( 32) 00:15:45.746 2.382 - 2.394: 97.5665% ( 41) 00:15:45.746 2.394 - 2.406: 97.8312% ( 36) 00:15:45.746 2.406 - 2.418: 98.0297% ( 27) 00:15:45.746 2.418 - 2.430: 98.1988% ( 23) 00:15:45.746 2.430 - 2.441: 98.3311% ( 18) 00:15:45.746 2.441 - 2.453: 98.4194% ( 12) 00:15:45.746 2.453 - 2.465: 98.4782% ( 8) 00:15:45.746 2.465 - 2.477: 98.5296% ( 7) 00:15:45.746 2.477 - 2.489: 98.5517% ( 3) 00:15:45.746 2.489 - 2.501: 98.5664% ( 2) 00:15:45.746 2.501 - 2.513: 98.5737% ( 1) 00:15:45.746 2.513 - 2.524: 98.5958% ( 3) 00:15:45.746 2.524 - 2.536: 98.6031% ( 1) 00:15:45.746 2.536 - 2.548: 98.6179% ( 2) 00:15:45.746 2.560 - 2.572: 98.6252% ( 1) 00:15:45.746 2.607 - 2.619: 98.6473% ( 3) 00:15:45.746 2.643 - 2.655: 98.6546% ( 1) 00:15:45.746 2.714 - 2.726: 98.6620% ( 1) 00:15:45.746 2.951 - 2.963: 98.6693% ( 1) 00:15:45.746 3.247 - 3.271: 98.6767% ( 1) 00:15:45.746 3.319 - 3.342: 98.6840% ( 1) 00:15:45.746 3.390 - 3.413: 98.6914% ( 1) 00:15:45.746 3.413 - 3.437: 98.7061% ( 2) 00:15:45.746 3.437 - 3.461: 98.7134% ( 1) 00:15:45.746 3.461 - 3.484: 98.7208% ( 1) 00:15:45.746 3.484 - 3.508: 98.7355% ( 2) 00:15:45.746 3.556 - 3.579: 98.7575% ( 3) 00:15:45.746 3.603 - 3.627: 98.7649% ( 1) 00:15:45.746 3.627 - 3.650: 98.7796% ( 2) 00:15:45.746 3.650 - 3.674: 98.7869% ( 1) 00:15:45.746 3.674 - 3.698: 98.7943% ( 1) 00:15:45.746 3.698 - 3.721: 98.8016% ( 1) 00:15:45.746 3.745 - 3.769: 98.8090% ( 1) 00:15:45.746 3.793 - 3.816: 98.8164% ( 1) 00:15:45.746 3.887 - 3.911: 98.8237% ( 1) 00:15:45.746 3.911 - 3.935: 98.8384% ( 2) 00:15:45.746 4.101 - 4.124: 98.8458% ( 1) 00:15:45.746 4.551 - 4.575: 98.8531% ( 1) 00:15:45.746 5.144 - 5.167: 98.8605% ( 1) 00:15:45.746 5.357 - 5.381: 98.8752% ( 2) 00:15:45.746 5.381 - 5.404: 98.8825% ( 1) 00:15:45.746 6.163 - 6.210: 98.9046% ( 3) 00:15:45.746 6.210 - 6.258: 98.9119% ( 1) 00:15:45.746 6.590 - 6.637: 98.9193% ( 1) 00:15:45.746 6.732 - 6.779: 98.9266% ( 1) 00:15:45.746 6.827 - 6.874: 98.9340% ( 1) 00:15:45.746 6.874 - 6.921: 98.9487% ( 2) 00:15:45.746 6.921 - 6.969: 98.9560% ( 1) 00:15:45.746 7.064 - 7.111: 98.9634% ( 1) 00:15:45.746 7.159 - 7.206: 98.9707% ( 1) 00:15:45.746 7.253 - 7.301: 98.9781% ( 1) 00:15:45.746 7.680 - 7.727: 98.9854% ( 1) 00:15:45.746 7.727 - 7.775: 98.9928% ( 1) 00:15:45.746 7.964 - 8.012: 99.0001% ( 1) 00:15:45.746 8.296 - 8.344: 99.0075% ( 1) 00:15:45.746 9.244 - 9.292: 99.0149% ( 1) 00:15:45.746 9.387 - 9.434: 99.0222% ( 1) 00:15:45.746 15.360 - 15.455: 99.0296% ( 1) 00:15:45.746 15.644 - 15.739: 99.0369% ( 1) 00:15:45.746 15.739 - 15.834: 99.0516% ( 2) 00:15:45.746 15.834 - 15.929: 99.0663% ( 2) 00:15:45.746 15.929 - 16.024: 99.0884% ( 3) 00:15:45.746 16.024 - 16.119: 99.1104% ( 3) 00:15:45.746 16.213 - 16.308: 99.1325% ( 3) 00:15:45.746 16.308 - 16.403: 99.1472% ( 2) 00:15:45.746 16.403 - 16.498: 99.1839% ( 5) 00:15:45.746 16.498 - 16.593: 99.2428% ( 8) 00:15:45.746 16.593 - 16.687: 99.2722% ( 4) 00:15:45.746 16.687 - 16.782: 99.2869% ( 2) 00:15:45.746 16.782 - 16.877: 99.3016% ( 2) 00:15:45.746 16.877 - 16.972: 99.3383% ( 5) 00:15:45.746 16.972 - 17.067: 99.3604% ( 3) 00:15:45.746 17.067 - 17.161: 99.3824% ( 3) 00:15:45.746 17.256 - 17.351: 99.4045% ( 3) 00:15:45.746 17.446 - 17.541: 99.4119% ( 1) 00:15:45.746 17.541 - 17.636: 99.4192% ( 1) 00:15:45.746 17.825 - 17.920: 99.4266% ( 1) 00:15:45.746 18.015 - 18.110: 99.4339% ( 1) 00:15:45.746 18.110 - 18.204: 99.4486% ( 2) 00:15:45.746 18.204 - 18.299: 99.4560% ( 1) 00:15:45.746 18.299 - 18.394: 99.4633% ( 1) 00:15:45.746 2026.761 - 2038.898: 99.4707% ( 1) 00:15:45.746 3980.705 - 4004.978: 99.7794% ( 42) 00:15:45.746 4004.978 - 4029.250: 99.9706% ( 26) 00:15:45.746 4029.250 - 4053.523: 99.9779% ( 1) 00:15:45.746 4053.523 - 4077.796: 99.9853% ( 1) 00:15:45.746 5995.330 - 6019.603: 100.0000% ( 2) 00:15:45.746 00:15:45.746 04:27:24 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:15:45.746 04:27:24 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:45.746 04:27:24 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:15:45.746 04:27:24 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:15:45.746 04:27:24 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:46.005 [ 00:15:46.005 { 00:15:46.005 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:46.005 "subtype": "Discovery", 00:15:46.005 "listen_addresses": [], 00:15:46.005 "allow_any_host": true, 00:15:46.005 "hosts": [] 00:15:46.005 }, 00:15:46.005 { 00:15:46.005 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:46.005 "subtype": "NVMe", 00:15:46.005 "listen_addresses": [ 00:15:46.005 { 00:15:46.005 "transport": "VFIOUSER", 00:15:46.005 "trtype": "VFIOUSER", 00:15:46.005 "adrfam": "IPv4", 00:15:46.005 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:46.005 "trsvcid": "0" 00:15:46.005 } 00:15:46.005 ], 00:15:46.005 "allow_any_host": true, 00:15:46.005 "hosts": [], 00:15:46.005 "serial_number": "SPDK1", 00:15:46.005 "model_number": "SPDK bdev Controller", 00:15:46.005 "max_namespaces": 32, 00:15:46.005 "min_cntlid": 1, 00:15:46.005 "max_cntlid": 65519, 00:15:46.005 "namespaces": [ 00:15:46.005 { 00:15:46.005 "nsid": 1, 00:15:46.005 "bdev_name": "Malloc1", 00:15:46.005 "name": "Malloc1", 00:15:46.005 "nguid": "C6D004B22C0D49E6AEB1D4ACC5707493", 00:15:46.005 "uuid": "c6d004b2-2c0d-49e6-aeb1-d4acc5707493" 00:15:46.005 }, 00:15:46.005 { 00:15:46.005 "nsid": 2, 00:15:46.005 "bdev_name": "Malloc3", 00:15:46.005 "name": "Malloc3", 00:15:46.005 "nguid": "4DA91A7CBFE248368F6EC573BB8D68B6", 00:15:46.005 "uuid": "4da91a7c-bfe2-4836-8f6e-c573bb8d68b6" 00:15:46.005 } 00:15:46.005 ] 00:15:46.005 }, 00:15:46.005 { 00:15:46.005 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:46.005 "subtype": "NVMe", 00:15:46.005 "listen_addresses": [ 00:15:46.005 { 00:15:46.005 "transport": "VFIOUSER", 00:15:46.005 "trtype": "VFIOUSER", 00:15:46.005 "adrfam": "IPv4", 00:15:46.005 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:46.005 "trsvcid": "0" 00:15:46.005 } 00:15:46.005 ], 00:15:46.005 "allow_any_host": true, 00:15:46.005 "hosts": [], 00:15:46.005 "serial_number": "SPDK2", 00:15:46.005 "model_number": "SPDK bdev Controller", 00:15:46.005 "max_namespaces": 32, 00:15:46.005 "min_cntlid": 1, 00:15:46.005 "max_cntlid": 65519, 00:15:46.005 "namespaces": [ 00:15:46.005 { 00:15:46.005 "nsid": 1, 00:15:46.005 "bdev_name": "Malloc2", 00:15:46.005 "name": "Malloc2", 00:15:46.005 "nguid": "0984CEC10AD045258321C2EDDE9C5975", 00:15:46.005 "uuid": "0984cec1-0ad0-4525-8321-c2edde9c5975" 00:15:46.005 } 00:15:46.005 ] 00:15:46.005 } 00:15:46.005 ] 00:15:46.005 04:27:24 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:46.005 04:27:24 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2891923 00:15:46.005 04:27:25 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:15:46.005 04:27:25 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:46.005 04:27:25 -- common/autotest_common.sh@1254 -- # local i=0 00:15:46.005 04:27:25 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:46.006 04:27:25 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:46.006 04:27:25 -- common/autotest_common.sh@1265 -- # return 0 00:15:46.006 04:27:25 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:46.006 04:27:25 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:15:46.006 EAL: No free 2048 kB hugepages reported on node 1 00:15:46.265 Malloc4 00:15:46.265 04:27:25 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:15:46.523 04:27:25 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:46.523 Asynchronous Event Request test 00:15:46.523 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:46.523 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:46.523 Registering asynchronous event callbacks... 00:15:46.523 Starting namespace attribute notice tests for all controllers... 00:15:46.523 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:46.523 aer_cb - Changed Namespace 00:15:46.523 Cleaning up... 00:15:46.783 [ 00:15:46.783 { 00:15:46.783 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:46.783 "subtype": "Discovery", 00:15:46.783 "listen_addresses": [], 00:15:46.783 "allow_any_host": true, 00:15:46.783 "hosts": [] 00:15:46.783 }, 00:15:46.783 { 00:15:46.783 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:46.783 "subtype": "NVMe", 00:15:46.783 "listen_addresses": [ 00:15:46.783 { 00:15:46.783 "transport": "VFIOUSER", 00:15:46.783 "trtype": "VFIOUSER", 00:15:46.783 "adrfam": "IPv4", 00:15:46.783 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:46.783 "trsvcid": "0" 00:15:46.783 } 00:15:46.783 ], 00:15:46.783 "allow_any_host": true, 00:15:46.783 "hosts": [], 00:15:46.783 "serial_number": "SPDK1", 00:15:46.783 "model_number": "SPDK bdev Controller", 00:15:46.783 "max_namespaces": 32, 00:15:46.783 "min_cntlid": 1, 00:15:46.783 "max_cntlid": 65519, 00:15:46.783 "namespaces": [ 00:15:46.783 { 00:15:46.783 "nsid": 1, 00:15:46.783 "bdev_name": "Malloc1", 00:15:46.783 "name": "Malloc1", 00:15:46.783 "nguid": "C6D004B22C0D49E6AEB1D4ACC5707493", 00:15:46.783 "uuid": "c6d004b2-2c0d-49e6-aeb1-d4acc5707493" 00:15:46.783 }, 00:15:46.783 { 00:15:46.783 "nsid": 2, 00:15:46.783 "bdev_name": "Malloc3", 00:15:46.783 "name": "Malloc3", 00:15:46.783 "nguid": "4DA91A7CBFE248368F6EC573BB8D68B6", 00:15:46.783 "uuid": "4da91a7c-bfe2-4836-8f6e-c573bb8d68b6" 00:15:46.783 } 00:15:46.783 ] 00:15:46.783 }, 00:15:46.783 { 00:15:46.783 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:46.783 "subtype": "NVMe", 00:15:46.783 "listen_addresses": [ 00:15:46.783 { 00:15:46.783 "transport": "VFIOUSER", 00:15:46.783 "trtype": "VFIOUSER", 00:15:46.783 "adrfam": "IPv4", 00:15:46.783 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:46.783 "trsvcid": "0" 00:15:46.783 } 00:15:46.783 ], 00:15:46.783 "allow_any_host": true, 00:15:46.783 "hosts": [], 00:15:46.783 "serial_number": "SPDK2", 00:15:46.783 "model_number": "SPDK bdev Controller", 00:15:46.783 "max_namespaces": 32, 00:15:46.783 "min_cntlid": 1, 00:15:46.783 "max_cntlid": 65519, 00:15:46.783 "namespaces": [ 00:15:46.783 { 00:15:46.783 "nsid": 1, 00:15:46.783 "bdev_name": "Malloc2", 00:15:46.783 "name": "Malloc2", 00:15:46.783 "nguid": "0984CEC10AD045258321C2EDDE9C5975", 00:15:46.783 "uuid": "0984cec1-0ad0-4525-8321-c2edde9c5975" 00:15:46.783 }, 00:15:46.783 { 00:15:46.783 "nsid": 2, 00:15:46.783 "bdev_name": "Malloc4", 00:15:46.783 "name": "Malloc4", 00:15:46.783 "nguid": "CFBEE9407BA348A586C3A33A8821A87F", 00:15:46.783 "uuid": "cfbee940-7ba3-48a5-86c3-a33a8821a87f" 00:15:46.783 } 00:15:46.783 ] 00:15:46.783 } 00:15:46.783 ] 00:15:46.783 04:27:25 -- target/nvmf_vfio_user.sh@44 -- # wait 2891923 00:15:46.783 04:27:25 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:15:46.783 04:27:25 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2885529 00:15:46.783 04:27:25 -- common/autotest_common.sh@936 -- # '[' -z 2885529 ']' 00:15:46.783 04:27:25 -- common/autotest_common.sh@940 -- # kill -0 2885529 00:15:46.783 04:27:25 -- common/autotest_common.sh@941 -- # uname 00:15:46.783 04:27:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:46.783 04:27:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2885529 00:15:46.783 04:27:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:46.783 04:27:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:46.783 04:27:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2885529' 00:15:46.783 killing process with pid 2885529 00:15:46.783 04:27:25 -- common/autotest_common.sh@955 -- # kill 2885529 00:15:46.783 [2024-11-26 04:27:25.841979] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:15:46.783 04:27:25 -- common/autotest_common.sh@960 -- # wait 2885529 00:15:47.043 04:27:26 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:15:47.043 04:27:26 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:15:47.043 04:27:26 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:15:47.043 04:27:26 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:15:47.043 04:27:26 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:15:47.043 04:27:26 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2892072 00:15:47.043 04:27:26 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:15:47.043 04:27:26 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2892072' 00:15:47.043 Process pid: 2892072 00:15:47.043 04:27:26 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:47.043 04:27:26 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2892072 00:15:47.043 04:27:26 -- common/autotest_common.sh@829 -- # '[' -z 2892072 ']' 00:15:47.043 04:27:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:47.043 04:27:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:47.043 04:27:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:47.043 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:47.043 04:27:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:47.043 04:27:26 -- common/autotest_common.sh@10 -- # set +x 00:15:47.043 [2024-11-26 04:27:26.230038] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:15:47.043 [2024-11-26 04:27:26.231041] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:47.043 [2024-11-26 04:27:26.231099] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:47.043 EAL: No free 2048 kB hugepages reported on node 1 00:15:47.301 [2024-11-26 04:27:26.297418] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:47.301 [2024-11-26 04:27:26.389580] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:47.301 [2024-11-26 04:27:26.389738] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:47.301 [2024-11-26 04:27:26.389758] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:47.301 [2024-11-26 04:27:26.389771] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:47.301 [2024-11-26 04:27:26.389831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:47.301 [2024-11-26 04:27:26.389866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:47.301 [2024-11-26 04:27:26.389899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:47.301 [2024-11-26 04:27:26.389902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:47.301 [2024-11-26 04:27:26.483962] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:15:47.301 [2024-11-26 04:27:26.484229] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:15:47.301 [2024-11-26 04:27:26.484487] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:15:47.301 [2024-11-26 04:27:26.485147] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:15:47.301 [2024-11-26 04:27:26.485245] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:15:48.236 04:27:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:48.236 04:27:27 -- common/autotest_common.sh@862 -- # return 0 00:15:48.236 04:27:27 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:49.170 04:27:28 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:15:49.429 04:27:28 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:49.429 04:27:28 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:49.429 04:27:28 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:49.429 04:27:28 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:49.429 04:27:28 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:49.688 Malloc1 00:15:49.688 04:27:28 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:49.946 04:27:29 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:50.203 04:27:29 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:50.461 04:27:29 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:50.461 04:27:29 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:50.461 04:27:29 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:50.720 Malloc2 00:15:50.720 04:27:29 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:50.978 04:27:30 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:51.236 04:27:30 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:51.495 04:27:30 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:15:51.495 04:27:30 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2892072 00:15:51.495 04:27:30 -- common/autotest_common.sh@936 -- # '[' -z 2892072 ']' 00:15:51.495 04:27:30 -- common/autotest_common.sh@940 -- # kill -0 2892072 00:15:51.495 04:27:30 -- common/autotest_common.sh@941 -- # uname 00:15:51.495 04:27:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:51.495 04:27:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2892072 00:15:51.495 04:27:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:51.495 04:27:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:51.495 04:27:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2892072' 00:15:51.495 killing process with pid 2892072 00:15:51.495 04:27:30 -- common/autotest_common.sh@955 -- # kill 2892072 00:15:51.495 04:27:30 -- common/autotest_common.sh@960 -- # wait 2892072 00:15:51.754 04:27:30 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:15:51.754 04:27:30 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:15:51.754 00:15:51.754 real 0m54.111s 00:15:51.754 user 3m33.725s 00:15:51.754 sys 0m4.584s 00:15:51.754 04:27:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:51.754 04:27:30 -- common/autotest_common.sh@10 -- # set +x 00:15:51.754 ************************************ 00:15:51.754 END TEST nvmf_vfio_user 00:15:51.754 ************************************ 00:15:52.014 04:27:30 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:15:52.014 04:27:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:52.014 04:27:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:52.014 04:27:30 -- common/autotest_common.sh@10 -- # set +x 00:15:52.014 ************************************ 00:15:52.014 START TEST nvmf_vfio_user_nvme_compliance 00:15:52.014 ************************************ 00:15:52.014 04:27:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:15:52.014 * Looking for test storage... 00:15:52.014 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:15:52.014 04:27:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:52.014 04:27:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:52.014 04:27:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:52.014 04:27:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:52.014 04:27:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:52.014 04:27:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:52.014 04:27:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:52.014 04:27:31 -- scripts/common.sh@335 -- # IFS=.-: 00:15:52.014 04:27:31 -- scripts/common.sh@335 -- # read -ra ver1 00:15:52.014 04:27:31 -- scripts/common.sh@336 -- # IFS=.-: 00:15:52.014 04:27:31 -- scripts/common.sh@336 -- # read -ra ver2 00:15:52.014 04:27:31 -- scripts/common.sh@337 -- # local 'op=<' 00:15:52.014 04:27:31 -- scripts/common.sh@339 -- # ver1_l=2 00:15:52.014 04:27:31 -- scripts/common.sh@340 -- # ver2_l=1 00:15:52.014 04:27:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:52.014 04:27:31 -- scripts/common.sh@343 -- # case "$op" in 00:15:52.014 04:27:31 -- scripts/common.sh@344 -- # : 1 00:15:52.014 04:27:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:52.014 04:27:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:52.014 04:27:31 -- scripts/common.sh@364 -- # decimal 1 00:15:52.014 04:27:31 -- scripts/common.sh@352 -- # local d=1 00:15:52.014 04:27:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:52.014 04:27:31 -- scripts/common.sh@354 -- # echo 1 00:15:52.014 04:27:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:52.014 04:27:31 -- scripts/common.sh@365 -- # decimal 2 00:15:52.014 04:27:31 -- scripts/common.sh@352 -- # local d=2 00:15:52.014 04:27:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:52.014 04:27:31 -- scripts/common.sh@354 -- # echo 2 00:15:52.014 04:27:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:52.014 04:27:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:52.014 04:27:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:52.014 04:27:31 -- scripts/common.sh@367 -- # return 0 00:15:52.014 04:27:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:52.014 04:27:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:52.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:52.014 --rc genhtml_branch_coverage=1 00:15:52.014 --rc genhtml_function_coverage=1 00:15:52.014 --rc genhtml_legend=1 00:15:52.014 --rc geninfo_all_blocks=1 00:15:52.014 --rc geninfo_unexecuted_blocks=1 00:15:52.014 00:15:52.014 ' 00:15:52.014 04:27:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:52.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:52.014 --rc genhtml_branch_coverage=1 00:15:52.014 --rc genhtml_function_coverage=1 00:15:52.014 --rc genhtml_legend=1 00:15:52.014 --rc geninfo_all_blocks=1 00:15:52.014 --rc geninfo_unexecuted_blocks=1 00:15:52.014 00:15:52.014 ' 00:15:52.014 04:27:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:52.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:52.014 --rc genhtml_branch_coverage=1 00:15:52.014 --rc genhtml_function_coverage=1 00:15:52.014 --rc genhtml_legend=1 00:15:52.014 --rc geninfo_all_blocks=1 00:15:52.014 --rc geninfo_unexecuted_blocks=1 00:15:52.014 00:15:52.014 ' 00:15:52.014 04:27:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:52.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:52.014 --rc genhtml_branch_coverage=1 00:15:52.014 --rc genhtml_function_coverage=1 00:15:52.014 --rc genhtml_legend=1 00:15:52.014 --rc geninfo_all_blocks=1 00:15:52.014 --rc geninfo_unexecuted_blocks=1 00:15:52.014 00:15:52.014 ' 00:15:52.014 04:27:31 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:52.014 04:27:31 -- nvmf/common.sh@7 -- # uname -s 00:15:52.014 04:27:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:52.014 04:27:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:52.014 04:27:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:52.014 04:27:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:52.014 04:27:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:52.014 04:27:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:52.014 04:27:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:52.014 04:27:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:52.014 04:27:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:52.014 04:27:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:52.014 04:27:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:52.014 04:27:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:52.014 04:27:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:52.014 04:27:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:52.014 04:27:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:52.014 04:27:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:52.014 04:27:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:52.014 04:27:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:52.014 04:27:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:52.014 04:27:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.014 04:27:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.014 04:27:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.015 04:27:31 -- paths/export.sh@5 -- # export PATH 00:15:52.015 04:27:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.015 04:27:31 -- nvmf/common.sh@46 -- # : 0 00:15:52.015 04:27:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:52.015 04:27:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:52.015 04:27:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:52.015 04:27:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:52.015 04:27:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:52.015 04:27:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:52.015 04:27:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:52.015 04:27:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:52.015 04:27:31 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:52.015 04:27:31 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:52.015 04:27:31 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:15:52.015 04:27:31 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:15:52.015 04:27:31 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:15:52.015 04:27:31 -- compliance/compliance.sh@20 -- # nvmfpid=2892819 00:15:52.015 04:27:31 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:15:52.015 04:27:31 -- compliance/compliance.sh@21 -- # echo 'Process pid: 2892819' 00:15:52.015 Process pid: 2892819 00:15:52.015 04:27:31 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:52.015 04:27:31 -- compliance/compliance.sh@24 -- # waitforlisten 2892819 00:15:52.015 04:27:31 -- common/autotest_common.sh@829 -- # '[' -z 2892819 ']' 00:15:52.015 04:27:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:52.015 04:27:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:52.015 04:27:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:52.015 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:52.015 04:27:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:52.015 04:27:31 -- common/autotest_common.sh@10 -- # set +x 00:15:52.015 [2024-11-26 04:27:31.206107] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:52.015 [2024-11-26 04:27:31.206185] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:52.015 EAL: No free 2048 kB hugepages reported on node 1 00:15:52.275 [2024-11-26 04:27:31.265998] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:52.275 [2024-11-26 04:27:31.354522] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:52.275 [2024-11-26 04:27:31.354706] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:52.275 [2024-11-26 04:27:31.354728] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:52.275 [2024-11-26 04:27:31.354742] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:52.275 [2024-11-26 04:27:31.354810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:52.275 [2024-11-26 04:27:31.354868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:52.275 [2024-11-26 04:27:31.354871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:53.214 04:27:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:53.214 04:27:32 -- common/autotest_common.sh@862 -- # return 0 00:15:53.214 04:27:32 -- compliance/compliance.sh@26 -- # sleep 1 00:15:54.154 04:27:33 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:15:54.154 04:27:33 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:15:54.154 04:27:33 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:15:54.154 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.154 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:15:54.154 04:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.154 04:27:33 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:15:54.154 04:27:33 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:15:54.154 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.154 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:15:54.154 malloc0 00:15:54.154 04:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.154 04:27:33 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:15:54.154 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.154 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:15:54.155 04:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.155 04:27:33 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:15:54.155 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.155 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:15:54.155 04:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.155 04:27:33 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:15:54.155 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:54.155 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:15:54.155 04:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:54.155 04:27:33 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:15:54.155 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.155 00:15:54.155 00:15:54.155 CUnit - A unit testing framework for C - Version 2.1-3 00:15:54.155 http://cunit.sourceforge.net/ 00:15:54.155 00:15:54.155 00:15:54.155 Suite: nvme_compliance 00:15:54.413 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-26 04:27:33.412703] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:15:54.413 [2024-11-26 04:27:33.412766] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:15:54.413 [2024-11-26 04:27:33.412797] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:15:54.413 passed 00:15:54.413 Test: admin_identify_ctrlr_verify_fused ...passed 00:15:54.673 Test: admin_identify_ns ...[2024-11-26 04:27:33.647699] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:15:54.673 [2024-11-26 04:27:33.655701] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:15:54.673 passed 00:15:54.673 Test: admin_get_features_mandatory_features ...passed 00:15:54.673 Test: admin_get_features_optional_features ...passed 00:15:54.933 Test: admin_set_features_number_of_queues ...passed 00:15:55.193 Test: admin_get_log_page_mandatory_logs ...passed 00:15:55.193 Test: admin_get_log_page_with_lpo ...[2024-11-26 04:27:34.279706] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:15:55.193 passed 00:15:55.193 Test: fabric_property_get ...passed 00:15:55.453 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-26 04:27:34.464343] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:15:55.453 passed 00:15:55.453 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-26 04:27:34.633699] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:15:55.453 [2024-11-26 04:27:34.648712] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:15:55.711 passed 00:15:55.711 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-26 04:27:34.738431] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:15:55.711 passed 00:15:55.711 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-26 04:27:34.901712] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:15:55.711 [2024-11-26 04:27:34.925701] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:15:55.970 passed 00:15:55.970 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-26 04:27:35.015812] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:15:55.970 [2024-11-26 04:27:35.015868] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:15:55.970 passed 00:15:55.970 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-26 04:27:35.191702] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:15:56.229 [2024-11-26 04:27:35.199694] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:15:56.229 [2024-11-26 04:27:35.207714] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:15:56.229 [2024-11-26 04:27:35.215695] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:15:56.229 passed 00:15:56.229 Test: admin_create_io_sq_verify_pc ...[2024-11-26 04:27:35.345737] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:15:56.229 passed 00:15:57.611 Test: admin_create_io_qp_max_qps ...[2024-11-26 04:27:36.537703] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:15:57.871 passed 00:15:58.131 Test: admin_create_io_sq_shared_cq ...[2024-11-26 04:27:37.133726] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:15:58.131 passed 00:15:58.131 00:15:58.131 Run Summary: Type Total Ran Passed Failed Inactive 00:15:58.131 suites 1 1 n/a 0 0 00:15:58.131 tests 18 18 18 0 0 00:15:58.131 asserts 360 360 360 0 n/a 00:15:58.131 00:15:58.131 Elapsed time = 1.556 seconds 00:15:58.131 04:27:37 -- compliance/compliance.sh@42 -- # killprocess 2892819 00:15:58.131 04:27:37 -- common/autotest_common.sh@936 -- # '[' -z 2892819 ']' 00:15:58.131 04:27:37 -- common/autotest_common.sh@940 -- # kill -0 2892819 00:15:58.131 04:27:37 -- common/autotest_common.sh@941 -- # uname 00:15:58.131 04:27:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:58.131 04:27:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2892819 00:15:58.131 04:27:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:58.131 04:27:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:58.131 04:27:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2892819' 00:15:58.131 killing process with pid 2892819 00:15:58.131 04:27:37 -- common/autotest_common.sh@955 -- # kill 2892819 00:15:58.131 04:27:37 -- common/autotest_common.sh@960 -- # wait 2892819 00:15:58.388 04:27:37 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:15:58.388 04:27:37 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:15:58.388 00:15:58.388 real 0m6.522s 00:15:58.388 user 0m18.549s 00:15:58.388 sys 0m0.600s 00:15:58.388 04:27:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:58.388 04:27:37 -- common/autotest_common.sh@10 -- # set +x 00:15:58.388 ************************************ 00:15:58.388 END TEST nvmf_vfio_user_nvme_compliance 00:15:58.388 ************************************ 00:15:58.388 04:27:37 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:15:58.388 04:27:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:58.388 04:27:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:58.388 04:27:37 -- common/autotest_common.sh@10 -- # set +x 00:15:58.388 ************************************ 00:15:58.388 START TEST nvmf_vfio_user_fuzz 00:15:58.388 ************************************ 00:15:58.388 04:27:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:15:58.388 * Looking for test storage... 00:15:58.388 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:58.388 04:27:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:58.388 04:27:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:58.388 04:27:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:58.646 04:27:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:58.646 04:27:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:58.646 04:27:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:58.646 04:27:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:58.646 04:27:37 -- scripts/common.sh@335 -- # IFS=.-: 00:15:58.646 04:27:37 -- scripts/common.sh@335 -- # read -ra ver1 00:15:58.646 04:27:37 -- scripts/common.sh@336 -- # IFS=.-: 00:15:58.646 04:27:37 -- scripts/common.sh@336 -- # read -ra ver2 00:15:58.646 04:27:37 -- scripts/common.sh@337 -- # local 'op=<' 00:15:58.646 04:27:37 -- scripts/common.sh@339 -- # ver1_l=2 00:15:58.646 04:27:37 -- scripts/common.sh@340 -- # ver2_l=1 00:15:58.646 04:27:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:58.646 04:27:37 -- scripts/common.sh@343 -- # case "$op" in 00:15:58.646 04:27:37 -- scripts/common.sh@344 -- # : 1 00:15:58.646 04:27:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:58.646 04:27:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:58.646 04:27:37 -- scripts/common.sh@364 -- # decimal 1 00:15:58.646 04:27:37 -- scripts/common.sh@352 -- # local d=1 00:15:58.646 04:27:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:58.646 04:27:37 -- scripts/common.sh@354 -- # echo 1 00:15:58.646 04:27:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:58.646 04:27:37 -- scripts/common.sh@365 -- # decimal 2 00:15:58.646 04:27:37 -- scripts/common.sh@352 -- # local d=2 00:15:58.646 04:27:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:58.646 04:27:37 -- scripts/common.sh@354 -- # echo 2 00:15:58.646 04:27:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:58.646 04:27:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:58.646 04:27:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:58.646 04:27:37 -- scripts/common.sh@367 -- # return 0 00:15:58.646 04:27:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:58.646 04:27:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:58.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:58.646 --rc genhtml_branch_coverage=1 00:15:58.646 --rc genhtml_function_coverage=1 00:15:58.646 --rc genhtml_legend=1 00:15:58.646 --rc geninfo_all_blocks=1 00:15:58.646 --rc geninfo_unexecuted_blocks=1 00:15:58.646 00:15:58.646 ' 00:15:58.646 04:27:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:58.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:58.646 --rc genhtml_branch_coverage=1 00:15:58.646 --rc genhtml_function_coverage=1 00:15:58.646 --rc genhtml_legend=1 00:15:58.646 --rc geninfo_all_blocks=1 00:15:58.646 --rc geninfo_unexecuted_blocks=1 00:15:58.646 00:15:58.646 ' 00:15:58.646 04:27:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:58.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:58.646 --rc genhtml_branch_coverage=1 00:15:58.646 --rc genhtml_function_coverage=1 00:15:58.646 --rc genhtml_legend=1 00:15:58.646 --rc geninfo_all_blocks=1 00:15:58.646 --rc geninfo_unexecuted_blocks=1 00:15:58.646 00:15:58.646 ' 00:15:58.646 04:27:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:58.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:58.646 --rc genhtml_branch_coverage=1 00:15:58.646 --rc genhtml_function_coverage=1 00:15:58.646 --rc genhtml_legend=1 00:15:58.646 --rc geninfo_all_blocks=1 00:15:58.646 --rc geninfo_unexecuted_blocks=1 00:15:58.646 00:15:58.646 ' 00:15:58.646 04:27:37 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:58.646 04:27:37 -- nvmf/common.sh@7 -- # uname -s 00:15:58.646 04:27:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:58.646 04:27:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:58.646 04:27:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:58.646 04:27:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:58.647 04:27:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:58.647 04:27:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:58.647 04:27:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:58.647 04:27:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:58.647 04:27:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:58.647 04:27:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:58.647 04:27:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:58.647 04:27:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:58.647 04:27:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:58.647 04:27:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:58.647 04:27:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:58.647 04:27:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:58.647 04:27:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:58.647 04:27:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:58.647 04:27:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:58.647 04:27:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.647 04:27:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.647 04:27:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.647 04:27:37 -- paths/export.sh@5 -- # export PATH 00:15:58.647 04:27:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.647 04:27:37 -- nvmf/common.sh@46 -- # : 0 00:15:58.647 04:27:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:58.647 04:27:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:58.647 04:27:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:58.647 04:27:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:58.647 04:27:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:58.647 04:27:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:58.647 04:27:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:58.647 04:27:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:58.647 04:27:37 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:58.647 04:27:37 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:58.647 04:27:37 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:15:58.647 04:27:37 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:15:58.647 04:27:37 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:58.647 04:27:37 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:58.647 04:27:37 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:15:58.647 04:27:37 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=2893699 00:15:58.647 04:27:37 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:58.647 04:27:37 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 2893699' 00:15:58.647 Process pid: 2893699 00:15:58.647 04:27:37 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:58.647 04:27:37 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 2893699 00:15:58.647 04:27:37 -- common/autotest_common.sh@829 -- # '[' -z 2893699 ']' 00:15:58.647 04:27:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:58.647 04:27:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:58.647 04:27:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:58.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:58.647 04:27:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:58.647 04:27:37 -- common/autotest_common.sh@10 -- # set +x 00:15:59.583 04:27:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:59.583 04:27:38 -- common/autotest_common.sh@862 -- # return 0 00:15:59.583 04:27:38 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:00.523 04:27:39 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:00.523 04:27:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.523 04:27:39 -- common/autotest_common.sh@10 -- # set +x 00:16:00.783 04:27:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.783 04:27:39 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:00.783 04:27:39 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:00.783 04:27:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.783 04:27:39 -- common/autotest_common.sh@10 -- # set +x 00:16:00.783 malloc0 00:16:00.783 04:27:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.783 04:27:39 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:00.783 04:27:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.783 04:27:39 -- common/autotest_common.sh@10 -- # set +x 00:16:00.783 04:27:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.783 04:27:39 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:00.783 04:27:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.783 04:27:39 -- common/autotest_common.sh@10 -- # set +x 00:16:00.783 04:27:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.783 04:27:39 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:00.783 04:27:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.783 04:27:39 -- common/autotest_common.sh@10 -- # set +x 00:16:00.783 04:27:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.783 04:27:39 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:00.783 04:27:39 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:16:32.918 Fuzzing completed. Shutting down the fuzz application 00:16:32.918 00:16:32.918 Dumping successful admin opcodes: 00:16:32.918 8, 9, 10, 24, 00:16:32.918 Dumping successful io opcodes: 00:16:32.918 0, 00:16:32.918 NS: 0x200003a1ef00 I/O qp, Total commands completed: 595778, total successful commands: 2302, random_seed: 454557376 00:16:32.918 NS: 0x200003a1ef00 admin qp, Total commands completed: 147955, total successful commands: 1193, random_seed: 2879630720 00:16:32.918 04:28:10 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:16:32.918 04:28:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:32.918 04:28:10 -- common/autotest_common.sh@10 -- # set +x 00:16:32.918 04:28:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:32.918 04:28:10 -- target/vfio_user_fuzz.sh@46 -- # killprocess 2893699 00:16:32.918 04:28:10 -- common/autotest_common.sh@936 -- # '[' -z 2893699 ']' 00:16:32.918 04:28:10 -- common/autotest_common.sh@940 -- # kill -0 2893699 00:16:32.918 04:28:10 -- common/autotest_common.sh@941 -- # uname 00:16:32.918 04:28:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:32.918 04:28:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2893699 00:16:32.918 04:28:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:32.918 04:28:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:32.918 04:28:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2893699' 00:16:32.918 killing process with pid 2893699 00:16:32.918 04:28:10 -- common/autotest_common.sh@955 -- # kill 2893699 00:16:32.918 04:28:10 -- common/autotest_common.sh@960 -- # wait 2893699 00:16:32.918 04:28:10 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:16:32.918 04:28:10 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:16:32.918 00:16:32.918 real 0m33.028s 00:16:32.918 user 0m35.051s 00:16:32.918 sys 0m26.168s 00:16:32.918 04:28:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:32.918 04:28:10 -- common/autotest_common.sh@10 -- # set +x 00:16:32.918 ************************************ 00:16:32.918 END TEST nvmf_vfio_user_fuzz 00:16:32.918 ************************************ 00:16:32.918 04:28:10 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:32.918 04:28:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:32.918 04:28:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:32.918 04:28:10 -- common/autotest_common.sh@10 -- # set +x 00:16:32.918 ************************************ 00:16:32.918 START TEST nvmf_host_management 00:16:32.918 ************************************ 00:16:32.918 04:28:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:32.918 * Looking for test storage... 00:16:32.918 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:32.918 04:28:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:32.918 04:28:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:32.918 04:28:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:32.918 04:28:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:32.918 04:28:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:32.918 04:28:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:32.918 04:28:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:32.918 04:28:10 -- scripts/common.sh@335 -- # IFS=.-: 00:16:32.918 04:28:10 -- scripts/common.sh@335 -- # read -ra ver1 00:16:32.918 04:28:10 -- scripts/common.sh@336 -- # IFS=.-: 00:16:32.918 04:28:10 -- scripts/common.sh@336 -- # read -ra ver2 00:16:32.918 04:28:10 -- scripts/common.sh@337 -- # local 'op=<' 00:16:32.918 04:28:10 -- scripts/common.sh@339 -- # ver1_l=2 00:16:32.918 04:28:10 -- scripts/common.sh@340 -- # ver2_l=1 00:16:32.918 04:28:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:32.918 04:28:10 -- scripts/common.sh@343 -- # case "$op" in 00:16:32.918 04:28:10 -- scripts/common.sh@344 -- # : 1 00:16:32.918 04:28:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:32.918 04:28:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:32.918 04:28:10 -- scripts/common.sh@364 -- # decimal 1 00:16:32.918 04:28:10 -- scripts/common.sh@352 -- # local d=1 00:16:32.918 04:28:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:32.918 04:28:10 -- scripts/common.sh@354 -- # echo 1 00:16:32.918 04:28:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:32.918 04:28:10 -- scripts/common.sh@365 -- # decimal 2 00:16:32.918 04:28:10 -- scripts/common.sh@352 -- # local d=2 00:16:32.918 04:28:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:32.918 04:28:10 -- scripts/common.sh@354 -- # echo 2 00:16:32.918 04:28:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:32.918 04:28:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:32.918 04:28:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:32.918 04:28:10 -- scripts/common.sh@367 -- # return 0 00:16:32.918 04:28:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:32.918 04:28:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:32.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:32.918 --rc genhtml_branch_coverage=1 00:16:32.918 --rc genhtml_function_coverage=1 00:16:32.918 --rc genhtml_legend=1 00:16:32.918 --rc geninfo_all_blocks=1 00:16:32.918 --rc geninfo_unexecuted_blocks=1 00:16:32.918 00:16:32.918 ' 00:16:32.918 04:28:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:32.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:32.918 --rc genhtml_branch_coverage=1 00:16:32.918 --rc genhtml_function_coverage=1 00:16:32.918 --rc genhtml_legend=1 00:16:32.918 --rc geninfo_all_blocks=1 00:16:32.918 --rc geninfo_unexecuted_blocks=1 00:16:32.918 00:16:32.918 ' 00:16:32.918 04:28:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:32.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:32.918 --rc genhtml_branch_coverage=1 00:16:32.918 --rc genhtml_function_coverage=1 00:16:32.918 --rc genhtml_legend=1 00:16:32.918 --rc geninfo_all_blocks=1 00:16:32.918 --rc geninfo_unexecuted_blocks=1 00:16:32.918 00:16:32.918 ' 00:16:32.918 04:28:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:32.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:32.918 --rc genhtml_branch_coverage=1 00:16:32.918 --rc genhtml_function_coverage=1 00:16:32.918 --rc genhtml_legend=1 00:16:32.918 --rc geninfo_all_blocks=1 00:16:32.918 --rc geninfo_unexecuted_blocks=1 00:16:32.918 00:16:32.918 ' 00:16:32.918 04:28:10 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:32.918 04:28:10 -- nvmf/common.sh@7 -- # uname -s 00:16:32.918 04:28:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:32.918 04:28:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:32.918 04:28:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:32.918 04:28:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:32.918 04:28:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:32.918 04:28:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:32.918 04:28:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:32.918 04:28:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:32.918 04:28:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:32.918 04:28:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:32.918 04:28:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:32.918 04:28:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:32.918 04:28:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:32.918 04:28:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:32.918 04:28:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:32.918 04:28:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:32.918 04:28:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:32.918 04:28:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:32.918 04:28:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:32.919 04:28:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.919 04:28:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.919 04:28:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.919 04:28:10 -- paths/export.sh@5 -- # export PATH 00:16:32.919 04:28:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.919 04:28:10 -- nvmf/common.sh@46 -- # : 0 00:16:32.919 04:28:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:32.919 04:28:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:32.919 04:28:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:32.919 04:28:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:32.919 04:28:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:32.919 04:28:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:32.919 04:28:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:32.919 04:28:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:32.919 04:28:10 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:32.919 04:28:10 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:32.919 04:28:10 -- target/host_management.sh@104 -- # nvmftestinit 00:16:32.919 04:28:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:32.919 04:28:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:32.919 04:28:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:32.919 04:28:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:32.919 04:28:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:32.919 04:28:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:32.919 04:28:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:32.919 04:28:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:32.919 04:28:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:32.919 04:28:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:32.919 04:28:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:32.919 04:28:10 -- common/autotest_common.sh@10 -- # set +x 00:16:33.861 04:28:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:33.861 04:28:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:33.861 04:28:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:33.861 04:28:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:33.861 04:28:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:33.861 04:28:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:33.861 04:28:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:33.861 04:28:12 -- nvmf/common.sh@294 -- # net_devs=() 00:16:33.861 04:28:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:33.861 04:28:12 -- nvmf/common.sh@295 -- # e810=() 00:16:33.861 04:28:12 -- nvmf/common.sh@295 -- # local -ga e810 00:16:33.861 04:28:12 -- nvmf/common.sh@296 -- # x722=() 00:16:33.861 04:28:12 -- nvmf/common.sh@296 -- # local -ga x722 00:16:33.861 04:28:12 -- nvmf/common.sh@297 -- # mlx=() 00:16:33.861 04:28:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:33.861 04:28:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:33.861 04:28:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:33.861 04:28:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:33.861 04:28:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:33.861 04:28:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:33.861 04:28:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:33.861 04:28:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:33.861 04:28:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:33.861 04:28:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:33.861 04:28:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:33.861 04:28:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:33.861 04:28:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:33.861 04:28:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:33.861 04:28:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:33.861 04:28:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:33.861 04:28:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:33.861 04:28:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:33.861 04:28:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:33.861 04:28:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:33.861 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:33.861 04:28:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:33.861 04:28:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:33.861 04:28:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:33.861 04:28:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:33.861 04:28:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:33.861 04:28:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:33.861 04:28:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:33.862 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:33.862 04:28:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:33.862 04:28:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:33.862 04:28:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:33.862 04:28:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:33.862 04:28:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:33.862 04:28:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:33.862 04:28:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:33.862 04:28:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:33.862 04:28:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:33.862 04:28:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:33.862 04:28:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:33.862 04:28:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:33.862 04:28:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:33.862 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:33.862 04:28:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:33.862 04:28:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:33.862 04:28:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:33.862 04:28:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:33.862 04:28:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:33.862 04:28:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:33.862 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:33.862 04:28:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:33.862 04:28:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:33.862 04:28:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:33.862 04:28:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:33.862 04:28:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:33.862 04:28:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:33.862 04:28:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:33.862 04:28:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:33.862 04:28:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:33.862 04:28:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:33.862 04:28:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:33.862 04:28:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:33.862 04:28:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:33.862 04:28:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:33.862 04:28:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:33.862 04:28:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:33.862 04:28:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:33.862 04:28:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:33.862 04:28:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:33.862 04:28:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:33.862 04:28:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:33.862 04:28:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:33.862 04:28:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:33.862 04:28:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:33.862 04:28:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:33.862 04:28:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:33.862 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:33.862 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.307 ms 00:16:33.862 00:16:33.862 --- 10.0.0.2 ping statistics --- 00:16:33.862 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:33.862 rtt min/avg/max/mdev = 0.307/0.307/0.307/0.000 ms 00:16:33.862 04:28:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:33.862 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:33.862 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.174 ms 00:16:33.862 00:16:33.862 --- 10.0.0.1 ping statistics --- 00:16:33.862 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:33.862 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:16:33.862 04:28:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:33.862 04:28:12 -- nvmf/common.sh@410 -- # return 0 00:16:33.862 04:28:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:33.862 04:28:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:33.862 04:28:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:33.862 04:28:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:33.862 04:28:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:33.862 04:28:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:33.862 04:28:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:33.862 04:28:12 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:16:33.862 04:28:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:16:33.862 04:28:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:33.862 04:28:12 -- common/autotest_common.sh@10 -- # set +x 00:16:33.862 ************************************ 00:16:33.862 START TEST nvmf_host_management 00:16:33.862 ************************************ 00:16:33.862 04:28:12 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:16:33.862 04:28:12 -- target/host_management.sh@69 -- # starttarget 00:16:33.862 04:28:12 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:16:33.862 04:28:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:33.862 04:28:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:33.862 04:28:12 -- common/autotest_common.sh@10 -- # set +x 00:16:33.862 04:28:12 -- nvmf/common.sh@469 -- # nvmfpid=2899305 00:16:33.862 04:28:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:16:33.862 04:28:12 -- nvmf/common.sh@470 -- # waitforlisten 2899305 00:16:33.862 04:28:12 -- common/autotest_common.sh@829 -- # '[' -z 2899305 ']' 00:16:33.862 04:28:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:33.862 04:28:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:33.862 04:28:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:33.862 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:33.862 04:28:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:33.862 04:28:12 -- common/autotest_common.sh@10 -- # set +x 00:16:33.862 [2024-11-26 04:28:12.989170] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:33.862 [2024-11-26 04:28:12.989255] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:33.862 EAL: No free 2048 kB hugepages reported on node 1 00:16:33.862 [2024-11-26 04:28:13.054101] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:34.121 [2024-11-26 04:28:13.139955] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:34.121 [2024-11-26 04:28:13.140102] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:34.121 [2024-11-26 04:28:13.140119] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:34.121 [2024-11-26 04:28:13.140131] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:34.121 [2024-11-26 04:28:13.140224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:34.121 [2024-11-26 04:28:13.140351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:34.121 [2024-11-26 04:28:13.140420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:34.121 [2024-11-26 04:28:13.140418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:35.056 04:28:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:35.056 04:28:13 -- common/autotest_common.sh@862 -- # return 0 00:16:35.056 04:28:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:35.056 04:28:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:35.056 04:28:13 -- common/autotest_common.sh@10 -- # set +x 00:16:35.056 04:28:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:35.056 04:28:13 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:35.056 04:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.056 04:28:13 -- common/autotest_common.sh@10 -- # set +x 00:16:35.056 [2024-11-26 04:28:13.990400] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:35.056 04:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.056 04:28:13 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:16:35.056 04:28:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:35.056 04:28:13 -- common/autotest_common.sh@10 -- # set +x 00:16:35.056 04:28:14 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:35.056 04:28:14 -- target/host_management.sh@23 -- # cat 00:16:35.056 04:28:14 -- target/host_management.sh@30 -- # rpc_cmd 00:16:35.056 04:28:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.056 04:28:14 -- common/autotest_common.sh@10 -- # set +x 00:16:35.056 Malloc0 00:16:35.056 [2024-11-26 04:28:14.050791] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:35.056 04:28:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.056 04:28:14 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:16:35.056 04:28:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:35.056 04:28:14 -- common/autotest_common.sh@10 -- # set +x 00:16:35.056 04:28:14 -- target/host_management.sh@73 -- # perfpid=2899483 00:16:35.056 04:28:14 -- target/host_management.sh@74 -- # waitforlisten 2899483 /var/tmp/bdevperf.sock 00:16:35.056 04:28:14 -- common/autotest_common.sh@829 -- # '[' -z 2899483 ']' 00:16:35.056 04:28:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:35.056 04:28:14 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:16:35.056 04:28:14 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:16:35.056 04:28:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:35.056 04:28:14 -- nvmf/common.sh@520 -- # config=() 00:16:35.056 04:28:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:35.056 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:35.056 04:28:14 -- nvmf/common.sh@520 -- # local subsystem config 00:16:35.056 04:28:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:35.056 04:28:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:35.056 04:28:14 -- common/autotest_common.sh@10 -- # set +x 00:16:35.056 04:28:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:35.056 { 00:16:35.056 "params": { 00:16:35.056 "name": "Nvme$subsystem", 00:16:35.056 "trtype": "$TEST_TRANSPORT", 00:16:35.056 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:35.056 "adrfam": "ipv4", 00:16:35.056 "trsvcid": "$NVMF_PORT", 00:16:35.056 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:35.056 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:35.056 "hdgst": ${hdgst:-false}, 00:16:35.056 "ddgst": ${ddgst:-false} 00:16:35.056 }, 00:16:35.056 "method": "bdev_nvme_attach_controller" 00:16:35.056 } 00:16:35.056 EOF 00:16:35.056 )") 00:16:35.056 04:28:14 -- nvmf/common.sh@542 -- # cat 00:16:35.056 04:28:14 -- nvmf/common.sh@544 -- # jq . 00:16:35.056 04:28:14 -- nvmf/common.sh@545 -- # IFS=, 00:16:35.056 04:28:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:35.056 "params": { 00:16:35.056 "name": "Nvme0", 00:16:35.056 "trtype": "tcp", 00:16:35.056 "traddr": "10.0.0.2", 00:16:35.056 "adrfam": "ipv4", 00:16:35.056 "trsvcid": "4420", 00:16:35.056 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:35.056 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:35.056 "hdgst": false, 00:16:35.056 "ddgst": false 00:16:35.056 }, 00:16:35.056 "method": "bdev_nvme_attach_controller" 00:16:35.056 }' 00:16:35.056 [2024-11-26 04:28:14.128561] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:35.056 [2024-11-26 04:28:14.128649] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2899483 ] 00:16:35.056 EAL: No free 2048 kB hugepages reported on node 1 00:16:35.056 [2024-11-26 04:28:14.188546] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:35.056 [2024-11-26 04:28:14.272790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:35.622 Running I/O for 10 seconds... 00:16:35.880 04:28:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:35.880 04:28:15 -- common/autotest_common.sh@862 -- # return 0 00:16:35.880 04:28:15 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:16:35.880 04:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.880 04:28:15 -- common/autotest_common.sh@10 -- # set +x 00:16:35.880 04:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.880 04:28:15 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:35.880 04:28:15 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:16:35.880 04:28:15 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:16:35.880 04:28:15 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:16:35.880 04:28:15 -- target/host_management.sh@52 -- # local ret=1 00:16:35.880 04:28:15 -- target/host_management.sh@53 -- # local i 00:16:35.880 04:28:15 -- target/host_management.sh@54 -- # (( i = 10 )) 00:16:35.880 04:28:15 -- target/host_management.sh@54 -- # (( i != 0 )) 00:16:35.880 04:28:15 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:16:35.880 04:28:15 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:16:35.880 04:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.880 04:28:15 -- common/autotest_common.sh@10 -- # set +x 00:16:35.880 04:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:36.139 04:28:15 -- target/host_management.sh@55 -- # read_io_count=1960 00:16:36.139 04:28:15 -- target/host_management.sh@58 -- # '[' 1960 -ge 100 ']' 00:16:36.139 04:28:15 -- target/host_management.sh@59 -- # ret=0 00:16:36.139 04:28:15 -- target/host_management.sh@60 -- # break 00:16:36.139 04:28:15 -- target/host_management.sh@64 -- # return 0 00:16:36.139 04:28:15 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:36.139 04:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:36.139 04:28:15 -- common/autotest_common.sh@10 -- # set +x 00:16:36.139 [2024-11-26 04:28:15.130492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.130989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.131000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.131013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.131025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.131037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.131059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.131072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.131085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.131098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.131111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.131125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.131138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.131156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x94fad0 is same with the state(5) to be set 00:16:36.139 [2024-11-26 04:28:15.132184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:10880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:11136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:11264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:11520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:11648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:4864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:11776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:11904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:12032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:12160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:5760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:5888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:12288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:12416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:12544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:6528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:12672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:12800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.139 [2024-11-26 04:28:15.132908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.139 [2024-11-26 04:28:15.132922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:12928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.132936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.132951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:13056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.132965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.132991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:13184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:13312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:13440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:13696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:7296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:7552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:14336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:7680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:14464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:7936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:8192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:14720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:8704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:9216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:9344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:15488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:15616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.133974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:9728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.133995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.134028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.134043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.134060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:15872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.134074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.134090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:9856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.134104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.134120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:10112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.134135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.134150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.134165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.134180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:16128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.134195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.134211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.134225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.134246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.134261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.134277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:36.140 [2024-11-26 04:28:15.134307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:36.140 [2024-11-26 04:28:15.134411] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20b3630 was disconnected and freed. reset controller. 00:16:36.140 04:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:36.140 04:28:15 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:36.140 04:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:36.140 04:28:15 -- common/autotest_common.sh@10 -- # set +x 00:16:36.140 [2024-11-26 04:28:15.135576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:16:36.140 task offset: 10880 on job bdev=Nvme0n1 fails 00:16:36.140 00:16:36.140 Latency(us) 00:16:36.140 [2024-11-26T03:28:15.366Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:36.140 [2024-11-26T03:28:15.366Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:36.140 [2024-11-26T03:28:15.366Z] Job: Nvme0n1 ended in about 0.53 seconds with error 00:16:36.140 Verification LBA range: start 0x0 length 0x400 00:16:36.140 Nvme0n1 : 0.53 4018.30 251.14 121.71 0.00 15200.56 2621.44 21165.70 00:16:36.140 [2024-11-26T03:28:15.366Z] =================================================================================================================== 00:16:36.140 [2024-11-26T03:28:15.366Z] Total : 4018.30 251.14 121.71 0.00 15200.56 2621.44 21165.70 00:16:36.140 [2024-11-26 04:28:15.137472] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:16:36.140 [2024-11-26 04:28:15.137502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20b91d0 (9): Bad file descriptor 00:16:36.140 04:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:36.140 04:28:15 -- target/host_management.sh@87 -- # sleep 1 00:16:36.140 [2024-11-26 04:28:15.147225] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:37.073 04:28:16 -- target/host_management.sh@91 -- # kill -9 2899483 00:16:37.073 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2899483) - No such process 00:16:37.073 04:28:16 -- target/host_management.sh@91 -- # true 00:16:37.073 04:28:16 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:16:37.073 04:28:16 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:16:37.073 04:28:16 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:16:37.073 04:28:16 -- nvmf/common.sh@520 -- # config=() 00:16:37.073 04:28:16 -- nvmf/common.sh@520 -- # local subsystem config 00:16:37.074 04:28:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:37.074 04:28:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:37.074 { 00:16:37.074 "params": { 00:16:37.074 "name": "Nvme$subsystem", 00:16:37.074 "trtype": "$TEST_TRANSPORT", 00:16:37.074 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:37.074 "adrfam": "ipv4", 00:16:37.074 "trsvcid": "$NVMF_PORT", 00:16:37.074 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:37.074 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:37.074 "hdgst": ${hdgst:-false}, 00:16:37.074 "ddgst": ${ddgst:-false} 00:16:37.074 }, 00:16:37.074 "method": "bdev_nvme_attach_controller" 00:16:37.074 } 00:16:37.074 EOF 00:16:37.074 )") 00:16:37.074 04:28:16 -- nvmf/common.sh@542 -- # cat 00:16:37.074 04:28:16 -- nvmf/common.sh@544 -- # jq . 00:16:37.074 04:28:16 -- nvmf/common.sh@545 -- # IFS=, 00:16:37.074 04:28:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:37.074 "params": { 00:16:37.074 "name": "Nvme0", 00:16:37.074 "trtype": "tcp", 00:16:37.074 "traddr": "10.0.0.2", 00:16:37.074 "adrfam": "ipv4", 00:16:37.074 "trsvcid": "4420", 00:16:37.074 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:37.074 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:37.074 "hdgst": false, 00:16:37.074 "ddgst": false 00:16:37.074 }, 00:16:37.074 "method": "bdev_nvme_attach_controller" 00:16:37.074 }' 00:16:37.074 [2024-11-26 04:28:16.185871] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:37.074 [2024-11-26 04:28:16.185946] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2899770 ] 00:16:37.074 EAL: No free 2048 kB hugepages reported on node 1 00:16:37.074 [2024-11-26 04:28:16.245357] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:37.332 [2024-11-26 04:28:16.328435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:37.591 Running I/O for 1 seconds... 00:16:38.525 00:16:38.525 Latency(us) 00:16:38.525 [2024-11-26T03:28:17.751Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:38.525 [2024-11-26T03:28:17.751Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:38.525 Verification LBA range: start 0x0 length 0x400 00:16:38.525 Nvme0n1 : 1.01 4088.60 255.54 0.00 0.00 15407.52 813.13 21456.97 00:16:38.525 [2024-11-26T03:28:17.751Z] =================================================================================================================== 00:16:38.525 [2024-11-26T03:28:17.751Z] Total : 4088.60 255.54 0.00 0.00 15407.52 813.13 21456.97 00:16:38.783 04:28:17 -- target/host_management.sh@101 -- # stoptarget 00:16:38.783 04:28:17 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:16:38.783 04:28:17 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:16:38.783 04:28:17 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:38.783 04:28:17 -- target/host_management.sh@40 -- # nvmftestfini 00:16:38.783 04:28:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:38.783 04:28:17 -- nvmf/common.sh@116 -- # sync 00:16:38.783 04:28:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:38.783 04:28:17 -- nvmf/common.sh@119 -- # set +e 00:16:38.783 04:28:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:38.783 04:28:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:38.783 rmmod nvme_tcp 00:16:38.783 rmmod nvme_fabrics 00:16:38.783 rmmod nvme_keyring 00:16:38.783 04:28:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:38.783 04:28:17 -- nvmf/common.sh@123 -- # set -e 00:16:38.783 04:28:17 -- nvmf/common.sh@124 -- # return 0 00:16:38.783 04:28:17 -- nvmf/common.sh@477 -- # '[' -n 2899305 ']' 00:16:38.783 04:28:17 -- nvmf/common.sh@478 -- # killprocess 2899305 00:16:38.783 04:28:17 -- common/autotest_common.sh@936 -- # '[' -z 2899305 ']' 00:16:38.783 04:28:17 -- common/autotest_common.sh@940 -- # kill -0 2899305 00:16:38.783 04:28:17 -- common/autotest_common.sh@941 -- # uname 00:16:38.783 04:28:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:38.783 04:28:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2899305 00:16:38.783 04:28:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:38.783 04:28:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:38.783 04:28:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2899305' 00:16:38.783 killing process with pid 2899305 00:16:38.783 04:28:17 -- common/autotest_common.sh@955 -- # kill 2899305 00:16:38.783 04:28:17 -- common/autotest_common.sh@960 -- # wait 2899305 00:16:39.043 [2024-11-26 04:28:18.204220] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:16:39.043 04:28:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:39.043 04:28:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:39.043 04:28:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:39.043 04:28:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:39.043 04:28:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:39.043 04:28:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:39.043 04:28:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:39.043 04:28:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:41.580 04:28:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:41.580 00:16:41.580 real 0m7.340s 00:16:41.580 user 0m22.811s 00:16:41.580 sys 0m1.421s 00:16:41.580 04:28:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:41.580 04:28:20 -- common/autotest_common.sh@10 -- # set +x 00:16:41.580 ************************************ 00:16:41.580 END TEST nvmf_host_management 00:16:41.580 ************************************ 00:16:41.580 04:28:20 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:16:41.580 00:16:41.580 real 0m9.695s 00:16:41.580 user 0m23.650s 00:16:41.580 sys 0m2.974s 00:16:41.580 04:28:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:41.580 04:28:20 -- common/autotest_common.sh@10 -- # set +x 00:16:41.580 ************************************ 00:16:41.580 END TEST nvmf_host_management 00:16:41.580 ************************************ 00:16:41.580 04:28:20 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:41.580 04:28:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:41.580 04:28:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:41.580 04:28:20 -- common/autotest_common.sh@10 -- # set +x 00:16:41.580 ************************************ 00:16:41.580 START TEST nvmf_lvol 00:16:41.580 ************************************ 00:16:41.580 04:28:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:41.580 * Looking for test storage... 00:16:41.580 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:41.580 04:28:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:41.580 04:28:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:41.580 04:28:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:41.580 04:28:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:41.580 04:28:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:41.580 04:28:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:41.580 04:28:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:41.580 04:28:20 -- scripts/common.sh@335 -- # IFS=.-: 00:16:41.580 04:28:20 -- scripts/common.sh@335 -- # read -ra ver1 00:16:41.580 04:28:20 -- scripts/common.sh@336 -- # IFS=.-: 00:16:41.580 04:28:20 -- scripts/common.sh@336 -- # read -ra ver2 00:16:41.580 04:28:20 -- scripts/common.sh@337 -- # local 'op=<' 00:16:41.580 04:28:20 -- scripts/common.sh@339 -- # ver1_l=2 00:16:41.580 04:28:20 -- scripts/common.sh@340 -- # ver2_l=1 00:16:41.580 04:28:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:41.580 04:28:20 -- scripts/common.sh@343 -- # case "$op" in 00:16:41.580 04:28:20 -- scripts/common.sh@344 -- # : 1 00:16:41.580 04:28:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:41.580 04:28:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:41.580 04:28:20 -- scripts/common.sh@364 -- # decimal 1 00:16:41.580 04:28:20 -- scripts/common.sh@352 -- # local d=1 00:16:41.580 04:28:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:41.580 04:28:20 -- scripts/common.sh@354 -- # echo 1 00:16:41.580 04:28:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:41.580 04:28:20 -- scripts/common.sh@365 -- # decimal 2 00:16:41.580 04:28:20 -- scripts/common.sh@352 -- # local d=2 00:16:41.580 04:28:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:41.580 04:28:20 -- scripts/common.sh@354 -- # echo 2 00:16:41.580 04:28:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:41.580 04:28:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:41.580 04:28:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:41.580 04:28:20 -- scripts/common.sh@367 -- # return 0 00:16:41.580 04:28:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:41.580 04:28:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:41.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.580 --rc genhtml_branch_coverage=1 00:16:41.580 --rc genhtml_function_coverage=1 00:16:41.580 --rc genhtml_legend=1 00:16:41.580 --rc geninfo_all_blocks=1 00:16:41.580 --rc geninfo_unexecuted_blocks=1 00:16:41.580 00:16:41.580 ' 00:16:41.580 04:28:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:41.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.580 --rc genhtml_branch_coverage=1 00:16:41.580 --rc genhtml_function_coverage=1 00:16:41.580 --rc genhtml_legend=1 00:16:41.580 --rc geninfo_all_blocks=1 00:16:41.580 --rc geninfo_unexecuted_blocks=1 00:16:41.580 00:16:41.580 ' 00:16:41.580 04:28:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:41.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.580 --rc genhtml_branch_coverage=1 00:16:41.580 --rc genhtml_function_coverage=1 00:16:41.580 --rc genhtml_legend=1 00:16:41.580 --rc geninfo_all_blocks=1 00:16:41.580 --rc geninfo_unexecuted_blocks=1 00:16:41.580 00:16:41.580 ' 00:16:41.580 04:28:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:41.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.580 --rc genhtml_branch_coverage=1 00:16:41.580 --rc genhtml_function_coverage=1 00:16:41.580 --rc genhtml_legend=1 00:16:41.580 --rc geninfo_all_blocks=1 00:16:41.580 --rc geninfo_unexecuted_blocks=1 00:16:41.580 00:16:41.580 ' 00:16:41.580 04:28:20 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:41.580 04:28:20 -- nvmf/common.sh@7 -- # uname -s 00:16:41.580 04:28:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:41.580 04:28:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:41.580 04:28:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:41.580 04:28:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:41.580 04:28:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:41.580 04:28:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:41.580 04:28:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:41.580 04:28:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:41.580 04:28:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:41.580 04:28:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:41.580 04:28:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:41.580 04:28:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:41.580 04:28:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:41.580 04:28:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:41.580 04:28:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:41.580 04:28:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:41.580 04:28:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:41.580 04:28:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:41.580 04:28:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:41.580 04:28:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.580 04:28:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.580 04:28:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.580 04:28:20 -- paths/export.sh@5 -- # export PATH 00:16:41.580 04:28:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.580 04:28:20 -- nvmf/common.sh@46 -- # : 0 00:16:41.580 04:28:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:41.580 04:28:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:41.580 04:28:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:41.580 04:28:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:41.580 04:28:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:41.580 04:28:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:41.580 04:28:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:41.580 04:28:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:41.580 04:28:20 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:41.580 04:28:20 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:41.580 04:28:20 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:16:41.580 04:28:20 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:16:41.580 04:28:20 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:41.580 04:28:20 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:16:41.580 04:28:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:41.580 04:28:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:41.580 04:28:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:41.580 04:28:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:41.581 04:28:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:41.581 04:28:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:41.581 04:28:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:41.581 04:28:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:41.581 04:28:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:41.581 04:28:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:41.581 04:28:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:41.581 04:28:20 -- common/autotest_common.sh@10 -- # set +x 00:16:43.486 04:28:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:43.486 04:28:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:43.486 04:28:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:43.486 04:28:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:43.486 04:28:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:43.486 04:28:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:43.486 04:28:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:43.486 04:28:22 -- nvmf/common.sh@294 -- # net_devs=() 00:16:43.486 04:28:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:43.486 04:28:22 -- nvmf/common.sh@295 -- # e810=() 00:16:43.486 04:28:22 -- nvmf/common.sh@295 -- # local -ga e810 00:16:43.486 04:28:22 -- nvmf/common.sh@296 -- # x722=() 00:16:43.486 04:28:22 -- nvmf/common.sh@296 -- # local -ga x722 00:16:43.486 04:28:22 -- nvmf/common.sh@297 -- # mlx=() 00:16:43.486 04:28:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:43.486 04:28:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:43.486 04:28:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:43.486 04:28:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:43.486 04:28:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:43.486 04:28:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:43.486 04:28:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:43.486 04:28:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:43.486 04:28:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:43.486 04:28:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:43.486 04:28:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:43.486 04:28:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:43.486 04:28:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:43.486 04:28:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:43.486 04:28:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:43.486 04:28:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:43.486 04:28:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:43.486 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:43.486 04:28:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:43.486 04:28:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:43.486 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:43.486 04:28:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:43.486 04:28:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:43.486 04:28:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:43.486 04:28:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:43.486 04:28:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:43.486 04:28:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:43.486 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:43.486 04:28:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:43.486 04:28:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:43.486 04:28:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:43.486 04:28:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:43.486 04:28:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:43.486 04:28:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:43.486 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:43.486 04:28:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:43.486 04:28:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:43.486 04:28:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:43.486 04:28:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:43.486 04:28:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:43.486 04:28:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:43.486 04:28:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:43.486 04:28:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:43.486 04:28:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:43.486 04:28:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:43.486 04:28:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:43.486 04:28:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:43.486 04:28:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:43.486 04:28:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:43.486 04:28:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:43.486 04:28:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:43.486 04:28:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:43.486 04:28:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:43.486 04:28:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:43.486 04:28:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:43.486 04:28:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:43.486 04:28:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:43.486 04:28:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:43.486 04:28:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:43.486 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:43.486 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:16:43.486 00:16:43.486 --- 10.0.0.2 ping statistics --- 00:16:43.486 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:43.486 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:16:43.486 04:28:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:43.486 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:43.486 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:16:43.486 00:16:43.486 --- 10.0.0.1 ping statistics --- 00:16:43.486 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:43.486 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:16:43.486 04:28:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:43.486 04:28:22 -- nvmf/common.sh@410 -- # return 0 00:16:43.486 04:28:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:43.486 04:28:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:43.486 04:28:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:43.486 04:28:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:43.486 04:28:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:43.486 04:28:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:43.486 04:28:22 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:16:43.486 04:28:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:43.486 04:28:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:43.486 04:28:22 -- common/autotest_common.sh@10 -- # set +x 00:16:43.486 04:28:22 -- nvmf/common.sh@469 -- # nvmfpid=2902007 00:16:43.486 04:28:22 -- nvmf/common.sh@470 -- # waitforlisten 2902007 00:16:43.486 04:28:22 -- common/autotest_common.sh@829 -- # '[' -z 2902007 ']' 00:16:43.486 04:28:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:43.486 04:28:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:43.486 04:28:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:43.486 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:43.486 04:28:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:43.486 04:28:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:43.486 04:28:22 -- common/autotest_common.sh@10 -- # set +x 00:16:43.745 [2024-11-26 04:28:22.711421] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:43.745 [2024-11-26 04:28:22.711511] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:43.745 EAL: No free 2048 kB hugepages reported on node 1 00:16:43.745 [2024-11-26 04:28:22.780678] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:43.745 [2024-11-26 04:28:22.870081] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:43.745 [2024-11-26 04:28:22.870231] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:43.745 [2024-11-26 04:28:22.870250] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:43.745 [2024-11-26 04:28:22.870263] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:43.745 [2024-11-26 04:28:22.870340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:43.745 [2024-11-26 04:28:22.870361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:43.745 [2024-11-26 04:28:22.870363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:44.685 04:28:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:44.686 04:28:23 -- common/autotest_common.sh@862 -- # return 0 00:16:44.686 04:28:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:44.686 04:28:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:44.686 04:28:23 -- common/autotest_common.sh@10 -- # set +x 00:16:44.686 04:28:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:44.686 04:28:23 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:44.944 [2024-11-26 04:28:23.935827] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:44.944 04:28:23 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.202 04:28:24 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:16:45.202 04:28:24 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.460 04:28:24 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:16:45.460 04:28:24 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:16:45.718 04:28:24 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:16:45.976 04:28:25 -- target/nvmf_lvol.sh@29 -- # lvs=3030db32-dad7-4e17-8637-b3bf8992c3ac 00:16:45.976 04:28:25 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 3030db32-dad7-4e17-8637-b3bf8992c3ac lvol 20 00:16:46.234 04:28:25 -- target/nvmf_lvol.sh@32 -- # lvol=336035e7-cc29-444c-9726-c603ba1ce13f 00:16:46.234 04:28:25 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:16:46.492 04:28:25 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 336035e7-cc29-444c-9726-c603ba1ce13f 00:16:46.749 04:28:25 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:16:47.007 [2024-11-26 04:28:26.014526] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:47.007 04:28:26 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:47.265 04:28:26 -- target/nvmf_lvol.sh@42 -- # perf_pid=2902456 00:16:47.265 04:28:26 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:16:47.265 04:28:26 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:16:47.265 EAL: No free 2048 kB hugepages reported on node 1 00:16:48.200 04:28:27 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 336035e7-cc29-444c-9726-c603ba1ce13f MY_SNAPSHOT 00:16:48.458 04:28:27 -- target/nvmf_lvol.sh@47 -- # snapshot=29678a89-05e3-4302-97e0-05500ed4132d 00:16:48.458 04:28:27 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 336035e7-cc29-444c-9726-c603ba1ce13f 30 00:16:48.716 04:28:27 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 29678a89-05e3-4302-97e0-05500ed4132d MY_CLONE 00:16:48.974 04:28:28 -- target/nvmf_lvol.sh@49 -- # clone=8521e7b5-d17f-4e1e-8700-73218e191252 00:16:48.974 04:28:28 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 8521e7b5-d17f-4e1e-8700-73218e191252 00:16:49.909 04:28:28 -- target/nvmf_lvol.sh@53 -- # wait 2902456 00:16:58.013 Initializing NVMe Controllers 00:16:58.013 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:16:58.013 Controller IO queue size 128, less than required. 00:16:58.013 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:16:58.013 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:16:58.013 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:16:58.013 Initialization complete. Launching workers. 00:16:58.013 ======================================================== 00:16:58.013 Latency(us) 00:16:58.013 Device Information : IOPS MiB/s Average min max 00:16:58.013 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10856.30 42.41 11791.82 332.98 83435.21 00:16:58.013 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10763.60 42.05 11897.34 1736.06 53618.70 00:16:58.013 ======================================================== 00:16:58.013 Total : 21619.90 84.45 11844.35 332.98 83435.21 00:16:58.013 00:16:58.013 04:28:36 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:16:58.013 04:28:36 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 336035e7-cc29-444c-9726-c603ba1ce13f 00:16:58.013 04:28:37 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 3030db32-dad7-4e17-8637-b3bf8992c3ac 00:16:58.272 04:28:37 -- target/nvmf_lvol.sh@60 -- # rm -f 00:16:58.272 04:28:37 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:16:58.272 04:28:37 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:16:58.272 04:28:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:58.272 04:28:37 -- nvmf/common.sh@116 -- # sync 00:16:58.272 04:28:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:58.272 04:28:37 -- nvmf/common.sh@119 -- # set +e 00:16:58.272 04:28:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:58.272 04:28:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:58.272 rmmod nvme_tcp 00:16:58.272 rmmod nvme_fabrics 00:16:58.272 rmmod nvme_keyring 00:16:58.272 04:28:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:58.272 04:28:37 -- nvmf/common.sh@123 -- # set -e 00:16:58.272 04:28:37 -- nvmf/common.sh@124 -- # return 0 00:16:58.272 04:28:37 -- nvmf/common.sh@477 -- # '[' -n 2902007 ']' 00:16:58.272 04:28:37 -- nvmf/common.sh@478 -- # killprocess 2902007 00:16:58.272 04:28:37 -- common/autotest_common.sh@936 -- # '[' -z 2902007 ']' 00:16:58.272 04:28:37 -- common/autotest_common.sh@940 -- # kill -0 2902007 00:16:58.272 04:28:37 -- common/autotest_common.sh@941 -- # uname 00:16:58.272 04:28:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:58.272 04:28:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2902007 00:16:58.272 04:28:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:58.530 04:28:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:58.530 04:28:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2902007' 00:16:58.530 killing process with pid 2902007 00:16:58.530 04:28:37 -- common/autotest_common.sh@955 -- # kill 2902007 00:16:58.530 04:28:37 -- common/autotest_common.sh@960 -- # wait 2902007 00:16:58.789 04:28:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:58.789 04:28:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:58.789 04:28:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:58.789 04:28:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:58.789 04:28:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:58.789 04:28:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:58.789 04:28:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:58.789 04:28:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:00.691 04:28:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:00.691 00:17:00.691 real 0m19.502s 00:17:00.691 user 1m6.178s 00:17:00.691 sys 0m5.404s 00:17:00.691 04:28:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:00.691 04:28:39 -- common/autotest_common.sh@10 -- # set +x 00:17:00.691 ************************************ 00:17:00.691 END TEST nvmf_lvol 00:17:00.691 ************************************ 00:17:00.691 04:28:39 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:00.691 04:28:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:00.691 04:28:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:00.691 04:28:39 -- common/autotest_common.sh@10 -- # set +x 00:17:00.691 ************************************ 00:17:00.691 START TEST nvmf_lvs_grow 00:17:00.691 ************************************ 00:17:00.691 04:28:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:00.691 * Looking for test storage... 00:17:00.691 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:00.691 04:28:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:00.691 04:28:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:00.691 04:28:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:00.950 04:28:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:00.950 04:28:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:00.950 04:28:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:00.950 04:28:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:00.950 04:28:39 -- scripts/common.sh@335 -- # IFS=.-: 00:17:00.950 04:28:39 -- scripts/common.sh@335 -- # read -ra ver1 00:17:00.950 04:28:39 -- scripts/common.sh@336 -- # IFS=.-: 00:17:00.950 04:28:39 -- scripts/common.sh@336 -- # read -ra ver2 00:17:00.950 04:28:39 -- scripts/common.sh@337 -- # local 'op=<' 00:17:00.950 04:28:39 -- scripts/common.sh@339 -- # ver1_l=2 00:17:00.950 04:28:39 -- scripts/common.sh@340 -- # ver2_l=1 00:17:00.950 04:28:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:00.950 04:28:39 -- scripts/common.sh@343 -- # case "$op" in 00:17:00.950 04:28:39 -- scripts/common.sh@344 -- # : 1 00:17:00.950 04:28:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:00.950 04:28:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:00.950 04:28:39 -- scripts/common.sh@364 -- # decimal 1 00:17:00.950 04:28:39 -- scripts/common.sh@352 -- # local d=1 00:17:00.950 04:28:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:00.950 04:28:39 -- scripts/common.sh@354 -- # echo 1 00:17:00.950 04:28:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:00.950 04:28:39 -- scripts/common.sh@365 -- # decimal 2 00:17:00.950 04:28:39 -- scripts/common.sh@352 -- # local d=2 00:17:00.950 04:28:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:00.950 04:28:39 -- scripts/common.sh@354 -- # echo 2 00:17:00.950 04:28:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:00.950 04:28:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:00.950 04:28:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:00.950 04:28:39 -- scripts/common.sh@367 -- # return 0 00:17:00.950 04:28:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:00.950 04:28:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:00.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:00.950 --rc genhtml_branch_coverage=1 00:17:00.950 --rc genhtml_function_coverage=1 00:17:00.950 --rc genhtml_legend=1 00:17:00.950 --rc geninfo_all_blocks=1 00:17:00.950 --rc geninfo_unexecuted_blocks=1 00:17:00.950 00:17:00.950 ' 00:17:00.950 04:28:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:00.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:00.950 --rc genhtml_branch_coverage=1 00:17:00.950 --rc genhtml_function_coverage=1 00:17:00.950 --rc genhtml_legend=1 00:17:00.950 --rc geninfo_all_blocks=1 00:17:00.950 --rc geninfo_unexecuted_blocks=1 00:17:00.950 00:17:00.950 ' 00:17:00.950 04:28:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:00.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:00.950 --rc genhtml_branch_coverage=1 00:17:00.950 --rc genhtml_function_coverage=1 00:17:00.950 --rc genhtml_legend=1 00:17:00.950 --rc geninfo_all_blocks=1 00:17:00.950 --rc geninfo_unexecuted_blocks=1 00:17:00.950 00:17:00.950 ' 00:17:00.950 04:28:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:00.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:00.950 --rc genhtml_branch_coverage=1 00:17:00.950 --rc genhtml_function_coverage=1 00:17:00.950 --rc genhtml_legend=1 00:17:00.950 --rc geninfo_all_blocks=1 00:17:00.950 --rc geninfo_unexecuted_blocks=1 00:17:00.950 00:17:00.950 ' 00:17:00.950 04:28:39 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:00.950 04:28:39 -- nvmf/common.sh@7 -- # uname -s 00:17:00.950 04:28:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:00.950 04:28:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:00.950 04:28:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:00.950 04:28:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:00.950 04:28:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:00.950 04:28:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:00.950 04:28:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:00.950 04:28:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:00.950 04:28:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:00.950 04:28:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:00.950 04:28:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:00.950 04:28:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:00.950 04:28:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:00.950 04:28:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:00.950 04:28:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:00.950 04:28:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:00.950 04:28:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:00.950 04:28:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:00.950 04:28:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:00.950 04:28:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:00.950 04:28:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:00.951 04:28:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:00.951 04:28:39 -- paths/export.sh@5 -- # export PATH 00:17:00.951 04:28:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:00.951 04:28:39 -- nvmf/common.sh@46 -- # : 0 00:17:00.951 04:28:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:00.951 04:28:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:00.951 04:28:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:00.951 04:28:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:00.951 04:28:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:00.951 04:28:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:00.951 04:28:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:00.951 04:28:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:00.951 04:28:39 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:00.951 04:28:39 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:00.951 04:28:39 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:00.951 04:28:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:00.951 04:28:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:00.951 04:28:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:00.951 04:28:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:00.951 04:28:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:00.951 04:28:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:00.951 04:28:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:00.951 04:28:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:00.951 04:28:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:00.951 04:28:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:00.951 04:28:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:00.951 04:28:40 -- common/autotest_common.sh@10 -- # set +x 00:17:02.854 04:28:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:02.854 04:28:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:02.854 04:28:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:02.854 04:28:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:02.854 04:28:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:02.854 04:28:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:02.854 04:28:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:02.854 04:28:41 -- nvmf/common.sh@294 -- # net_devs=() 00:17:02.854 04:28:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:02.854 04:28:41 -- nvmf/common.sh@295 -- # e810=() 00:17:02.854 04:28:41 -- nvmf/common.sh@295 -- # local -ga e810 00:17:02.854 04:28:41 -- nvmf/common.sh@296 -- # x722=() 00:17:02.854 04:28:41 -- nvmf/common.sh@296 -- # local -ga x722 00:17:02.854 04:28:41 -- nvmf/common.sh@297 -- # mlx=() 00:17:02.854 04:28:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:02.854 04:28:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:02.854 04:28:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:02.854 04:28:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:02.854 04:28:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:02.854 04:28:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:02.854 04:28:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:02.854 04:28:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:02.854 04:28:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:02.854 04:28:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:02.854 04:28:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:02.854 04:28:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:02.854 04:28:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:02.854 04:28:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:02.854 04:28:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:02.854 04:28:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:02.854 04:28:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:02.854 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:02.854 04:28:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:02.854 04:28:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:02.854 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:02.854 04:28:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:02.854 04:28:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:02.854 04:28:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:02.854 04:28:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:02.854 04:28:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:02.854 04:28:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:02.854 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:02.854 04:28:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:02.854 04:28:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:02.854 04:28:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:02.854 04:28:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:02.854 04:28:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:02.854 04:28:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:02.854 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:02.854 04:28:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:02.854 04:28:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:02.854 04:28:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:02.854 04:28:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:02.854 04:28:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:02.854 04:28:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:02.854 04:28:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:02.854 04:28:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:02.854 04:28:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:02.854 04:28:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:02.854 04:28:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:02.854 04:28:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:02.854 04:28:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:02.854 04:28:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:02.854 04:28:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:02.854 04:28:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:02.854 04:28:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:02.854 04:28:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:03.114 04:28:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:03.114 04:28:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:03.114 04:28:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:03.114 04:28:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:03.114 04:28:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:03.114 04:28:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:03.114 04:28:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:03.114 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:03.114 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.281 ms 00:17:03.114 00:17:03.114 --- 10.0.0.2 ping statistics --- 00:17:03.114 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:03.114 rtt min/avg/max/mdev = 0.281/0.281/0.281/0.000 ms 00:17:03.114 04:28:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:03.114 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:03.114 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:17:03.114 00:17:03.114 --- 10.0.0.1 ping statistics --- 00:17:03.114 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:03.114 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:17:03.114 04:28:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:03.114 04:28:42 -- nvmf/common.sh@410 -- # return 0 00:17:03.114 04:28:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:03.114 04:28:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:03.114 04:28:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:03.114 04:28:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:03.114 04:28:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:03.114 04:28:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:03.114 04:28:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:03.114 04:28:42 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:03.114 04:28:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:03.114 04:28:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:03.114 04:28:42 -- common/autotest_common.sh@10 -- # set +x 00:17:03.114 04:28:42 -- nvmf/common.sh@469 -- # nvmfpid=2905770 00:17:03.114 04:28:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:03.114 04:28:42 -- nvmf/common.sh@470 -- # waitforlisten 2905770 00:17:03.114 04:28:42 -- common/autotest_common.sh@829 -- # '[' -z 2905770 ']' 00:17:03.114 04:28:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:03.114 04:28:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:03.114 04:28:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:03.114 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:03.114 04:28:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:03.114 04:28:42 -- common/autotest_common.sh@10 -- # set +x 00:17:03.114 [2024-11-26 04:28:42.300875] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:03.114 [2024-11-26 04:28:42.300953] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:03.114 EAL: No free 2048 kB hugepages reported on node 1 00:17:03.373 [2024-11-26 04:28:42.370980] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:03.373 [2024-11-26 04:28:42.462665] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:03.373 [2024-11-26 04:28:42.462855] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:03.373 [2024-11-26 04:28:42.462886] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:03.373 [2024-11-26 04:28:42.462901] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:03.373 [2024-11-26 04:28:42.462933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:04.306 04:28:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:04.306 04:28:43 -- common/autotest_common.sh@862 -- # return 0 00:17:04.306 04:28:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:04.306 04:28:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:04.306 04:28:43 -- common/autotest_common.sh@10 -- # set +x 00:17:04.306 04:28:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:04.306 04:28:43 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:04.565 [2024-11-26 04:28:43.622726] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:04.565 04:28:43 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:04.565 04:28:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:04.565 04:28:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:04.565 04:28:43 -- common/autotest_common.sh@10 -- # set +x 00:17:04.565 ************************************ 00:17:04.565 START TEST lvs_grow_clean 00:17:04.565 ************************************ 00:17:04.565 04:28:43 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:04.565 04:28:43 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:04.565 04:28:43 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:04.565 04:28:43 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:04.565 04:28:43 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:04.565 04:28:43 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:04.565 04:28:43 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:04.565 04:28:43 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:04.565 04:28:43 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:04.565 04:28:43 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:04.824 04:28:43 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:04.824 04:28:43 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:05.082 04:28:44 -- target/nvmf_lvs_grow.sh@28 -- # lvs=0bca843a-d9a1-472b-ac9b-0a4834fd2172 00:17:05.082 04:28:44 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0bca843a-d9a1-472b-ac9b-0a4834fd2172 00:17:05.082 04:28:44 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:05.339 04:28:44 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:05.339 04:28:44 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:05.339 04:28:44 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 0bca843a-d9a1-472b-ac9b-0a4834fd2172 lvol 150 00:17:05.597 04:28:44 -- target/nvmf_lvs_grow.sh@33 -- # lvol=cabe0e9f-deda-4e0c-be3e-c6a371e3ce03 00:17:05.597 04:28:44 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:05.597 04:28:44 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:05.855 [2024-11-26 04:28:45.002970] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:05.855 [2024-11-26 04:28:45.003076] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:05.855 true 00:17:05.855 04:28:45 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0bca843a-d9a1-472b-ac9b-0a4834fd2172 00:17:05.855 04:28:45 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:06.113 04:28:45 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:06.113 04:28:45 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:06.371 04:28:45 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 cabe0e9f-deda-4e0c-be3e-c6a371e3ce03 00:17:06.629 04:28:45 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:06.887 [2024-11-26 04:28:46.090404] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:06.887 04:28:46 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:07.482 04:28:46 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2906348 00:17:07.482 04:28:46 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:07.482 04:28:46 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:07.482 04:28:46 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2906348 /var/tmp/bdevperf.sock 00:17:07.482 04:28:46 -- common/autotest_common.sh@829 -- # '[' -z 2906348 ']' 00:17:07.482 04:28:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:07.482 04:28:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:07.482 04:28:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:07.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:07.482 04:28:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:07.482 04:28:46 -- common/autotest_common.sh@10 -- # set +x 00:17:07.482 [2024-11-26 04:28:46.417441] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:07.482 [2024-11-26 04:28:46.417525] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2906348 ] 00:17:07.482 EAL: No free 2048 kB hugepages reported on node 1 00:17:07.482 [2024-11-26 04:28:46.477300] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:07.482 [2024-11-26 04:28:46.564074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:08.452 04:28:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:08.452 04:28:47 -- common/autotest_common.sh@862 -- # return 0 00:17:08.452 04:28:47 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:08.710 Nvme0n1 00:17:08.710 04:28:47 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:08.967 [ 00:17:08.967 { 00:17:08.967 "name": "Nvme0n1", 00:17:08.967 "aliases": [ 00:17:08.967 "cabe0e9f-deda-4e0c-be3e-c6a371e3ce03" 00:17:08.967 ], 00:17:08.967 "product_name": "NVMe disk", 00:17:08.967 "block_size": 4096, 00:17:08.968 "num_blocks": 38912, 00:17:08.968 "uuid": "cabe0e9f-deda-4e0c-be3e-c6a371e3ce03", 00:17:08.968 "assigned_rate_limits": { 00:17:08.968 "rw_ios_per_sec": 0, 00:17:08.968 "rw_mbytes_per_sec": 0, 00:17:08.968 "r_mbytes_per_sec": 0, 00:17:08.968 "w_mbytes_per_sec": 0 00:17:08.968 }, 00:17:08.968 "claimed": false, 00:17:08.968 "zoned": false, 00:17:08.968 "supported_io_types": { 00:17:08.968 "read": true, 00:17:08.968 "write": true, 00:17:08.968 "unmap": true, 00:17:08.968 "write_zeroes": true, 00:17:08.968 "flush": true, 00:17:08.968 "reset": true, 00:17:08.968 "compare": true, 00:17:08.968 "compare_and_write": true, 00:17:08.968 "abort": true, 00:17:08.968 "nvme_admin": true, 00:17:08.968 "nvme_io": true 00:17:08.968 }, 00:17:08.968 "driver_specific": { 00:17:08.968 "nvme": [ 00:17:08.968 { 00:17:08.968 "trid": { 00:17:08.968 "trtype": "TCP", 00:17:08.968 "adrfam": "IPv4", 00:17:08.968 "traddr": "10.0.0.2", 00:17:08.968 "trsvcid": "4420", 00:17:08.968 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:08.968 }, 00:17:08.968 "ctrlr_data": { 00:17:08.968 "cntlid": 1, 00:17:08.968 "vendor_id": "0x8086", 00:17:08.968 "model_number": "SPDK bdev Controller", 00:17:08.968 "serial_number": "SPDK0", 00:17:08.968 "firmware_revision": "24.01.1", 00:17:08.968 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:08.968 "oacs": { 00:17:08.968 "security": 0, 00:17:08.968 "format": 0, 00:17:08.968 "firmware": 0, 00:17:08.968 "ns_manage": 0 00:17:08.968 }, 00:17:08.968 "multi_ctrlr": true, 00:17:08.968 "ana_reporting": false 00:17:08.968 }, 00:17:08.968 "vs": { 00:17:08.968 "nvme_version": "1.3" 00:17:08.968 }, 00:17:08.968 "ns_data": { 00:17:08.968 "id": 1, 00:17:08.968 "can_share": true 00:17:08.968 } 00:17:08.968 } 00:17:08.968 ], 00:17:08.968 "mp_policy": "active_passive" 00:17:08.968 } 00:17:08.968 } 00:17:08.968 ] 00:17:08.968 04:28:48 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2906501 00:17:08.968 04:28:48 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:08.968 04:28:48 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:08.968 Running I/O for 10 seconds... 00:17:10.344 Latency(us) 00:17:10.344 [2024-11-26T03:28:49.570Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:10.344 [2024-11-26T03:28:49.570Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:10.344 Nvme0n1 : 1.00 14817.00 57.88 0.00 0.00 0.00 0.00 0.00 00:17:10.344 [2024-11-26T03:28:49.570Z] =================================================================================================================== 00:17:10.344 [2024-11-26T03:28:49.570Z] Total : 14817.00 57.88 0.00 0.00 0.00 0.00 0.00 00:17:10.344 00:17:10.910 04:28:50 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 0bca843a-d9a1-472b-ac9b-0a4834fd2172 00:17:11.168 [2024-11-26T03:28:50.394Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:11.168 Nvme0n1 : 2.00 15009.00 58.63 0.00 0.00 0.00 0.00 0.00 00:17:11.168 [2024-11-26T03:28:50.394Z] =================================================================================================================== 00:17:11.168 [2024-11-26T03:28:50.394Z] Total : 15009.00 58.63 0.00 0.00 0.00 0.00 0.00 00:17:11.168 00:17:11.168 true 00:17:11.168 04:28:50 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0bca843a-d9a1-472b-ac9b-0a4834fd2172 00:17:11.168 04:28:50 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:11.426 04:28:50 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:11.426 04:28:50 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:11.426 04:28:50 -- target/nvmf_lvs_grow.sh@65 -- # wait 2906501 00:17:11.992 [2024-11-26T03:28:51.218Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:11.992 Nvme0n1 : 3.00 15117.67 59.05 0.00 0.00 0.00 0.00 0.00 00:17:11.992 [2024-11-26T03:28:51.218Z] =================================================================================================================== 00:17:11.992 [2024-11-26T03:28:51.218Z] Total : 15117.67 59.05 0.00 0.00 0.00 0.00 0.00 00:17:11.992 00:17:13.364 [2024-11-26T03:28:52.590Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:13.364 Nvme0n1 : 4.00 15215.75 59.44 0.00 0.00 0.00 0.00 0.00 00:17:13.364 [2024-11-26T03:28:52.590Z] =================================================================================================================== 00:17:13.364 [2024-11-26T03:28:52.590Z] Total : 15215.75 59.44 0.00 0.00 0.00 0.00 0.00 00:17:13.364 00:17:14.299 [2024-11-26T03:28:53.525Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:14.299 Nvme0n1 : 5.00 15312.40 59.81 0.00 0.00 0.00 0.00 0.00 00:17:14.299 [2024-11-26T03:28:53.525Z] =================================================================================================================== 00:17:14.299 [2024-11-26T03:28:53.525Z] Total : 15312.40 59.81 0.00 0.00 0.00 0.00 0.00 00:17:14.299 00:17:15.233 [2024-11-26T03:28:54.459Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:15.233 Nvme0n1 : 6.00 15366.83 60.03 0.00 0.00 0.00 0.00 0.00 00:17:15.233 [2024-11-26T03:28:54.459Z] =================================================================================================================== 00:17:15.233 [2024-11-26T03:28:54.459Z] Total : 15366.83 60.03 0.00 0.00 0.00 0.00 0.00 00:17:15.233 00:17:16.168 [2024-11-26T03:28:55.394Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:16.168 Nvme0n1 : 7.00 15508.29 60.58 0.00 0.00 0.00 0.00 0.00 00:17:16.168 [2024-11-26T03:28:55.394Z] =================================================================================================================== 00:17:16.168 [2024-11-26T03:28:55.394Z] Total : 15508.29 60.58 0.00 0.00 0.00 0.00 0.00 00:17:16.168 00:17:17.104 [2024-11-26T03:28:56.330Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:17.104 Nvme0n1 : 8.00 15528.62 60.66 0.00 0.00 0.00 0.00 0.00 00:17:17.104 [2024-11-26T03:28:56.330Z] =================================================================================================================== 00:17:17.104 [2024-11-26T03:28:56.330Z] Total : 15528.62 60.66 0.00 0.00 0.00 0.00 0.00 00:17:17.104 00:17:18.039 [2024-11-26T03:28:57.266Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:18.040 Nvme0n1 : 9.00 15561.89 60.79 0.00 0.00 0.00 0.00 0.00 00:17:18.040 [2024-11-26T03:28:57.266Z] =================================================================================================================== 00:17:18.040 [2024-11-26T03:28:57.266Z] Total : 15561.89 60.79 0.00 0.00 0.00 0.00 0.00 00:17:18.040 00:17:19.416 [2024-11-26T03:28:58.642Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:19.416 Nvme0n1 : 10.00 15587.90 60.89 0.00 0.00 0.00 0.00 0.00 00:17:19.416 [2024-11-26T03:28:58.642Z] =================================================================================================================== 00:17:19.416 [2024-11-26T03:28:58.642Z] Total : 15587.90 60.89 0.00 0.00 0.00 0.00 0.00 00:17:19.416 00:17:19.416 00:17:19.416 Latency(us) 00:17:19.416 [2024-11-26T03:28:58.642Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:19.416 [2024-11-26T03:28:58.642Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:19.416 Nvme0n1 : 10.01 15592.12 60.91 0.00 0.00 8204.67 3883.61 16699.54 00:17:19.416 [2024-11-26T03:28:58.642Z] =================================================================================================================== 00:17:19.416 [2024-11-26T03:28:58.642Z] Total : 15592.12 60.91 0.00 0.00 8204.67 3883.61 16699.54 00:17:19.416 0 00:17:19.416 04:28:58 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2906348 00:17:19.416 04:28:58 -- common/autotest_common.sh@936 -- # '[' -z 2906348 ']' 00:17:19.416 04:28:58 -- common/autotest_common.sh@940 -- # kill -0 2906348 00:17:19.416 04:28:58 -- common/autotest_common.sh@941 -- # uname 00:17:19.416 04:28:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:19.416 04:28:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2906348 00:17:19.416 04:28:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:19.416 04:28:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:19.416 04:28:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2906348' 00:17:19.416 killing process with pid 2906348 00:17:19.416 04:28:58 -- common/autotest_common.sh@955 -- # kill 2906348 00:17:19.416 Received shutdown signal, test time was about 10.000000 seconds 00:17:19.416 00:17:19.416 Latency(us) 00:17:19.416 [2024-11-26T03:28:58.642Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:19.416 [2024-11-26T03:28:58.642Z] =================================================================================================================== 00:17:19.416 [2024-11-26T03:28:58.642Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:19.416 04:28:58 -- common/autotest_common.sh@960 -- # wait 2906348 00:17:19.416 04:28:58 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:19.674 04:28:58 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0bca843a-d9a1-472b-ac9b-0a4834fd2172 00:17:19.674 04:28:58 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:19.933 04:28:59 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:19.933 04:28:59 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:19.933 04:28:59 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:20.190 [2024-11-26 04:28:59.308531] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:20.190 04:28:59 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0bca843a-d9a1-472b-ac9b-0a4834fd2172 00:17:20.190 04:28:59 -- common/autotest_common.sh@650 -- # local es=0 00:17:20.190 04:28:59 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0bca843a-d9a1-472b-ac9b-0a4834fd2172 00:17:20.190 04:28:59 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:20.190 04:28:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:20.190 04:28:59 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:20.190 04:28:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:20.190 04:28:59 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:20.190 04:28:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:20.190 04:28:59 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:20.190 04:28:59 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:20.190 04:28:59 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0bca843a-d9a1-472b-ac9b-0a4834fd2172 00:17:20.448 request: 00:17:20.448 { 00:17:20.448 "uuid": "0bca843a-d9a1-472b-ac9b-0a4834fd2172", 00:17:20.448 "method": "bdev_lvol_get_lvstores", 00:17:20.448 "req_id": 1 00:17:20.448 } 00:17:20.448 Got JSON-RPC error response 00:17:20.448 response: 00:17:20.448 { 00:17:20.448 "code": -19, 00:17:20.448 "message": "No such device" 00:17:20.448 } 00:17:20.448 04:28:59 -- common/autotest_common.sh@653 -- # es=1 00:17:20.448 04:28:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:20.448 04:28:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:20.448 04:28:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:20.448 04:28:59 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:21.013 aio_bdev 00:17:21.013 04:28:59 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev cabe0e9f-deda-4e0c-be3e-c6a371e3ce03 00:17:21.013 04:28:59 -- common/autotest_common.sh@897 -- # local bdev_name=cabe0e9f-deda-4e0c-be3e-c6a371e3ce03 00:17:21.013 04:28:59 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:21.013 04:28:59 -- common/autotest_common.sh@899 -- # local i 00:17:21.013 04:28:59 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:21.013 04:28:59 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:21.013 04:28:59 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:21.271 04:29:00 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b cabe0e9f-deda-4e0c-be3e-c6a371e3ce03 -t 2000 00:17:21.530 [ 00:17:21.530 { 00:17:21.530 "name": "cabe0e9f-deda-4e0c-be3e-c6a371e3ce03", 00:17:21.530 "aliases": [ 00:17:21.530 "lvs/lvol" 00:17:21.530 ], 00:17:21.530 "product_name": "Logical Volume", 00:17:21.530 "block_size": 4096, 00:17:21.530 "num_blocks": 38912, 00:17:21.530 "uuid": "cabe0e9f-deda-4e0c-be3e-c6a371e3ce03", 00:17:21.530 "assigned_rate_limits": { 00:17:21.530 "rw_ios_per_sec": 0, 00:17:21.530 "rw_mbytes_per_sec": 0, 00:17:21.530 "r_mbytes_per_sec": 0, 00:17:21.530 "w_mbytes_per_sec": 0 00:17:21.530 }, 00:17:21.530 "claimed": false, 00:17:21.530 "zoned": false, 00:17:21.530 "supported_io_types": { 00:17:21.530 "read": true, 00:17:21.530 "write": true, 00:17:21.530 "unmap": true, 00:17:21.530 "write_zeroes": true, 00:17:21.530 "flush": false, 00:17:21.530 "reset": true, 00:17:21.530 "compare": false, 00:17:21.530 "compare_and_write": false, 00:17:21.530 "abort": false, 00:17:21.530 "nvme_admin": false, 00:17:21.530 "nvme_io": false 00:17:21.530 }, 00:17:21.530 "driver_specific": { 00:17:21.530 "lvol": { 00:17:21.530 "lvol_store_uuid": "0bca843a-d9a1-472b-ac9b-0a4834fd2172", 00:17:21.530 "base_bdev": "aio_bdev", 00:17:21.530 "thin_provision": false, 00:17:21.530 "snapshot": false, 00:17:21.530 "clone": false, 00:17:21.530 "esnap_clone": false 00:17:21.530 } 00:17:21.530 } 00:17:21.530 } 00:17:21.530 ] 00:17:21.530 04:29:00 -- common/autotest_common.sh@905 -- # return 0 00:17:21.530 04:29:00 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0bca843a-d9a1-472b-ac9b-0a4834fd2172 00:17:21.530 04:29:00 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:21.789 04:29:00 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:21.789 04:29:00 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0bca843a-d9a1-472b-ac9b-0a4834fd2172 00:17:21.789 04:29:00 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:22.048 04:29:01 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:22.048 04:29:01 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete cabe0e9f-deda-4e0c-be3e-c6a371e3ce03 00:17:22.306 04:29:01 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 0bca843a-d9a1-472b-ac9b-0a4834fd2172 00:17:22.565 04:29:01 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:22.823 04:29:01 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:22.823 00:17:22.823 real 0m18.188s 00:17:22.823 user 0m17.926s 00:17:22.823 sys 0m1.826s 00:17:22.823 04:29:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:22.823 04:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:22.823 ************************************ 00:17:22.823 END TEST lvs_grow_clean 00:17:22.823 ************************************ 00:17:22.823 04:29:01 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:22.823 04:29:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:22.823 04:29:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:22.823 04:29:01 -- common/autotest_common.sh@10 -- # set +x 00:17:22.823 ************************************ 00:17:22.823 START TEST lvs_grow_dirty 00:17:22.823 ************************************ 00:17:22.823 04:29:01 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:17:22.823 04:29:01 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:22.823 04:29:01 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:22.823 04:29:01 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:22.823 04:29:01 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:22.823 04:29:01 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:22.823 04:29:01 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:22.823 04:29:01 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:22.823 04:29:01 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:22.823 04:29:01 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:23.082 04:29:02 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:23.082 04:29:02 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:23.340 04:29:02 -- target/nvmf_lvs_grow.sh@28 -- # lvs=b94d1724-fd56-4e84-ac60-657f112c1624 00:17:23.340 04:29:02 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:23.340 04:29:02 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:23.598 04:29:02 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:23.598 04:29:02 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:23.598 04:29:02 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u b94d1724-fd56-4e84-ac60-657f112c1624 lvol 150 00:17:23.857 04:29:02 -- target/nvmf_lvs_grow.sh@33 -- # lvol=bbe50336-7fe9-4b2f-99f1-237145d151cf 00:17:23.857 04:29:02 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:23.857 04:29:02 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:24.116 [2024-11-26 04:29:03.236121] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:24.116 [2024-11-26 04:29:03.236203] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:24.116 true 00:17:24.116 04:29:03 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:24.116 04:29:03 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:24.374 04:29:03 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:24.374 04:29:03 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:24.633 04:29:03 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bbe50336-7fe9-4b2f-99f1-237145d151cf 00:17:24.891 04:29:04 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:25.149 04:29:04 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:25.408 04:29:04 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2908592 00:17:25.408 04:29:04 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:25.408 04:29:04 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:25.408 04:29:04 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2908592 /var/tmp/bdevperf.sock 00:17:25.408 04:29:04 -- common/autotest_common.sh@829 -- # '[' -z 2908592 ']' 00:17:25.408 04:29:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:25.408 04:29:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:25.408 04:29:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:25.408 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:25.408 04:29:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:25.408 04:29:04 -- common/autotest_common.sh@10 -- # set +x 00:17:25.408 [2024-11-26 04:29:04.561841] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:25.408 [2024-11-26 04:29:04.561919] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2908592 ] 00:17:25.408 EAL: No free 2048 kB hugepages reported on node 1 00:17:25.408 [2024-11-26 04:29:04.623797] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:25.667 [2024-11-26 04:29:04.713173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:25.667 04:29:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:25.667 04:29:04 -- common/autotest_common.sh@862 -- # return 0 00:17:25.667 04:29:04 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:26.233 Nvme0n1 00:17:26.233 04:29:05 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:26.491 [ 00:17:26.491 { 00:17:26.491 "name": "Nvme0n1", 00:17:26.491 "aliases": [ 00:17:26.491 "bbe50336-7fe9-4b2f-99f1-237145d151cf" 00:17:26.491 ], 00:17:26.491 "product_name": "NVMe disk", 00:17:26.491 "block_size": 4096, 00:17:26.491 "num_blocks": 38912, 00:17:26.491 "uuid": "bbe50336-7fe9-4b2f-99f1-237145d151cf", 00:17:26.491 "assigned_rate_limits": { 00:17:26.491 "rw_ios_per_sec": 0, 00:17:26.491 "rw_mbytes_per_sec": 0, 00:17:26.491 "r_mbytes_per_sec": 0, 00:17:26.491 "w_mbytes_per_sec": 0 00:17:26.491 }, 00:17:26.491 "claimed": false, 00:17:26.491 "zoned": false, 00:17:26.491 "supported_io_types": { 00:17:26.491 "read": true, 00:17:26.491 "write": true, 00:17:26.491 "unmap": true, 00:17:26.491 "write_zeroes": true, 00:17:26.491 "flush": true, 00:17:26.491 "reset": true, 00:17:26.491 "compare": true, 00:17:26.491 "compare_and_write": true, 00:17:26.491 "abort": true, 00:17:26.491 "nvme_admin": true, 00:17:26.491 "nvme_io": true 00:17:26.491 }, 00:17:26.491 "driver_specific": { 00:17:26.491 "nvme": [ 00:17:26.491 { 00:17:26.491 "trid": { 00:17:26.491 "trtype": "TCP", 00:17:26.491 "adrfam": "IPv4", 00:17:26.491 "traddr": "10.0.0.2", 00:17:26.491 "trsvcid": "4420", 00:17:26.491 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:26.491 }, 00:17:26.491 "ctrlr_data": { 00:17:26.491 "cntlid": 1, 00:17:26.491 "vendor_id": "0x8086", 00:17:26.491 "model_number": "SPDK bdev Controller", 00:17:26.491 "serial_number": "SPDK0", 00:17:26.491 "firmware_revision": "24.01.1", 00:17:26.491 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:26.491 "oacs": { 00:17:26.491 "security": 0, 00:17:26.491 "format": 0, 00:17:26.491 "firmware": 0, 00:17:26.491 "ns_manage": 0 00:17:26.491 }, 00:17:26.491 "multi_ctrlr": true, 00:17:26.491 "ana_reporting": false 00:17:26.491 }, 00:17:26.491 "vs": { 00:17:26.491 "nvme_version": "1.3" 00:17:26.491 }, 00:17:26.491 "ns_data": { 00:17:26.491 "id": 1, 00:17:26.491 "can_share": true 00:17:26.491 } 00:17:26.491 } 00:17:26.491 ], 00:17:26.491 "mp_policy": "active_passive" 00:17:26.491 } 00:17:26.491 } 00:17:26.491 ] 00:17:26.491 04:29:05 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2908731 00:17:26.491 04:29:05 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:26.491 04:29:05 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:26.491 Running I/O for 10 seconds... 00:17:27.425 Latency(us) 00:17:27.426 [2024-11-26T03:29:06.652Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:27.426 [2024-11-26T03:29:06.652Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:27.426 Nvme0n1 : 1.00 14547.00 56.82 0.00 0.00 0.00 0.00 0.00 00:17:27.426 [2024-11-26T03:29:06.652Z] =================================================================================================================== 00:17:27.426 [2024-11-26T03:29:06.652Z] Total : 14547.00 56.82 0.00 0.00 0.00 0.00 0.00 00:17:27.426 00:17:28.358 04:29:07 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:28.616 [2024-11-26T03:29:07.842Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:28.616 Nvme0n1 : 2.00 14708.00 57.45 0.00 0.00 0.00 0.00 0.00 00:17:28.616 [2024-11-26T03:29:07.842Z] =================================================================================================================== 00:17:28.616 [2024-11-26T03:29:07.842Z] Total : 14708.00 57.45 0.00 0.00 0.00 0.00 0.00 00:17:28.616 00:17:28.616 true 00:17:28.875 04:29:07 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:28.875 04:29:07 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:29.132 04:29:08 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:29.132 04:29:08 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:29.132 04:29:08 -- target/nvmf_lvs_grow.sh@65 -- # wait 2908731 00:17:29.699 [2024-11-26T03:29:08.925Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:29.699 Nvme0n1 : 3.00 14772.33 57.70 0.00 0.00 0.00 0.00 0.00 00:17:29.699 [2024-11-26T03:29:08.925Z] =================================================================================================================== 00:17:29.699 [2024-11-26T03:29:08.925Z] Total : 14772.33 57.70 0.00 0.00 0.00 0.00 0.00 00:17:29.699 00:17:30.633 [2024-11-26T03:29:09.859Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:30.633 Nvme0n1 : 4.00 14859.75 58.05 0.00 0.00 0.00 0.00 0.00 00:17:30.633 [2024-11-26T03:29:09.859Z] =================================================================================================================== 00:17:30.633 [2024-11-26T03:29:09.859Z] Total : 14859.75 58.05 0.00 0.00 0.00 0.00 0.00 00:17:30.633 00:17:31.567 [2024-11-26T03:29:10.793Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:31.567 Nvme0n1 : 5.00 14911.00 58.25 0.00 0.00 0.00 0.00 0.00 00:17:31.567 [2024-11-26T03:29:10.793Z] =================================================================================================================== 00:17:31.567 [2024-11-26T03:29:10.793Z] Total : 14911.00 58.25 0.00 0.00 0.00 0.00 0.00 00:17:31.567 00:17:32.502 [2024-11-26T03:29:11.728Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:32.502 Nvme0n1 : 6.00 14971.00 58.48 0.00 0.00 0.00 0.00 0.00 00:17:32.502 [2024-11-26T03:29:11.728Z] =================================================================================================================== 00:17:32.502 [2024-11-26T03:29:11.728Z] Total : 14971.00 58.48 0.00 0.00 0.00 0.00 0.00 00:17:32.502 00:17:33.877 [2024-11-26T03:29:13.103Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:33.877 Nvme0n1 : 7.00 15013.57 58.65 0.00 0.00 0.00 0.00 0.00 00:17:33.877 [2024-11-26T03:29:13.103Z] =================================================================================================================== 00:17:33.877 [2024-11-26T03:29:13.103Z] Total : 15013.57 58.65 0.00 0.00 0.00 0.00 0.00 00:17:33.877 00:17:34.445 [2024-11-26T03:29:13.671Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:34.445 Nvme0n1 : 8.00 15059.62 58.83 0.00 0.00 0.00 0.00 0.00 00:17:34.445 [2024-11-26T03:29:13.671Z] =================================================================================================================== 00:17:34.445 [2024-11-26T03:29:13.671Z] Total : 15059.62 58.83 0.00 0.00 0.00 0.00 0.00 00:17:34.445 00:17:35.820 [2024-11-26T03:29:15.046Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:35.820 Nvme0n1 : 9.00 15092.00 58.95 0.00 0.00 0.00 0.00 0.00 00:17:35.820 [2024-11-26T03:29:15.046Z] =================================================================================================================== 00:17:35.820 [2024-11-26T03:29:15.046Z] Total : 15092.00 58.95 0.00 0.00 0.00 0.00 0.00 00:17:35.820 00:17:36.753 [2024-11-26T03:29:15.979Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:36.753 Nvme0n1 : 10.00 15127.50 59.09 0.00 0.00 0.00 0.00 0.00 00:17:36.753 [2024-11-26T03:29:15.979Z] =================================================================================================================== 00:17:36.753 [2024-11-26T03:29:15.979Z] Total : 15127.50 59.09 0.00 0.00 0.00 0.00 0.00 00:17:36.753 00:17:36.753 00:17:36.753 Latency(us) 00:17:36.753 [2024-11-26T03:29:15.979Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:36.753 [2024-11-26T03:29:15.979Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:36.753 Nvme0n1 : 10.01 15127.70 59.09 0.00 0.00 8456.64 2354.44 20971.52 00:17:36.753 [2024-11-26T03:29:15.979Z] =================================================================================================================== 00:17:36.753 [2024-11-26T03:29:15.979Z] Total : 15127.70 59.09 0.00 0.00 8456.64 2354.44 20971.52 00:17:36.753 0 00:17:36.753 04:29:15 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2908592 00:17:36.753 04:29:15 -- common/autotest_common.sh@936 -- # '[' -z 2908592 ']' 00:17:36.753 04:29:15 -- common/autotest_common.sh@940 -- # kill -0 2908592 00:17:36.753 04:29:15 -- common/autotest_common.sh@941 -- # uname 00:17:36.753 04:29:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:36.753 04:29:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2908592 00:17:36.753 04:29:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:36.753 04:29:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:36.753 04:29:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2908592' 00:17:36.753 killing process with pid 2908592 00:17:36.753 04:29:15 -- common/autotest_common.sh@955 -- # kill 2908592 00:17:36.753 Received shutdown signal, test time was about 10.000000 seconds 00:17:36.753 00:17:36.753 Latency(us) 00:17:36.753 [2024-11-26T03:29:15.979Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:36.753 [2024-11-26T03:29:15.979Z] =================================================================================================================== 00:17:36.753 [2024-11-26T03:29:15.979Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:36.753 04:29:15 -- common/autotest_common.sh@960 -- # wait 2908592 00:17:36.753 04:29:15 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:37.011 04:29:16 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:37.011 04:29:16 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:37.269 04:29:16 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:37.269 04:29:16 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:17:37.269 04:29:16 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2905770 00:17:37.269 04:29:16 -- target/nvmf_lvs_grow.sh@74 -- # wait 2905770 00:17:37.528 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2905770 Killed "${NVMF_APP[@]}" "$@" 00:17:37.528 04:29:16 -- target/nvmf_lvs_grow.sh@74 -- # true 00:17:37.528 04:29:16 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:17:37.528 04:29:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:37.528 04:29:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:37.528 04:29:16 -- common/autotest_common.sh@10 -- # set +x 00:17:37.528 04:29:16 -- nvmf/common.sh@469 -- # nvmfpid=2909971 00:17:37.528 04:29:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:37.528 04:29:16 -- nvmf/common.sh@470 -- # waitforlisten 2909971 00:17:37.528 04:29:16 -- common/autotest_common.sh@829 -- # '[' -z 2909971 ']' 00:17:37.528 04:29:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:37.528 04:29:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:37.528 04:29:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:37.528 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:37.528 04:29:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:37.528 04:29:16 -- common/autotest_common.sh@10 -- # set +x 00:17:37.528 [2024-11-26 04:29:16.542389] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:37.528 [2024-11-26 04:29:16.542478] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:37.528 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.528 [2024-11-26 04:29:16.615081] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:37.528 [2024-11-26 04:29:16.707182] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:37.528 [2024-11-26 04:29:16.707374] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:37.528 [2024-11-26 04:29:16.707393] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:37.528 [2024-11-26 04:29:16.707416] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:37.528 [2024-11-26 04:29:16.707450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:38.463 04:29:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:38.463 04:29:17 -- common/autotest_common.sh@862 -- # return 0 00:17:38.463 04:29:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:38.463 04:29:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:38.463 04:29:17 -- common/autotest_common.sh@10 -- # set +x 00:17:38.463 04:29:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:38.463 04:29:17 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:38.722 [2024-11-26 04:29:17.812244] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:17:38.722 [2024-11-26 04:29:17.812414] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:17:38.722 [2024-11-26 04:29:17.812472] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:17:38.722 04:29:17 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:17:38.722 04:29:17 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev bbe50336-7fe9-4b2f-99f1-237145d151cf 00:17:38.722 04:29:17 -- common/autotest_common.sh@897 -- # local bdev_name=bbe50336-7fe9-4b2f-99f1-237145d151cf 00:17:38.722 04:29:17 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:38.722 04:29:17 -- common/autotest_common.sh@899 -- # local i 00:17:38.722 04:29:17 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:38.722 04:29:17 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:38.722 04:29:17 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:39.001 04:29:18 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b bbe50336-7fe9-4b2f-99f1-237145d151cf -t 2000 00:17:39.270 [ 00:17:39.270 { 00:17:39.270 "name": "bbe50336-7fe9-4b2f-99f1-237145d151cf", 00:17:39.270 "aliases": [ 00:17:39.270 "lvs/lvol" 00:17:39.270 ], 00:17:39.270 "product_name": "Logical Volume", 00:17:39.270 "block_size": 4096, 00:17:39.270 "num_blocks": 38912, 00:17:39.270 "uuid": "bbe50336-7fe9-4b2f-99f1-237145d151cf", 00:17:39.270 "assigned_rate_limits": { 00:17:39.270 "rw_ios_per_sec": 0, 00:17:39.270 "rw_mbytes_per_sec": 0, 00:17:39.270 "r_mbytes_per_sec": 0, 00:17:39.270 "w_mbytes_per_sec": 0 00:17:39.270 }, 00:17:39.270 "claimed": false, 00:17:39.270 "zoned": false, 00:17:39.270 "supported_io_types": { 00:17:39.270 "read": true, 00:17:39.270 "write": true, 00:17:39.270 "unmap": true, 00:17:39.270 "write_zeroes": true, 00:17:39.270 "flush": false, 00:17:39.270 "reset": true, 00:17:39.270 "compare": false, 00:17:39.270 "compare_and_write": false, 00:17:39.270 "abort": false, 00:17:39.270 "nvme_admin": false, 00:17:39.270 "nvme_io": false 00:17:39.270 }, 00:17:39.270 "driver_specific": { 00:17:39.270 "lvol": { 00:17:39.270 "lvol_store_uuid": "b94d1724-fd56-4e84-ac60-657f112c1624", 00:17:39.270 "base_bdev": "aio_bdev", 00:17:39.270 "thin_provision": false, 00:17:39.270 "snapshot": false, 00:17:39.270 "clone": false, 00:17:39.270 "esnap_clone": false 00:17:39.270 } 00:17:39.270 } 00:17:39.270 } 00:17:39.270 ] 00:17:39.270 04:29:18 -- common/autotest_common.sh@905 -- # return 0 00:17:39.270 04:29:18 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:39.270 04:29:18 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:17:39.538 04:29:18 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:17:39.538 04:29:18 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:39.538 04:29:18 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:17:39.797 04:29:18 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:17:39.797 04:29:18 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:40.058 [2024-11-26 04:29:19.129545] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:40.058 04:29:19 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:40.058 04:29:19 -- common/autotest_common.sh@650 -- # local es=0 00:17:40.058 04:29:19 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:40.058 04:29:19 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:40.058 04:29:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.058 04:29:19 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:40.058 04:29:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.058 04:29:19 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:40.058 04:29:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.058 04:29:19 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:40.058 04:29:19 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:40.058 04:29:19 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:40.315 request: 00:17:40.315 { 00:17:40.315 "uuid": "b94d1724-fd56-4e84-ac60-657f112c1624", 00:17:40.315 "method": "bdev_lvol_get_lvstores", 00:17:40.316 "req_id": 1 00:17:40.316 } 00:17:40.316 Got JSON-RPC error response 00:17:40.316 response: 00:17:40.316 { 00:17:40.316 "code": -19, 00:17:40.316 "message": "No such device" 00:17:40.316 } 00:17:40.316 04:29:19 -- common/autotest_common.sh@653 -- # es=1 00:17:40.316 04:29:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:40.316 04:29:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:40.316 04:29:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:40.316 04:29:19 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:40.573 aio_bdev 00:17:40.573 04:29:19 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev bbe50336-7fe9-4b2f-99f1-237145d151cf 00:17:40.573 04:29:19 -- common/autotest_common.sh@897 -- # local bdev_name=bbe50336-7fe9-4b2f-99f1-237145d151cf 00:17:40.573 04:29:19 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:40.573 04:29:19 -- common/autotest_common.sh@899 -- # local i 00:17:40.573 04:29:19 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:40.573 04:29:19 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:40.573 04:29:19 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:40.832 04:29:19 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b bbe50336-7fe9-4b2f-99f1-237145d151cf -t 2000 00:17:41.090 [ 00:17:41.090 { 00:17:41.090 "name": "bbe50336-7fe9-4b2f-99f1-237145d151cf", 00:17:41.090 "aliases": [ 00:17:41.090 "lvs/lvol" 00:17:41.090 ], 00:17:41.090 "product_name": "Logical Volume", 00:17:41.090 "block_size": 4096, 00:17:41.090 "num_blocks": 38912, 00:17:41.090 "uuid": "bbe50336-7fe9-4b2f-99f1-237145d151cf", 00:17:41.090 "assigned_rate_limits": { 00:17:41.090 "rw_ios_per_sec": 0, 00:17:41.090 "rw_mbytes_per_sec": 0, 00:17:41.090 "r_mbytes_per_sec": 0, 00:17:41.090 "w_mbytes_per_sec": 0 00:17:41.090 }, 00:17:41.090 "claimed": false, 00:17:41.090 "zoned": false, 00:17:41.090 "supported_io_types": { 00:17:41.090 "read": true, 00:17:41.090 "write": true, 00:17:41.090 "unmap": true, 00:17:41.090 "write_zeroes": true, 00:17:41.090 "flush": false, 00:17:41.090 "reset": true, 00:17:41.090 "compare": false, 00:17:41.090 "compare_and_write": false, 00:17:41.090 "abort": false, 00:17:41.090 "nvme_admin": false, 00:17:41.090 "nvme_io": false 00:17:41.090 }, 00:17:41.090 "driver_specific": { 00:17:41.090 "lvol": { 00:17:41.090 "lvol_store_uuid": "b94d1724-fd56-4e84-ac60-657f112c1624", 00:17:41.090 "base_bdev": "aio_bdev", 00:17:41.090 "thin_provision": false, 00:17:41.090 "snapshot": false, 00:17:41.090 "clone": false, 00:17:41.090 "esnap_clone": false 00:17:41.090 } 00:17:41.090 } 00:17:41.090 } 00:17:41.090 ] 00:17:41.090 04:29:20 -- common/autotest_common.sh@905 -- # return 0 00:17:41.090 04:29:20 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:41.090 04:29:20 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:41.349 04:29:20 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:41.349 04:29:20 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:41.349 04:29:20 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:41.607 04:29:20 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:41.607 04:29:20 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete bbe50336-7fe9-4b2f-99f1-237145d151cf 00:17:41.865 04:29:21 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u b94d1724-fd56-4e84-ac60-657f112c1624 00:17:42.123 04:29:21 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:42.382 04:29:21 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:42.382 00:17:42.382 real 0m19.676s 00:17:42.382 user 0m49.800s 00:17:42.382 sys 0m4.614s 00:17:42.382 04:29:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:42.382 04:29:21 -- common/autotest_common.sh@10 -- # set +x 00:17:42.382 ************************************ 00:17:42.382 END TEST lvs_grow_dirty 00:17:42.382 ************************************ 00:17:42.382 04:29:21 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:17:42.382 04:29:21 -- common/autotest_common.sh@806 -- # type=--id 00:17:42.382 04:29:21 -- common/autotest_common.sh@807 -- # id=0 00:17:42.382 04:29:21 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:17:42.382 04:29:21 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:42.382 04:29:21 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:17:42.382 04:29:21 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:17:42.382 04:29:21 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:17:42.382 04:29:21 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:42.382 nvmf_trace.0 00:17:42.382 04:29:21 -- common/autotest_common.sh@821 -- # return 0 00:17:42.382 04:29:21 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:17:42.382 04:29:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:42.382 04:29:21 -- nvmf/common.sh@116 -- # sync 00:17:42.382 04:29:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:42.382 04:29:21 -- nvmf/common.sh@119 -- # set +e 00:17:42.382 04:29:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:42.382 04:29:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:42.382 rmmod nvme_tcp 00:17:42.640 rmmod nvme_fabrics 00:17:42.640 rmmod nvme_keyring 00:17:42.640 04:29:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:42.640 04:29:21 -- nvmf/common.sh@123 -- # set -e 00:17:42.640 04:29:21 -- nvmf/common.sh@124 -- # return 0 00:17:42.640 04:29:21 -- nvmf/common.sh@477 -- # '[' -n 2909971 ']' 00:17:42.640 04:29:21 -- nvmf/common.sh@478 -- # killprocess 2909971 00:17:42.640 04:29:21 -- common/autotest_common.sh@936 -- # '[' -z 2909971 ']' 00:17:42.640 04:29:21 -- common/autotest_common.sh@940 -- # kill -0 2909971 00:17:42.640 04:29:21 -- common/autotest_common.sh@941 -- # uname 00:17:42.640 04:29:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:42.640 04:29:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2909971 00:17:42.640 04:29:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:42.640 04:29:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:42.640 04:29:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2909971' 00:17:42.640 killing process with pid 2909971 00:17:42.640 04:29:21 -- common/autotest_common.sh@955 -- # kill 2909971 00:17:42.640 04:29:21 -- common/autotest_common.sh@960 -- # wait 2909971 00:17:42.900 04:29:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:42.900 04:29:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:42.900 04:29:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:42.900 04:29:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:42.900 04:29:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:42.900 04:29:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:42.900 04:29:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:42.900 04:29:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:44.806 04:29:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:44.806 00:17:44.806 real 0m44.123s 00:17:44.806 user 1m14.549s 00:17:44.806 sys 0m8.348s 00:17:44.806 04:29:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:44.806 04:29:23 -- common/autotest_common.sh@10 -- # set +x 00:17:44.806 ************************************ 00:17:44.806 END TEST nvmf_lvs_grow 00:17:44.806 ************************************ 00:17:44.806 04:29:23 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:44.806 04:29:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:44.806 04:29:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:44.806 04:29:23 -- common/autotest_common.sh@10 -- # set +x 00:17:44.806 ************************************ 00:17:44.806 START TEST nvmf_bdev_io_wait 00:17:44.806 ************************************ 00:17:44.806 04:29:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:45.064 * Looking for test storage... 00:17:45.064 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:45.064 04:29:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:45.064 04:29:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:45.064 04:29:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:45.064 04:29:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:45.064 04:29:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:45.064 04:29:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:45.064 04:29:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:45.064 04:29:24 -- scripts/common.sh@335 -- # IFS=.-: 00:17:45.064 04:29:24 -- scripts/common.sh@335 -- # read -ra ver1 00:17:45.064 04:29:24 -- scripts/common.sh@336 -- # IFS=.-: 00:17:45.064 04:29:24 -- scripts/common.sh@336 -- # read -ra ver2 00:17:45.064 04:29:24 -- scripts/common.sh@337 -- # local 'op=<' 00:17:45.064 04:29:24 -- scripts/common.sh@339 -- # ver1_l=2 00:17:45.064 04:29:24 -- scripts/common.sh@340 -- # ver2_l=1 00:17:45.064 04:29:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:45.065 04:29:24 -- scripts/common.sh@343 -- # case "$op" in 00:17:45.065 04:29:24 -- scripts/common.sh@344 -- # : 1 00:17:45.065 04:29:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:45.065 04:29:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:45.065 04:29:24 -- scripts/common.sh@364 -- # decimal 1 00:17:45.065 04:29:24 -- scripts/common.sh@352 -- # local d=1 00:17:45.065 04:29:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:45.065 04:29:24 -- scripts/common.sh@354 -- # echo 1 00:17:45.065 04:29:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:45.065 04:29:24 -- scripts/common.sh@365 -- # decimal 2 00:17:45.065 04:29:24 -- scripts/common.sh@352 -- # local d=2 00:17:45.065 04:29:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:45.065 04:29:24 -- scripts/common.sh@354 -- # echo 2 00:17:45.065 04:29:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:45.065 04:29:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:45.065 04:29:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:45.065 04:29:24 -- scripts/common.sh@367 -- # return 0 00:17:45.065 04:29:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:45.065 04:29:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:45.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:45.065 --rc genhtml_branch_coverage=1 00:17:45.065 --rc genhtml_function_coverage=1 00:17:45.065 --rc genhtml_legend=1 00:17:45.065 --rc geninfo_all_blocks=1 00:17:45.065 --rc geninfo_unexecuted_blocks=1 00:17:45.065 00:17:45.065 ' 00:17:45.065 04:29:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:45.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:45.065 --rc genhtml_branch_coverage=1 00:17:45.065 --rc genhtml_function_coverage=1 00:17:45.065 --rc genhtml_legend=1 00:17:45.065 --rc geninfo_all_blocks=1 00:17:45.065 --rc geninfo_unexecuted_blocks=1 00:17:45.065 00:17:45.065 ' 00:17:45.065 04:29:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:45.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:45.065 --rc genhtml_branch_coverage=1 00:17:45.065 --rc genhtml_function_coverage=1 00:17:45.065 --rc genhtml_legend=1 00:17:45.065 --rc geninfo_all_blocks=1 00:17:45.065 --rc geninfo_unexecuted_blocks=1 00:17:45.065 00:17:45.065 ' 00:17:45.065 04:29:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:45.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:45.065 --rc genhtml_branch_coverage=1 00:17:45.065 --rc genhtml_function_coverage=1 00:17:45.065 --rc genhtml_legend=1 00:17:45.065 --rc geninfo_all_blocks=1 00:17:45.065 --rc geninfo_unexecuted_blocks=1 00:17:45.065 00:17:45.065 ' 00:17:45.065 04:29:24 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:45.065 04:29:24 -- nvmf/common.sh@7 -- # uname -s 00:17:45.065 04:29:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:45.065 04:29:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:45.065 04:29:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:45.065 04:29:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:45.065 04:29:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:45.065 04:29:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:45.065 04:29:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:45.065 04:29:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:45.065 04:29:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:45.065 04:29:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:45.065 04:29:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:45.065 04:29:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:45.065 04:29:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:45.065 04:29:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:45.065 04:29:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:45.065 04:29:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:45.065 04:29:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:45.065 04:29:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:45.065 04:29:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:45.065 04:29:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.065 04:29:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.065 04:29:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.065 04:29:24 -- paths/export.sh@5 -- # export PATH 00:17:45.065 04:29:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.065 04:29:24 -- nvmf/common.sh@46 -- # : 0 00:17:45.065 04:29:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:45.065 04:29:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:45.065 04:29:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:45.065 04:29:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:45.065 04:29:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:45.065 04:29:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:45.065 04:29:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:45.065 04:29:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:45.065 04:29:24 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:45.065 04:29:24 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:45.065 04:29:24 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:17:45.065 04:29:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:45.065 04:29:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:45.065 04:29:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:45.065 04:29:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:45.065 04:29:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:45.065 04:29:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:45.065 04:29:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:45.065 04:29:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:45.065 04:29:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:45.065 04:29:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:45.065 04:29:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:45.065 04:29:24 -- common/autotest_common.sh@10 -- # set +x 00:17:47.594 04:29:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:47.594 04:29:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:47.594 04:29:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:47.594 04:29:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:47.594 04:29:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:47.594 04:29:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:47.594 04:29:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:47.594 04:29:26 -- nvmf/common.sh@294 -- # net_devs=() 00:17:47.594 04:29:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:47.594 04:29:26 -- nvmf/common.sh@295 -- # e810=() 00:17:47.594 04:29:26 -- nvmf/common.sh@295 -- # local -ga e810 00:17:47.594 04:29:26 -- nvmf/common.sh@296 -- # x722=() 00:17:47.594 04:29:26 -- nvmf/common.sh@296 -- # local -ga x722 00:17:47.594 04:29:26 -- nvmf/common.sh@297 -- # mlx=() 00:17:47.594 04:29:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:47.594 04:29:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:47.594 04:29:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:47.594 04:29:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:47.594 04:29:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:47.594 04:29:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:47.594 04:29:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:47.594 04:29:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:47.594 04:29:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:47.594 04:29:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:47.594 04:29:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:47.595 04:29:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:47.595 04:29:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:47.595 04:29:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:47.595 04:29:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:47.595 04:29:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:47.595 04:29:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:47.595 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:47.595 04:29:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:47.595 04:29:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:47.595 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:47.595 04:29:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:47.595 04:29:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:47.595 04:29:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:47.595 04:29:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:47.595 04:29:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:47.595 04:29:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:47.595 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:47.595 04:29:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:47.595 04:29:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:47.595 04:29:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:47.595 04:29:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:47.595 04:29:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:47.595 04:29:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:47.595 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:47.595 04:29:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:47.595 04:29:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:47.595 04:29:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:47.595 04:29:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:47.595 04:29:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:47.595 04:29:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:47.595 04:29:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:47.595 04:29:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:47.595 04:29:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:47.595 04:29:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:47.595 04:29:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:47.595 04:29:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:47.595 04:29:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:47.595 04:29:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:47.595 04:29:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:47.595 04:29:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:47.595 04:29:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:47.595 04:29:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:47.595 04:29:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:47.595 04:29:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:47.595 04:29:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:47.595 04:29:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:47.595 04:29:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:47.595 04:29:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:47.595 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:47.595 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.255 ms 00:17:47.595 00:17:47.595 --- 10.0.0.2 ping statistics --- 00:17:47.595 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:47.595 rtt min/avg/max/mdev = 0.255/0.255/0.255/0.000 ms 00:17:47.595 04:29:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:47.595 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:47.595 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.153 ms 00:17:47.595 00:17:47.595 --- 10.0.0.1 ping statistics --- 00:17:47.595 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:47.595 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:17:47.595 04:29:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:47.595 04:29:26 -- nvmf/common.sh@410 -- # return 0 00:17:47.595 04:29:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:47.595 04:29:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:47.595 04:29:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:47.595 04:29:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:47.595 04:29:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:47.595 04:29:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:47.595 04:29:26 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:17:47.595 04:29:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:47.595 04:29:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:47.595 04:29:26 -- common/autotest_common.sh@10 -- # set +x 00:17:47.595 04:29:26 -- nvmf/common.sh@469 -- # nvmfpid=2912657 00:17:47.595 04:29:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:17:47.595 04:29:26 -- nvmf/common.sh@470 -- # waitforlisten 2912657 00:17:47.595 04:29:26 -- common/autotest_common.sh@829 -- # '[' -z 2912657 ']' 00:17:47.595 04:29:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:47.595 04:29:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:47.595 04:29:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:47.595 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:47.595 04:29:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:47.595 04:29:26 -- common/autotest_common.sh@10 -- # set +x 00:17:47.595 [2024-11-26 04:29:26.433398] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:47.595 [2024-11-26 04:29:26.433489] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:47.595 EAL: No free 2048 kB hugepages reported on node 1 00:17:47.595 [2024-11-26 04:29:26.501774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:47.595 [2024-11-26 04:29:26.593590] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:47.595 [2024-11-26 04:29:26.593782] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:47.595 [2024-11-26 04:29:26.593804] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:47.595 [2024-11-26 04:29:26.593819] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:47.595 [2024-11-26 04:29:26.593877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:47.595 [2024-11-26 04:29:26.593955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:47.595 [2024-11-26 04:29:26.594679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:47.595 [2024-11-26 04:29:26.595030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:47.595 04:29:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:47.595 04:29:26 -- common/autotest_common.sh@862 -- # return 0 00:17:47.595 04:29:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:47.595 04:29:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:47.595 04:29:26 -- common/autotest_common.sh@10 -- # set +x 00:17:47.595 04:29:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:47.595 04:29:26 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:17:47.595 04:29:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:47.595 04:29:26 -- common/autotest_common.sh@10 -- # set +x 00:17:47.595 04:29:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:47.595 04:29:26 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:17:47.595 04:29:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:47.595 04:29:26 -- common/autotest_common.sh@10 -- # set +x 00:17:47.595 04:29:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:47.595 04:29:26 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:47.595 04:29:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:47.595 04:29:26 -- common/autotest_common.sh@10 -- # set +x 00:17:47.595 [2024-11-26 04:29:26.753075] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:47.595 04:29:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:47.595 04:29:26 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:47.595 04:29:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:47.595 04:29:26 -- common/autotest_common.sh@10 -- # set +x 00:17:47.595 Malloc0 00:17:47.595 04:29:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:47.595 04:29:26 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:47.595 04:29:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:47.595 04:29:26 -- common/autotest_common.sh@10 -- # set +x 00:17:47.595 04:29:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:47.595 04:29:26 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:47.595 04:29:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:47.595 04:29:26 -- common/autotest_common.sh@10 -- # set +x 00:17:47.854 04:29:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:47.854 04:29:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:47.854 04:29:26 -- common/autotest_common.sh@10 -- # set +x 00:17:47.854 [2024-11-26 04:29:26.822359] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:47.854 04:29:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2912694 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@30 -- # READ_PID=2912696 00:17:47.854 04:29:26 -- nvmf/common.sh@520 -- # config=() 00:17:47.854 04:29:26 -- nvmf/common.sh@520 -- # local subsystem config 00:17:47.854 04:29:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:47.854 04:29:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:47.854 { 00:17:47.854 "params": { 00:17:47.854 "name": "Nvme$subsystem", 00:17:47.854 "trtype": "$TEST_TRANSPORT", 00:17:47.854 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:47.854 "adrfam": "ipv4", 00:17:47.854 "trsvcid": "$NVMF_PORT", 00:17:47.854 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:47.854 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:47.854 "hdgst": ${hdgst:-false}, 00:17:47.854 "ddgst": ${ddgst:-false} 00:17:47.854 }, 00:17:47.854 "method": "bdev_nvme_attach_controller" 00:17:47.854 } 00:17:47.854 EOF 00:17:47.854 )") 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2912698 00:17:47.854 04:29:26 -- nvmf/common.sh@520 -- # config=() 00:17:47.854 04:29:26 -- nvmf/common.sh@520 -- # local subsystem config 00:17:47.854 04:29:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:47.854 04:29:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:47.854 { 00:17:47.854 "params": { 00:17:47.854 "name": "Nvme$subsystem", 00:17:47.854 "trtype": "$TEST_TRANSPORT", 00:17:47.854 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:47.854 "adrfam": "ipv4", 00:17:47.854 "trsvcid": "$NVMF_PORT", 00:17:47.854 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:47.854 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:47.854 "hdgst": ${hdgst:-false}, 00:17:47.854 "ddgst": ${ddgst:-false} 00:17:47.854 }, 00:17:47.854 "method": "bdev_nvme_attach_controller" 00:17:47.854 } 00:17:47.854 EOF 00:17:47.854 )") 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:17:47.854 04:29:26 -- nvmf/common.sh@542 -- # cat 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2912701 00:17:47.854 04:29:26 -- nvmf/common.sh@520 -- # config=() 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@35 -- # sync 00:17:47.854 04:29:26 -- nvmf/common.sh@520 -- # local subsystem config 00:17:47.854 04:29:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:47.854 04:29:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:47.854 { 00:17:47.854 "params": { 00:17:47.854 "name": "Nvme$subsystem", 00:17:47.854 "trtype": "$TEST_TRANSPORT", 00:17:47.854 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:47.854 "adrfam": "ipv4", 00:17:47.854 "trsvcid": "$NVMF_PORT", 00:17:47.854 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:47.854 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:47.854 "hdgst": ${hdgst:-false}, 00:17:47.854 "ddgst": ${ddgst:-false} 00:17:47.854 }, 00:17:47.854 "method": "bdev_nvme_attach_controller" 00:17:47.854 } 00:17:47.854 EOF 00:17:47.854 )") 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:17:47.854 04:29:26 -- nvmf/common.sh@542 -- # cat 00:17:47.854 04:29:26 -- nvmf/common.sh@520 -- # config=() 00:17:47.854 04:29:26 -- nvmf/common.sh@520 -- # local subsystem config 00:17:47.854 04:29:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:47.854 04:29:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:47.854 { 00:17:47.854 "params": { 00:17:47.854 "name": "Nvme$subsystem", 00:17:47.854 "trtype": "$TEST_TRANSPORT", 00:17:47.854 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:47.854 "adrfam": "ipv4", 00:17:47.854 "trsvcid": "$NVMF_PORT", 00:17:47.854 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:47.854 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:47.854 "hdgst": ${hdgst:-false}, 00:17:47.854 "ddgst": ${ddgst:-false} 00:17:47.854 }, 00:17:47.854 "method": "bdev_nvme_attach_controller" 00:17:47.854 } 00:17:47.854 EOF 00:17:47.854 )") 00:17:47.854 04:29:26 -- nvmf/common.sh@542 -- # cat 00:17:47.854 04:29:26 -- target/bdev_io_wait.sh@37 -- # wait 2912694 00:17:47.854 04:29:26 -- nvmf/common.sh@542 -- # cat 00:17:47.854 04:29:26 -- nvmf/common.sh@544 -- # jq . 00:17:47.854 04:29:26 -- nvmf/common.sh@544 -- # jq . 00:17:47.854 04:29:26 -- nvmf/common.sh@545 -- # IFS=, 00:17:47.854 04:29:26 -- nvmf/common.sh@544 -- # jq . 00:17:47.854 04:29:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:47.854 "params": { 00:17:47.854 "name": "Nvme1", 00:17:47.855 "trtype": "tcp", 00:17:47.855 "traddr": "10.0.0.2", 00:17:47.855 "adrfam": "ipv4", 00:17:47.855 "trsvcid": "4420", 00:17:47.855 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:47.855 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:47.855 "hdgst": false, 00:17:47.855 "ddgst": false 00:17:47.855 }, 00:17:47.855 "method": "bdev_nvme_attach_controller" 00:17:47.855 }' 00:17:47.855 04:29:26 -- nvmf/common.sh@545 -- # IFS=, 00:17:47.855 04:29:26 -- nvmf/common.sh@544 -- # jq . 00:17:47.855 04:29:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:47.855 "params": { 00:17:47.855 "name": "Nvme1", 00:17:47.855 "trtype": "tcp", 00:17:47.855 "traddr": "10.0.0.2", 00:17:47.855 "adrfam": "ipv4", 00:17:47.855 "trsvcid": "4420", 00:17:47.855 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:47.855 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:47.855 "hdgst": false, 00:17:47.855 "ddgst": false 00:17:47.855 }, 00:17:47.855 "method": "bdev_nvme_attach_controller" 00:17:47.855 }' 00:17:47.855 04:29:26 -- nvmf/common.sh@545 -- # IFS=, 00:17:47.855 04:29:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:47.855 "params": { 00:17:47.855 "name": "Nvme1", 00:17:47.855 "trtype": "tcp", 00:17:47.855 "traddr": "10.0.0.2", 00:17:47.855 "adrfam": "ipv4", 00:17:47.855 "trsvcid": "4420", 00:17:47.855 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:47.855 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:47.855 "hdgst": false, 00:17:47.855 "ddgst": false 00:17:47.855 }, 00:17:47.855 "method": "bdev_nvme_attach_controller" 00:17:47.855 }' 00:17:47.855 04:29:26 -- nvmf/common.sh@545 -- # IFS=, 00:17:47.855 04:29:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:47.855 "params": { 00:17:47.855 "name": "Nvme1", 00:17:47.855 "trtype": "tcp", 00:17:47.855 "traddr": "10.0.0.2", 00:17:47.855 "adrfam": "ipv4", 00:17:47.855 "trsvcid": "4420", 00:17:47.855 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:47.855 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:47.855 "hdgst": false, 00:17:47.855 "ddgst": false 00:17:47.855 }, 00:17:47.855 "method": "bdev_nvme_attach_controller" 00:17:47.855 }' 00:17:47.855 [2024-11-26 04:29:26.866346] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:47.855 [2024-11-26 04:29:26.866346] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:47.855 [2024-11-26 04:29:26.866346] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:47.855 [2024-11-26 04:29:26.866431] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-26 04:29:26.866431] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-26 04:29:26.866431] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:17:47.855 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:17:47.855 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:17:47.855 [2024-11-26 04:29:26.868166] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:47.855 [2024-11-26 04:29:26.868241] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:17:47.855 EAL: No free 2048 kB hugepages reported on node 1 00:17:47.855 EAL: No free 2048 kB hugepages reported on node 1 00:17:47.855 [2024-11-26 04:29:27.040829] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:48.113 [2024-11-26 04:29:27.116471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:48.113 EAL: No free 2048 kB hugepages reported on node 1 00:17:48.113 [2024-11-26 04:29:27.145459] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:48.113 EAL: No free 2048 kB hugepages reported on node 1 00:17:48.113 [2024-11-26 04:29:27.218512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:48.113 [2024-11-26 04:29:27.271500] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:48.113 [2024-11-26 04:29:27.329513] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:48.372 [2024-11-26 04:29:27.355287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:48.372 [2024-11-26 04:29:27.399728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:17:48.372 Running I/O for 1 seconds... 00:17:48.372 Running I/O for 1 seconds... 00:17:48.631 Running I/O for 1 seconds... 00:17:48.631 Running I/O for 1 seconds... 00:17:49.566 00:17:49.566 Latency(us) 00:17:49.566 [2024-11-26T03:29:28.792Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.566 [2024-11-26T03:29:28.792Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:17:49.566 Nvme1n1 : 1.01 12185.02 47.60 0.00 0.00 10468.96 5825.42 20000.62 00:17:49.566 [2024-11-26T03:29:28.792Z] =================================================================================================================== 00:17:49.566 [2024-11-26T03:29:28.792Z] Total : 12185.02 47.60 0.00 0.00 10468.96 5825.42 20000.62 00:17:49.566 00:17:49.566 Latency(us) 00:17:49.566 [2024-11-26T03:29:28.792Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.566 [2024-11-26T03:29:28.792Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:17:49.566 Nvme1n1 : 1.02 6081.18 23.75 0.00 0.00 20887.81 11650.84 37476.88 00:17:49.566 [2024-11-26T03:29:28.792Z] =================================================================================================================== 00:17:49.566 [2024-11-26T03:29:28.792Z] Total : 6081.18 23.75 0.00 0.00 20887.81 11650.84 37476.88 00:17:49.566 00:17:49.566 Latency(us) 00:17:49.566 [2024-11-26T03:29:28.792Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.566 [2024-11-26T03:29:28.792Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:17:49.566 Nvme1n1 : 1.00 194327.87 759.09 0.00 0.00 656.13 276.10 922.36 00:17:49.566 [2024-11-26T03:29:28.792Z] =================================================================================================================== 00:17:49.566 [2024-11-26T03:29:28.792Z] Total : 194327.87 759.09 0.00 0.00 656.13 276.10 922.36 00:17:49.566 04:29:28 -- target/bdev_io_wait.sh@38 -- # wait 2912696 00:17:49.566 00:17:49.566 Latency(us) 00:17:49.566 [2024-11-26T03:29:28.792Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.566 [2024-11-26T03:29:28.792Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:17:49.566 Nvme1n1 : 1.01 6441.17 25.16 0.00 0.00 19800.75 6310.87 46991.74 00:17:49.566 [2024-11-26T03:29:28.792Z] =================================================================================================================== 00:17:49.566 [2024-11-26T03:29:28.792Z] Total : 6441.17 25.16 0.00 0.00 19800.75 6310.87 46991.74 00:17:49.825 04:29:28 -- target/bdev_io_wait.sh@39 -- # wait 2912698 00:17:49.825 04:29:28 -- target/bdev_io_wait.sh@40 -- # wait 2912701 00:17:49.825 04:29:28 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:49.825 04:29:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:49.825 04:29:28 -- common/autotest_common.sh@10 -- # set +x 00:17:49.825 04:29:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:49.825 04:29:29 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:17:49.825 04:29:29 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:17:49.825 04:29:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:49.825 04:29:29 -- nvmf/common.sh@116 -- # sync 00:17:49.825 04:29:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:49.825 04:29:29 -- nvmf/common.sh@119 -- # set +e 00:17:49.825 04:29:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:49.825 04:29:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:49.825 rmmod nvme_tcp 00:17:49.825 rmmod nvme_fabrics 00:17:49.825 rmmod nvme_keyring 00:17:50.086 04:29:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:50.086 04:29:29 -- nvmf/common.sh@123 -- # set -e 00:17:50.086 04:29:29 -- nvmf/common.sh@124 -- # return 0 00:17:50.086 04:29:29 -- nvmf/common.sh@477 -- # '[' -n 2912657 ']' 00:17:50.087 04:29:29 -- nvmf/common.sh@478 -- # killprocess 2912657 00:17:50.087 04:29:29 -- common/autotest_common.sh@936 -- # '[' -z 2912657 ']' 00:17:50.087 04:29:29 -- common/autotest_common.sh@940 -- # kill -0 2912657 00:17:50.087 04:29:29 -- common/autotest_common.sh@941 -- # uname 00:17:50.087 04:29:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:50.087 04:29:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2912657 00:17:50.087 04:29:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:50.087 04:29:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:50.087 04:29:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2912657' 00:17:50.087 killing process with pid 2912657 00:17:50.087 04:29:29 -- common/autotest_common.sh@955 -- # kill 2912657 00:17:50.087 04:29:29 -- common/autotest_common.sh@960 -- # wait 2912657 00:17:50.346 04:29:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:50.346 04:29:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:50.346 04:29:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:50.346 04:29:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:50.346 04:29:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:50.346 04:29:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:50.346 04:29:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:50.346 04:29:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:52.252 04:29:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:52.252 00:17:52.252 real 0m7.361s 00:17:52.252 user 0m16.685s 00:17:52.252 sys 0m3.604s 00:17:52.252 04:29:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:52.252 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:17:52.252 ************************************ 00:17:52.252 END TEST nvmf_bdev_io_wait 00:17:52.252 ************************************ 00:17:52.252 04:29:31 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:17:52.252 04:29:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:52.252 04:29:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:52.252 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:17:52.252 ************************************ 00:17:52.252 START TEST nvmf_queue_depth 00:17:52.252 ************************************ 00:17:52.252 04:29:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:17:52.252 * Looking for test storage... 00:17:52.252 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:52.252 04:29:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:52.252 04:29:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:52.252 04:29:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:52.510 04:29:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:52.510 04:29:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:52.510 04:29:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:52.510 04:29:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:52.510 04:29:31 -- scripts/common.sh@335 -- # IFS=.-: 00:17:52.510 04:29:31 -- scripts/common.sh@335 -- # read -ra ver1 00:17:52.510 04:29:31 -- scripts/common.sh@336 -- # IFS=.-: 00:17:52.510 04:29:31 -- scripts/common.sh@336 -- # read -ra ver2 00:17:52.510 04:29:31 -- scripts/common.sh@337 -- # local 'op=<' 00:17:52.510 04:29:31 -- scripts/common.sh@339 -- # ver1_l=2 00:17:52.510 04:29:31 -- scripts/common.sh@340 -- # ver2_l=1 00:17:52.510 04:29:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:52.510 04:29:31 -- scripts/common.sh@343 -- # case "$op" in 00:17:52.510 04:29:31 -- scripts/common.sh@344 -- # : 1 00:17:52.510 04:29:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:52.510 04:29:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:52.510 04:29:31 -- scripts/common.sh@364 -- # decimal 1 00:17:52.510 04:29:31 -- scripts/common.sh@352 -- # local d=1 00:17:52.510 04:29:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:52.511 04:29:31 -- scripts/common.sh@354 -- # echo 1 00:17:52.511 04:29:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:52.511 04:29:31 -- scripts/common.sh@365 -- # decimal 2 00:17:52.511 04:29:31 -- scripts/common.sh@352 -- # local d=2 00:17:52.511 04:29:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:52.511 04:29:31 -- scripts/common.sh@354 -- # echo 2 00:17:52.511 04:29:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:52.511 04:29:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:52.511 04:29:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:52.511 04:29:31 -- scripts/common.sh@367 -- # return 0 00:17:52.511 04:29:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:52.511 04:29:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:52.511 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:52.511 --rc genhtml_branch_coverage=1 00:17:52.511 --rc genhtml_function_coverage=1 00:17:52.511 --rc genhtml_legend=1 00:17:52.511 --rc geninfo_all_blocks=1 00:17:52.511 --rc geninfo_unexecuted_blocks=1 00:17:52.511 00:17:52.511 ' 00:17:52.511 04:29:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:52.511 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:52.511 --rc genhtml_branch_coverage=1 00:17:52.511 --rc genhtml_function_coverage=1 00:17:52.511 --rc genhtml_legend=1 00:17:52.511 --rc geninfo_all_blocks=1 00:17:52.511 --rc geninfo_unexecuted_blocks=1 00:17:52.511 00:17:52.511 ' 00:17:52.511 04:29:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:52.511 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:52.511 --rc genhtml_branch_coverage=1 00:17:52.511 --rc genhtml_function_coverage=1 00:17:52.511 --rc genhtml_legend=1 00:17:52.511 --rc geninfo_all_blocks=1 00:17:52.511 --rc geninfo_unexecuted_blocks=1 00:17:52.511 00:17:52.511 ' 00:17:52.511 04:29:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:52.511 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:52.511 --rc genhtml_branch_coverage=1 00:17:52.511 --rc genhtml_function_coverage=1 00:17:52.511 --rc genhtml_legend=1 00:17:52.511 --rc geninfo_all_blocks=1 00:17:52.511 --rc geninfo_unexecuted_blocks=1 00:17:52.511 00:17:52.511 ' 00:17:52.511 04:29:31 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:52.511 04:29:31 -- nvmf/common.sh@7 -- # uname -s 00:17:52.511 04:29:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:52.511 04:29:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:52.511 04:29:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:52.511 04:29:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:52.511 04:29:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:52.511 04:29:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:52.511 04:29:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:52.511 04:29:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:52.511 04:29:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:52.511 04:29:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:52.511 04:29:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:52.511 04:29:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:52.511 04:29:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:52.511 04:29:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:52.511 04:29:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:52.511 04:29:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:52.511 04:29:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:52.511 04:29:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:52.511 04:29:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:52.511 04:29:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:52.511 04:29:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:52.511 04:29:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:52.511 04:29:31 -- paths/export.sh@5 -- # export PATH 00:17:52.511 04:29:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:52.511 04:29:31 -- nvmf/common.sh@46 -- # : 0 00:17:52.511 04:29:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:52.511 04:29:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:52.511 04:29:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:52.511 04:29:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:52.511 04:29:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:52.511 04:29:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:52.511 04:29:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:52.511 04:29:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:52.511 04:29:31 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:17:52.511 04:29:31 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:17:52.511 04:29:31 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:52.511 04:29:31 -- target/queue_depth.sh@19 -- # nvmftestinit 00:17:52.511 04:29:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:52.511 04:29:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:52.511 04:29:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:52.511 04:29:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:52.511 04:29:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:52.511 04:29:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:52.511 04:29:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:52.511 04:29:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:52.511 04:29:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:52.511 04:29:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:52.511 04:29:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:52.511 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:17:54.415 04:29:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:54.415 04:29:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:54.415 04:29:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:54.415 04:29:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:54.415 04:29:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:54.415 04:29:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:54.415 04:29:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:54.415 04:29:33 -- nvmf/common.sh@294 -- # net_devs=() 00:17:54.415 04:29:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:54.415 04:29:33 -- nvmf/common.sh@295 -- # e810=() 00:17:54.415 04:29:33 -- nvmf/common.sh@295 -- # local -ga e810 00:17:54.415 04:29:33 -- nvmf/common.sh@296 -- # x722=() 00:17:54.415 04:29:33 -- nvmf/common.sh@296 -- # local -ga x722 00:17:54.415 04:29:33 -- nvmf/common.sh@297 -- # mlx=() 00:17:54.415 04:29:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:54.415 04:29:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:54.415 04:29:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:54.415 04:29:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:54.415 04:29:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:54.415 04:29:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:54.415 04:29:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:54.415 04:29:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:54.415 04:29:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:54.415 04:29:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:54.415 04:29:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:54.415 04:29:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:54.415 04:29:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:54.415 04:29:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:54.415 04:29:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:54.415 04:29:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:54.415 04:29:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:54.415 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:54.415 04:29:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:54.415 04:29:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:54.415 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:54.415 04:29:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:54.415 04:29:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:54.415 04:29:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:54.415 04:29:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:54.415 04:29:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:54.415 04:29:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:54.415 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:54.415 04:29:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:54.415 04:29:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:54.415 04:29:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:54.415 04:29:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:54.415 04:29:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:54.415 04:29:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:54.415 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:54.415 04:29:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:54.415 04:29:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:54.415 04:29:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:54.415 04:29:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:54.415 04:29:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:54.415 04:29:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:54.415 04:29:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:54.415 04:29:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:54.415 04:29:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:54.415 04:29:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:54.415 04:29:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:54.416 04:29:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:54.416 04:29:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:54.416 04:29:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:54.416 04:29:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:54.416 04:29:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:54.416 04:29:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:54.416 04:29:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:54.416 04:29:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:54.416 04:29:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:54.416 04:29:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:54.416 04:29:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:54.416 04:29:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:54.416 04:29:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:54.416 04:29:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:54.416 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:54.416 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:17:54.416 00:17:54.416 --- 10.0.0.2 ping statistics --- 00:17:54.416 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:54.416 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:17:54.416 04:29:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:54.416 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:54.416 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.137 ms 00:17:54.416 00:17:54.416 --- 10.0.0.1 ping statistics --- 00:17:54.416 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:54.416 rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms 00:17:54.416 04:29:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:54.416 04:29:33 -- nvmf/common.sh@410 -- # return 0 00:17:54.416 04:29:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:54.416 04:29:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:54.416 04:29:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:54.416 04:29:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:54.416 04:29:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:54.416 04:29:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:54.416 04:29:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:54.675 04:29:33 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:17:54.675 04:29:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:54.675 04:29:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:54.675 04:29:33 -- common/autotest_common.sh@10 -- # set +x 00:17:54.675 04:29:33 -- nvmf/common.sh@469 -- # nvmfpid=2914937 00:17:54.675 04:29:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:54.675 04:29:33 -- nvmf/common.sh@470 -- # waitforlisten 2914937 00:17:54.675 04:29:33 -- common/autotest_common.sh@829 -- # '[' -z 2914937 ']' 00:17:54.675 04:29:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:54.675 04:29:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:54.675 04:29:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:54.675 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:54.675 04:29:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:54.675 04:29:33 -- common/autotest_common.sh@10 -- # set +x 00:17:54.675 [2024-11-26 04:29:33.701169] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:54.675 [2024-11-26 04:29:33.701248] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:54.675 EAL: No free 2048 kB hugepages reported on node 1 00:17:54.675 [2024-11-26 04:29:33.764565] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:54.675 [2024-11-26 04:29:33.852114] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:54.675 [2024-11-26 04:29:33.852281] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:54.675 [2024-11-26 04:29:33.852302] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:54.675 [2024-11-26 04:29:33.852315] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:54.675 [2024-11-26 04:29:33.852344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:55.610 04:29:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:55.610 04:29:34 -- common/autotest_common.sh@862 -- # return 0 00:17:55.610 04:29:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:55.610 04:29:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:55.610 04:29:34 -- common/autotest_common.sh@10 -- # set +x 00:17:55.610 04:29:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:55.610 04:29:34 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:55.610 04:29:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:55.610 04:29:34 -- common/autotest_common.sh@10 -- # set +x 00:17:55.610 [2024-11-26 04:29:34.702176] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:55.610 04:29:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:55.610 04:29:34 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:55.610 04:29:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:55.610 04:29:34 -- common/autotest_common.sh@10 -- # set +x 00:17:55.610 Malloc0 00:17:55.610 04:29:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:55.610 04:29:34 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:55.610 04:29:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:55.611 04:29:34 -- common/autotest_common.sh@10 -- # set +x 00:17:55.611 04:29:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:55.611 04:29:34 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:55.611 04:29:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:55.611 04:29:34 -- common/autotest_common.sh@10 -- # set +x 00:17:55.611 04:29:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:55.611 04:29:34 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:55.611 04:29:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:55.611 04:29:34 -- common/autotest_common.sh@10 -- # set +x 00:17:55.611 [2024-11-26 04:29:34.764471] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:55.611 04:29:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:55.611 04:29:34 -- target/queue_depth.sh@30 -- # bdevperf_pid=2915091 00:17:55.611 04:29:34 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:17:55.611 04:29:34 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:55.611 04:29:34 -- target/queue_depth.sh@33 -- # waitforlisten 2915091 /var/tmp/bdevperf.sock 00:17:55.611 04:29:34 -- common/autotest_common.sh@829 -- # '[' -z 2915091 ']' 00:17:55.611 04:29:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:55.611 04:29:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:55.611 04:29:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:55.611 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:55.611 04:29:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:55.611 04:29:34 -- common/autotest_common.sh@10 -- # set +x 00:17:55.611 [2024-11-26 04:29:34.808806] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:55.611 [2024-11-26 04:29:34.808875] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2915091 ] 00:17:55.870 EAL: No free 2048 kB hugepages reported on node 1 00:17:55.870 [2024-11-26 04:29:34.872122] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:55.870 [2024-11-26 04:29:34.962867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:56.802 04:29:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:56.802 04:29:35 -- common/autotest_common.sh@862 -- # return 0 00:17:56.802 04:29:35 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:17:56.802 04:29:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:56.802 04:29:35 -- common/autotest_common.sh@10 -- # set +x 00:17:57.060 NVMe0n1 00:17:57.060 04:29:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:57.060 04:29:36 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:57.060 Running I/O for 10 seconds... 00:18:09.264 00:18:09.264 Latency(us) 00:18:09.264 [2024-11-26T03:29:48.490Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:09.264 [2024-11-26T03:29:48.490Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:09.264 Verification LBA range: start 0x0 length 0x4000 00:18:09.264 NVMe0n1 : 10.07 12183.48 47.59 0.00 0.00 83715.76 13786.83 64079.64 00:18:09.264 [2024-11-26T03:29:48.490Z] =================================================================================================================== 00:18:09.264 [2024-11-26T03:29:48.490Z] Total : 12183.48 47.59 0.00 0.00 83715.76 13786.83 64079.64 00:18:09.264 0 00:18:09.264 04:29:46 -- target/queue_depth.sh@39 -- # killprocess 2915091 00:18:09.264 04:29:46 -- common/autotest_common.sh@936 -- # '[' -z 2915091 ']' 00:18:09.264 04:29:46 -- common/autotest_common.sh@940 -- # kill -0 2915091 00:18:09.264 04:29:46 -- common/autotest_common.sh@941 -- # uname 00:18:09.264 04:29:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:09.264 04:29:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2915091 00:18:09.264 04:29:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:09.264 04:29:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:09.264 04:29:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2915091' 00:18:09.264 killing process with pid 2915091 00:18:09.264 04:29:46 -- common/autotest_common.sh@955 -- # kill 2915091 00:18:09.264 Received shutdown signal, test time was about 10.000000 seconds 00:18:09.264 00:18:09.264 Latency(us) 00:18:09.264 [2024-11-26T03:29:48.490Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:09.264 [2024-11-26T03:29:48.490Z] =================================================================================================================== 00:18:09.264 [2024-11-26T03:29:48.490Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:09.264 04:29:46 -- common/autotest_common.sh@960 -- # wait 2915091 00:18:09.264 04:29:46 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:09.264 04:29:46 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:09.264 04:29:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:09.264 04:29:46 -- nvmf/common.sh@116 -- # sync 00:18:09.264 04:29:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:09.264 04:29:46 -- nvmf/common.sh@119 -- # set +e 00:18:09.264 04:29:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:09.264 04:29:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:09.264 rmmod nvme_tcp 00:18:09.264 rmmod nvme_fabrics 00:18:09.264 rmmod nvme_keyring 00:18:09.264 04:29:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:09.264 04:29:46 -- nvmf/common.sh@123 -- # set -e 00:18:09.264 04:29:46 -- nvmf/common.sh@124 -- # return 0 00:18:09.264 04:29:46 -- nvmf/common.sh@477 -- # '[' -n 2914937 ']' 00:18:09.264 04:29:46 -- nvmf/common.sh@478 -- # killprocess 2914937 00:18:09.264 04:29:46 -- common/autotest_common.sh@936 -- # '[' -z 2914937 ']' 00:18:09.264 04:29:46 -- common/autotest_common.sh@940 -- # kill -0 2914937 00:18:09.264 04:29:46 -- common/autotest_common.sh@941 -- # uname 00:18:09.264 04:29:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:09.264 04:29:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2914937 00:18:09.264 04:29:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:09.264 04:29:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:09.264 04:29:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2914937' 00:18:09.264 killing process with pid 2914937 00:18:09.264 04:29:46 -- common/autotest_common.sh@955 -- # kill 2914937 00:18:09.264 04:29:46 -- common/autotest_common.sh@960 -- # wait 2914937 00:18:09.264 04:29:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:09.264 04:29:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:09.264 04:29:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:09.264 04:29:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:09.264 04:29:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:09.264 04:29:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:09.264 04:29:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:09.264 04:29:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:09.832 04:29:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:09.832 00:18:09.832 real 0m17.594s 00:18:09.832 user 0m25.424s 00:18:09.832 sys 0m3.097s 00:18:09.832 04:29:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:09.832 04:29:48 -- common/autotest_common.sh@10 -- # set +x 00:18:09.832 ************************************ 00:18:09.832 END TEST nvmf_queue_depth 00:18:09.832 ************************************ 00:18:09.832 04:29:48 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:09.832 04:29:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:09.832 04:29:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:09.832 04:29:48 -- common/autotest_common.sh@10 -- # set +x 00:18:09.832 ************************************ 00:18:09.832 START TEST nvmf_multipath 00:18:09.832 ************************************ 00:18:09.832 04:29:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:09.833 * Looking for test storage... 00:18:09.833 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:09.833 04:29:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:09.833 04:29:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:09.833 04:29:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:10.095 04:29:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:10.095 04:29:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:10.095 04:29:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:10.095 04:29:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:10.095 04:29:49 -- scripts/common.sh@335 -- # IFS=.-: 00:18:10.095 04:29:49 -- scripts/common.sh@335 -- # read -ra ver1 00:18:10.095 04:29:49 -- scripts/common.sh@336 -- # IFS=.-: 00:18:10.095 04:29:49 -- scripts/common.sh@336 -- # read -ra ver2 00:18:10.095 04:29:49 -- scripts/common.sh@337 -- # local 'op=<' 00:18:10.095 04:29:49 -- scripts/common.sh@339 -- # ver1_l=2 00:18:10.095 04:29:49 -- scripts/common.sh@340 -- # ver2_l=1 00:18:10.095 04:29:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:10.095 04:29:49 -- scripts/common.sh@343 -- # case "$op" in 00:18:10.095 04:29:49 -- scripts/common.sh@344 -- # : 1 00:18:10.095 04:29:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:10.095 04:29:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:10.095 04:29:49 -- scripts/common.sh@364 -- # decimal 1 00:18:10.095 04:29:49 -- scripts/common.sh@352 -- # local d=1 00:18:10.095 04:29:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:10.095 04:29:49 -- scripts/common.sh@354 -- # echo 1 00:18:10.095 04:29:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:10.095 04:29:49 -- scripts/common.sh@365 -- # decimal 2 00:18:10.095 04:29:49 -- scripts/common.sh@352 -- # local d=2 00:18:10.095 04:29:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:10.095 04:29:49 -- scripts/common.sh@354 -- # echo 2 00:18:10.095 04:29:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:10.095 04:29:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:10.095 04:29:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:10.095 04:29:49 -- scripts/common.sh@367 -- # return 0 00:18:10.095 04:29:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:10.095 04:29:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:10.095 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:10.095 --rc genhtml_branch_coverage=1 00:18:10.095 --rc genhtml_function_coverage=1 00:18:10.095 --rc genhtml_legend=1 00:18:10.095 --rc geninfo_all_blocks=1 00:18:10.096 --rc geninfo_unexecuted_blocks=1 00:18:10.096 00:18:10.096 ' 00:18:10.096 04:29:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:10.096 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:10.096 --rc genhtml_branch_coverage=1 00:18:10.096 --rc genhtml_function_coverage=1 00:18:10.096 --rc genhtml_legend=1 00:18:10.096 --rc geninfo_all_blocks=1 00:18:10.096 --rc geninfo_unexecuted_blocks=1 00:18:10.096 00:18:10.096 ' 00:18:10.096 04:29:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:10.096 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:10.096 --rc genhtml_branch_coverage=1 00:18:10.096 --rc genhtml_function_coverage=1 00:18:10.096 --rc genhtml_legend=1 00:18:10.096 --rc geninfo_all_blocks=1 00:18:10.096 --rc geninfo_unexecuted_blocks=1 00:18:10.096 00:18:10.096 ' 00:18:10.096 04:29:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:10.096 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:10.096 --rc genhtml_branch_coverage=1 00:18:10.096 --rc genhtml_function_coverage=1 00:18:10.096 --rc genhtml_legend=1 00:18:10.096 --rc geninfo_all_blocks=1 00:18:10.096 --rc geninfo_unexecuted_blocks=1 00:18:10.096 00:18:10.096 ' 00:18:10.096 04:29:49 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:10.096 04:29:49 -- nvmf/common.sh@7 -- # uname -s 00:18:10.096 04:29:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:10.096 04:29:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:10.096 04:29:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:10.096 04:29:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:10.096 04:29:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:10.096 04:29:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:10.096 04:29:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:10.096 04:29:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:10.096 04:29:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:10.096 04:29:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:10.096 04:29:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:10.096 04:29:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:10.096 04:29:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:10.096 04:29:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:10.096 04:29:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:10.096 04:29:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:10.096 04:29:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:10.096 04:29:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:10.096 04:29:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:10.096 04:29:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:10.096 04:29:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:10.096 04:29:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:10.096 04:29:49 -- paths/export.sh@5 -- # export PATH 00:18:10.096 04:29:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:10.096 04:29:49 -- nvmf/common.sh@46 -- # : 0 00:18:10.096 04:29:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:10.096 04:29:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:10.096 04:29:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:10.096 04:29:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:10.096 04:29:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:10.096 04:29:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:10.096 04:29:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:10.096 04:29:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:10.096 04:29:49 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:10.096 04:29:49 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:10.096 04:29:49 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:10.096 04:29:49 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:10.096 04:29:49 -- target/multipath.sh@43 -- # nvmftestinit 00:18:10.096 04:29:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:10.096 04:29:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:10.096 04:29:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:10.096 04:29:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:10.096 04:29:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:10.096 04:29:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:10.096 04:29:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:10.096 04:29:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:10.096 04:29:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:10.096 04:29:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:10.096 04:29:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:10.096 04:29:49 -- common/autotest_common.sh@10 -- # set +x 00:18:12.630 04:29:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:12.630 04:29:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:12.630 04:29:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:12.630 04:29:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:12.630 04:29:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:12.630 04:29:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:12.630 04:29:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:12.630 04:29:51 -- nvmf/common.sh@294 -- # net_devs=() 00:18:12.630 04:29:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:12.631 04:29:51 -- nvmf/common.sh@295 -- # e810=() 00:18:12.631 04:29:51 -- nvmf/common.sh@295 -- # local -ga e810 00:18:12.631 04:29:51 -- nvmf/common.sh@296 -- # x722=() 00:18:12.631 04:29:51 -- nvmf/common.sh@296 -- # local -ga x722 00:18:12.631 04:29:51 -- nvmf/common.sh@297 -- # mlx=() 00:18:12.631 04:29:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:12.631 04:29:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:12.631 04:29:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:12.631 04:29:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:12.631 04:29:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:12.631 04:29:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:12.631 04:29:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:12.631 04:29:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:12.631 04:29:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:12.631 04:29:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:12.631 04:29:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:12.631 04:29:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:12.631 04:29:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:12.631 04:29:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:12.631 04:29:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:12.631 04:29:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:12.631 04:29:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:12.631 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:12.631 04:29:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:12.631 04:29:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:12.631 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:12.631 04:29:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:12.631 04:29:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:12.631 04:29:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:12.631 04:29:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:12.631 04:29:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:12.631 04:29:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:12.631 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:12.631 04:29:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:12.631 04:29:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:12.631 04:29:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:12.631 04:29:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:12.631 04:29:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:12.631 04:29:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:12.631 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:12.631 04:29:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:12.631 04:29:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:12.631 04:29:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:12.631 04:29:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:12.631 04:29:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:12.631 04:29:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:12.631 04:29:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:12.631 04:29:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:12.631 04:29:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:12.631 04:29:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:12.631 04:29:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:12.631 04:29:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:12.631 04:29:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:12.631 04:29:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:12.631 04:29:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:12.631 04:29:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:12.631 04:29:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:12.631 04:29:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:12.631 04:29:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:12.631 04:29:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:12.631 04:29:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:12.631 04:29:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:12.631 04:29:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:12.631 04:29:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:12.631 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:12.631 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:18:12.631 00:18:12.631 --- 10.0.0.2 ping statistics --- 00:18:12.631 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:12.631 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:18:12.631 04:29:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:12.631 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:12.631 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:18:12.631 00:18:12.631 --- 10.0.0.1 ping statistics --- 00:18:12.631 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:12.631 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:18:12.631 04:29:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:12.631 04:29:51 -- nvmf/common.sh@410 -- # return 0 00:18:12.631 04:29:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:12.631 04:29:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:12.631 04:29:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:12.631 04:29:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:12.631 04:29:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:12.631 04:29:51 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:12.631 04:29:51 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:12.631 only one NIC for nvmf test 00:18:12.631 04:29:51 -- target/multipath.sh@47 -- # nvmftestfini 00:18:12.631 04:29:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:12.631 04:29:51 -- nvmf/common.sh@116 -- # sync 00:18:12.631 04:29:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:12.631 04:29:51 -- nvmf/common.sh@119 -- # set +e 00:18:12.631 04:29:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:12.631 04:29:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:12.631 rmmod nvme_tcp 00:18:12.631 rmmod nvme_fabrics 00:18:12.631 rmmod nvme_keyring 00:18:12.631 04:29:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:12.631 04:29:51 -- nvmf/common.sh@123 -- # set -e 00:18:12.631 04:29:51 -- nvmf/common.sh@124 -- # return 0 00:18:12.631 04:29:51 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:12.631 04:29:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:12.631 04:29:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:12.631 04:29:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:12.631 04:29:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:12.631 04:29:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:12.631 04:29:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:12.631 04:29:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:14.536 04:29:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:14.536 04:29:53 -- target/multipath.sh@48 -- # exit 0 00:18:14.536 04:29:53 -- target/multipath.sh@1 -- # nvmftestfini 00:18:14.536 04:29:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:14.536 04:29:53 -- nvmf/common.sh@116 -- # sync 00:18:14.536 04:29:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:14.536 04:29:53 -- nvmf/common.sh@119 -- # set +e 00:18:14.536 04:29:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:14.536 04:29:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:14.536 04:29:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:14.536 04:29:53 -- nvmf/common.sh@123 -- # set -e 00:18:14.536 04:29:53 -- nvmf/common.sh@124 -- # return 0 00:18:14.536 04:29:53 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:14.536 04:29:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:14.536 04:29:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:14.536 04:29:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:14.536 04:29:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:14.536 04:29:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:14.536 04:29:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:14.536 04:29:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:14.536 04:29:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:14.536 04:29:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:14.536 00:18:14.536 real 0m4.506s 00:18:14.536 user 0m0.925s 00:18:14.536 sys 0m1.588s 00:18:14.536 04:29:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:14.536 04:29:53 -- common/autotest_common.sh@10 -- # set +x 00:18:14.537 ************************************ 00:18:14.537 END TEST nvmf_multipath 00:18:14.537 ************************************ 00:18:14.537 04:29:53 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:14.537 04:29:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:14.537 04:29:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:14.537 04:29:53 -- common/autotest_common.sh@10 -- # set +x 00:18:14.537 ************************************ 00:18:14.537 START TEST nvmf_zcopy 00:18:14.537 ************************************ 00:18:14.537 04:29:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:14.537 * Looking for test storage... 00:18:14.537 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:14.537 04:29:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:14.537 04:29:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:14.537 04:29:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:14.537 04:29:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:14.537 04:29:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:14.537 04:29:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:14.537 04:29:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:14.537 04:29:53 -- scripts/common.sh@335 -- # IFS=.-: 00:18:14.537 04:29:53 -- scripts/common.sh@335 -- # read -ra ver1 00:18:14.537 04:29:53 -- scripts/common.sh@336 -- # IFS=.-: 00:18:14.537 04:29:53 -- scripts/common.sh@336 -- # read -ra ver2 00:18:14.537 04:29:53 -- scripts/common.sh@337 -- # local 'op=<' 00:18:14.537 04:29:53 -- scripts/common.sh@339 -- # ver1_l=2 00:18:14.537 04:29:53 -- scripts/common.sh@340 -- # ver2_l=1 00:18:14.537 04:29:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:14.537 04:29:53 -- scripts/common.sh@343 -- # case "$op" in 00:18:14.537 04:29:53 -- scripts/common.sh@344 -- # : 1 00:18:14.537 04:29:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:14.537 04:29:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:14.537 04:29:53 -- scripts/common.sh@364 -- # decimal 1 00:18:14.537 04:29:53 -- scripts/common.sh@352 -- # local d=1 00:18:14.537 04:29:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:14.537 04:29:53 -- scripts/common.sh@354 -- # echo 1 00:18:14.537 04:29:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:14.537 04:29:53 -- scripts/common.sh@365 -- # decimal 2 00:18:14.537 04:29:53 -- scripts/common.sh@352 -- # local d=2 00:18:14.537 04:29:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:14.537 04:29:53 -- scripts/common.sh@354 -- # echo 2 00:18:14.537 04:29:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:14.537 04:29:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:14.537 04:29:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:14.537 04:29:53 -- scripts/common.sh@367 -- # return 0 00:18:14.537 04:29:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:14.537 04:29:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:14.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:14.537 --rc genhtml_branch_coverage=1 00:18:14.537 --rc genhtml_function_coverage=1 00:18:14.537 --rc genhtml_legend=1 00:18:14.537 --rc geninfo_all_blocks=1 00:18:14.537 --rc geninfo_unexecuted_blocks=1 00:18:14.537 00:18:14.537 ' 00:18:14.537 04:29:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:14.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:14.537 --rc genhtml_branch_coverage=1 00:18:14.537 --rc genhtml_function_coverage=1 00:18:14.537 --rc genhtml_legend=1 00:18:14.537 --rc geninfo_all_blocks=1 00:18:14.537 --rc geninfo_unexecuted_blocks=1 00:18:14.537 00:18:14.537 ' 00:18:14.537 04:29:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:14.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:14.537 --rc genhtml_branch_coverage=1 00:18:14.537 --rc genhtml_function_coverage=1 00:18:14.537 --rc genhtml_legend=1 00:18:14.537 --rc geninfo_all_blocks=1 00:18:14.537 --rc geninfo_unexecuted_blocks=1 00:18:14.537 00:18:14.537 ' 00:18:14.537 04:29:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:14.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:14.537 --rc genhtml_branch_coverage=1 00:18:14.537 --rc genhtml_function_coverage=1 00:18:14.537 --rc genhtml_legend=1 00:18:14.537 --rc geninfo_all_blocks=1 00:18:14.537 --rc geninfo_unexecuted_blocks=1 00:18:14.537 00:18:14.537 ' 00:18:14.537 04:29:53 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:14.537 04:29:53 -- nvmf/common.sh@7 -- # uname -s 00:18:14.537 04:29:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:14.537 04:29:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:14.537 04:29:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:14.537 04:29:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:14.537 04:29:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:14.537 04:29:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:14.537 04:29:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:14.537 04:29:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:14.537 04:29:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:14.537 04:29:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:14.537 04:29:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:14.537 04:29:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:14.537 04:29:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:14.537 04:29:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:14.537 04:29:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:14.537 04:29:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:14.537 04:29:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:14.537 04:29:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:14.537 04:29:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:14.537 04:29:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:14.537 04:29:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:14.537 04:29:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:14.537 04:29:53 -- paths/export.sh@5 -- # export PATH 00:18:14.537 04:29:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:14.537 04:29:53 -- nvmf/common.sh@46 -- # : 0 00:18:14.537 04:29:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:14.537 04:29:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:14.537 04:29:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:14.537 04:29:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:14.538 04:29:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:14.538 04:29:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:14.538 04:29:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:14.538 04:29:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:14.538 04:29:53 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:14.538 04:29:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:14.538 04:29:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:14.538 04:29:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:14.538 04:29:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:14.538 04:29:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:14.538 04:29:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:14.538 04:29:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:14.538 04:29:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:14.538 04:29:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:14.538 04:29:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:14.538 04:29:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:14.538 04:29:53 -- common/autotest_common.sh@10 -- # set +x 00:18:16.441 04:29:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:16.441 04:29:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:16.441 04:29:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:16.441 04:29:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:16.441 04:29:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:16.441 04:29:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:16.441 04:29:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:16.441 04:29:55 -- nvmf/common.sh@294 -- # net_devs=() 00:18:16.441 04:29:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:16.441 04:29:55 -- nvmf/common.sh@295 -- # e810=() 00:18:16.441 04:29:55 -- nvmf/common.sh@295 -- # local -ga e810 00:18:16.441 04:29:55 -- nvmf/common.sh@296 -- # x722=() 00:18:16.441 04:29:55 -- nvmf/common.sh@296 -- # local -ga x722 00:18:16.441 04:29:55 -- nvmf/common.sh@297 -- # mlx=() 00:18:16.441 04:29:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:16.441 04:29:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:16.441 04:29:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:16.441 04:29:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:16.441 04:29:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:16.441 04:29:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:16.441 04:29:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:16.441 04:29:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:16.441 04:29:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:16.441 04:29:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:16.441 04:29:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:16.441 04:29:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:16.441 04:29:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:16.441 04:29:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:16.441 04:29:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:16.441 04:29:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:16.441 04:29:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:16.441 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:16.441 04:29:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:16.441 04:29:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:16.441 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:16.441 04:29:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:16.441 04:29:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:16.441 04:29:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:16.441 04:29:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:16.442 04:29:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:16.442 04:29:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:16.442 04:29:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:16.442 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:16.442 04:29:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:16.442 04:29:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:16.442 04:29:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:16.442 04:29:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:16.701 04:29:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:16.701 04:29:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:16.701 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:16.701 04:29:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:16.701 04:29:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:16.701 04:29:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:16.701 04:29:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:16.701 04:29:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:16.701 04:29:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:16.701 04:29:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:16.701 04:29:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:16.701 04:29:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:16.701 04:29:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:16.701 04:29:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:16.701 04:29:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:16.701 04:29:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:16.701 04:29:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:16.701 04:29:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:16.701 04:29:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:16.701 04:29:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:16.701 04:29:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:16.701 04:29:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:16.701 04:29:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:16.701 04:29:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:16.701 04:29:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:16.701 04:29:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:16.701 04:29:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:16.701 04:29:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:16.701 04:29:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:16.701 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:16.701 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.289 ms 00:18:16.701 00:18:16.701 --- 10.0.0.2 ping statistics --- 00:18:16.701 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:16.701 rtt min/avg/max/mdev = 0.289/0.289/0.289/0.000 ms 00:18:16.701 04:29:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:16.701 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:16.701 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.149 ms 00:18:16.701 00:18:16.701 --- 10.0.0.1 ping statistics --- 00:18:16.701 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:16.701 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:18:16.701 04:29:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:16.701 04:29:55 -- nvmf/common.sh@410 -- # return 0 00:18:16.701 04:29:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:16.701 04:29:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:16.701 04:29:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:16.701 04:29:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:16.701 04:29:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:16.701 04:29:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:16.701 04:29:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:16.701 04:29:55 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:16.701 04:29:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:16.701 04:29:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:16.701 04:29:55 -- common/autotest_common.sh@10 -- # set +x 00:18:16.701 04:29:55 -- nvmf/common.sh@469 -- # nvmfpid=2920475 00:18:16.701 04:29:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:16.701 04:29:55 -- nvmf/common.sh@470 -- # waitforlisten 2920475 00:18:16.701 04:29:55 -- common/autotest_common.sh@829 -- # '[' -z 2920475 ']' 00:18:16.701 04:29:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:16.701 04:29:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:16.701 04:29:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:16.701 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:16.701 04:29:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:16.701 04:29:55 -- common/autotest_common.sh@10 -- # set +x 00:18:16.701 [2024-11-26 04:29:55.872257] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:16.701 [2024-11-26 04:29:55.872346] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:16.701 EAL: No free 2048 kB hugepages reported on node 1 00:18:16.960 [2024-11-26 04:29:55.941986] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:16.960 [2024-11-26 04:29:56.032373] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:16.960 [2024-11-26 04:29:56.032564] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:16.960 [2024-11-26 04:29:56.032584] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:16.960 [2024-11-26 04:29:56.032598] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:16.960 [2024-11-26 04:29:56.032630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:17.894 04:29:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:17.894 04:29:56 -- common/autotest_common.sh@862 -- # return 0 00:18:17.894 04:29:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:17.894 04:29:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:17.894 04:29:56 -- common/autotest_common.sh@10 -- # set +x 00:18:17.894 04:29:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:17.894 04:29:56 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:17.894 04:29:56 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:17.894 04:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.894 04:29:56 -- common/autotest_common.sh@10 -- # set +x 00:18:17.894 [2024-11-26 04:29:56.850424] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:17.894 04:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.894 04:29:56 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:17.894 04:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.894 04:29:56 -- common/autotest_common.sh@10 -- # set +x 00:18:17.894 04:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.894 04:29:56 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:17.894 04:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.894 04:29:56 -- common/autotest_common.sh@10 -- # set +x 00:18:17.894 [2024-11-26 04:29:56.866610] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:17.894 04:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.894 04:29:56 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:17.894 04:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.894 04:29:56 -- common/autotest_common.sh@10 -- # set +x 00:18:17.894 04:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.895 04:29:56 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:17.895 04:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.895 04:29:56 -- common/autotest_common.sh@10 -- # set +x 00:18:17.895 malloc0 00:18:17.895 04:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.895 04:29:56 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:17.895 04:29:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.895 04:29:56 -- common/autotest_common.sh@10 -- # set +x 00:18:17.895 04:29:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.895 04:29:56 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:17.895 04:29:56 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:17.895 04:29:56 -- nvmf/common.sh@520 -- # config=() 00:18:17.895 04:29:56 -- nvmf/common.sh@520 -- # local subsystem config 00:18:17.895 04:29:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:17.895 04:29:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:17.895 { 00:18:17.895 "params": { 00:18:17.895 "name": "Nvme$subsystem", 00:18:17.895 "trtype": "$TEST_TRANSPORT", 00:18:17.895 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:17.895 "adrfam": "ipv4", 00:18:17.895 "trsvcid": "$NVMF_PORT", 00:18:17.895 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:17.895 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:17.895 "hdgst": ${hdgst:-false}, 00:18:17.895 "ddgst": ${ddgst:-false} 00:18:17.895 }, 00:18:17.895 "method": "bdev_nvme_attach_controller" 00:18:17.895 } 00:18:17.895 EOF 00:18:17.895 )") 00:18:17.895 04:29:56 -- nvmf/common.sh@542 -- # cat 00:18:17.895 04:29:56 -- nvmf/common.sh@544 -- # jq . 00:18:17.895 04:29:56 -- nvmf/common.sh@545 -- # IFS=, 00:18:17.895 04:29:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:17.895 "params": { 00:18:17.895 "name": "Nvme1", 00:18:17.895 "trtype": "tcp", 00:18:17.895 "traddr": "10.0.0.2", 00:18:17.895 "adrfam": "ipv4", 00:18:17.895 "trsvcid": "4420", 00:18:17.895 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.895 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:17.895 "hdgst": false, 00:18:17.895 "ddgst": false 00:18:17.895 }, 00:18:17.895 "method": "bdev_nvme_attach_controller" 00:18:17.895 }' 00:18:17.895 [2024-11-26 04:29:56.939504] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:17.895 [2024-11-26 04:29:56.939580] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2920633 ] 00:18:17.895 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.895 [2024-11-26 04:29:57.002303] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:17.895 [2024-11-26 04:29:57.096419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:18.461 Running I/O for 10 seconds... 00:18:28.529 00:18:28.529 Latency(us) 00:18:28.529 [2024-11-26T03:30:07.755Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:28.529 [2024-11-26T03:30:07.755Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:28.529 Verification LBA range: start 0x0 length 0x1000 00:18:28.529 Nvme1n1 : 10.01 8597.01 67.16 0.00 0.00 14853.83 1686.95 21262.79 00:18:28.529 [2024-11-26T03:30:07.755Z] =================================================================================================================== 00:18:28.529 [2024-11-26T03:30:07.755Z] Total : 8597.01 67.16 0.00 0.00 14853.83 1686.95 21262.79 00:18:28.529 04:30:07 -- target/zcopy.sh@39 -- # perfpid=2922213 00:18:28.529 04:30:07 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:28.529 04:30:07 -- common/autotest_common.sh@10 -- # set +x 00:18:28.529 04:30:07 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:28.529 04:30:07 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:28.529 04:30:07 -- nvmf/common.sh@520 -- # config=() 00:18:28.529 04:30:07 -- nvmf/common.sh@520 -- # local subsystem config 00:18:28.529 04:30:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:28.529 04:30:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:28.529 { 00:18:28.529 "params": { 00:18:28.529 "name": "Nvme$subsystem", 00:18:28.529 "trtype": "$TEST_TRANSPORT", 00:18:28.529 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:28.529 "adrfam": "ipv4", 00:18:28.529 "trsvcid": "$NVMF_PORT", 00:18:28.529 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:28.529 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:28.529 "hdgst": ${hdgst:-false}, 00:18:28.529 "ddgst": ${ddgst:-false} 00:18:28.529 }, 00:18:28.529 "method": "bdev_nvme_attach_controller" 00:18:28.529 } 00:18:28.529 EOF 00:18:28.529 )") 00:18:28.529 04:30:07 -- nvmf/common.sh@542 -- # cat 00:18:28.529 04:30:07 -- nvmf/common.sh@544 -- # jq . 00:18:28.529 [2024-11-26 04:30:07.705192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.529 [2024-11-26 04:30:07.705236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.529 04:30:07 -- nvmf/common.sh@545 -- # IFS=, 00:18:28.529 04:30:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:28.529 "params": { 00:18:28.529 "name": "Nvme1", 00:18:28.529 "trtype": "tcp", 00:18:28.529 "traddr": "10.0.0.2", 00:18:28.529 "adrfam": "ipv4", 00:18:28.529 "trsvcid": "4420", 00:18:28.529 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:28.529 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:28.529 "hdgst": false, 00:18:28.529 "ddgst": false 00:18:28.529 }, 00:18:28.529 "method": "bdev_nvme_attach_controller" 00:18:28.529 }' 00:18:28.529 [2024-11-26 04:30:07.713134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.529 [2024-11-26 04:30:07.713156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.529 [2024-11-26 04:30:07.721155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.529 [2024-11-26 04:30:07.721177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.529 [2024-11-26 04:30:07.729174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.529 [2024-11-26 04:30:07.729194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.529 [2024-11-26 04:30:07.737200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.529 [2024-11-26 04:30:07.737231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.529 [2024-11-26 04:30:07.738911] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:28.529 [2024-11-26 04:30:07.738984] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2922213 ] 00:18:28.529 [2024-11-26 04:30:07.745214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.529 [2024-11-26 04:30:07.745234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.753253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.753275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.761260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.761281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 EAL: No free 2048 kB hugepages reported on node 1 00:18:28.788 [2024-11-26 04:30:07.769279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.769299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.777302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.777322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.785324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.785344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.793345] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.793365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.800069] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:28.788 [2024-11-26 04:30:07.801367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.801387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.809439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.809481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.817439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.817483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.825437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.825458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.833456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.833478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.841482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.841505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.849526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.849559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.857568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.857607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.865564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.865587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.788 [2024-11-26 04:30:07.873567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.788 [2024-11-26 04:30:07.873588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.881588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.881610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.888848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:28.789 [2024-11-26 04:30:07.889612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.889635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.897632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.897652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.905745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.905788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.913756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.913799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.921782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.921823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.929806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.929849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.937823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.937865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.945844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.945888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.953810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.953837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.961859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.961896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.969881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.969920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.977901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.977941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.985890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.985911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:07.993932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:07.993958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:08.001945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:08.001995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:28.789 [2024-11-26 04:30:08.010010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:28.789 [2024-11-26 04:30:08.010040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.047 [2024-11-26 04:30:08.018024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.047 [2024-11-26 04:30:08.018074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.047 [2024-11-26 04:30:08.026054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.047 [2024-11-26 04:30:08.026080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.047 [2024-11-26 04:30:08.034074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.047 [2024-11-26 04:30:08.034099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.047 [2024-11-26 04:30:08.042098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.047 [2024-11-26 04:30:08.042123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.047 [2024-11-26 04:30:08.050121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.047 [2024-11-26 04:30:08.050145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.058159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.058186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.066176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.066204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.074212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.074240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.082208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.082249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.090239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.090265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.098274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.098304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 Running I/O for 5 seconds... 00:18:29.048 [2024-11-26 04:30:08.106287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.106313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.120694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.120752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.131732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.131760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.143120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.143152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.154502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.154536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.165851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.165881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.177160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.177192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.188892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.188921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.200391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.200430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.213901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.213929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.224468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.224499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.235475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.235506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.248853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.248881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.048 [2024-11-26 04:30:08.259517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.048 [2024-11-26 04:30:08.259547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.270903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.270932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.282335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.282368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.293820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.293849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.305158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.305190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.317894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.317922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.328623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.328654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.339935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.339963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.350707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.350750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.362228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.362259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.375556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.375588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.386184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.386214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.397397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.397430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.408490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.408521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.419512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.419543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.430982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.431014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.444333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.444364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.454589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.454620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.465602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.465634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.478897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.478927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.489241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.489272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.500489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.500520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.513402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.513434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.307 [2024-11-26 04:30:08.523785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.307 [2024-11-26 04:30:08.523812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.535340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.535372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.548876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.548904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.559684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.559750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.570989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.571020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.583866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.583896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.594182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.594214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.605162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.605193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.618353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.618384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.629113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.629144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.640269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.640300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.651277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.651308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.662859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.662887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.674384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.674415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.686174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.686205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.697436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.697467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.710774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.710803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.721115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.721146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.732102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.732134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.744838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.744874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.754874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.754902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.766004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.766035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.566 [2024-11-26 04:30:08.778683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.566 [2024-11-26 04:30:08.778741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.789395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.825 [2024-11-26 04:30:08.789425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.800638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.825 [2024-11-26 04:30:08.800670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.813768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.825 [2024-11-26 04:30:08.813797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.824472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.825 [2024-11-26 04:30:08.824500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.836199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.825 [2024-11-26 04:30:08.836231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.847101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.825 [2024-11-26 04:30:08.847132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.857918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.825 [2024-11-26 04:30:08.857946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.869013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.825 [2024-11-26 04:30:08.869044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.880172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.825 [2024-11-26 04:30:08.880203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.893323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.825 [2024-11-26 04:30:08.893355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.903911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.825 [2024-11-26 04:30:08.903939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.915038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.825 [2024-11-26 04:30:08.915069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.825 [2024-11-26 04:30:08.928034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.826 [2024-11-26 04:30:08.928066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.826 [2024-11-26 04:30:08.938159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.826 [2024-11-26 04:30:08.938190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.826 [2024-11-26 04:30:08.949219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.826 [2024-11-26 04:30:08.949257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.826 [2024-11-26 04:30:08.962519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.826 [2024-11-26 04:30:08.962551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.826 [2024-11-26 04:30:08.973001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.826 [2024-11-26 04:30:08.973033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.826 [2024-11-26 04:30:08.984347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.826 [2024-11-26 04:30:08.984378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.826 [2024-11-26 04:30:08.995855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.826 [2024-11-26 04:30:08.995883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.826 [2024-11-26 04:30:09.007057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.826 [2024-11-26 04:30:09.007089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.826 [2024-11-26 04:30:09.018452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.826 [2024-11-26 04:30:09.018483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.826 [2024-11-26 04:30:09.029515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.826 [2024-11-26 04:30:09.029543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:29.826 [2024-11-26 04:30:09.040470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:29.826 [2024-11-26 04:30:09.040498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.092 [2024-11-26 04:30:09.053197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.092 [2024-11-26 04:30:09.053236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.092 [2024-11-26 04:30:09.063038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.092 [2024-11-26 04:30:09.063070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.092 [2024-11-26 04:30:09.074089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.092 [2024-11-26 04:30:09.074130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.092 [2024-11-26 04:30:09.084719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.092 [2024-11-26 04:30:09.084748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.092 [2024-11-26 04:30:09.095115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.092 [2024-11-26 04:30:09.095143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.092 [2024-11-26 04:30:09.106004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.092 [2024-11-26 04:30:09.106044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.092 [2024-11-26 04:30:09.118782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.118810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.128895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.128923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.140438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.140469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.151514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.151544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.162912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.162941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.174280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.174311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.185901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.185929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.197357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.197388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.208917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.208945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.220360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.220391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.231527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.231558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.242971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.243017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.254568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.254599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.266010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.266056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.277532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.277575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.290659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.290712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.093 [2024-11-26 04:30:09.301070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.093 [2024-11-26 04:30:09.301101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.352 [2024-11-26 04:30:09.312651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.352 [2024-11-26 04:30:09.312682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.352 [2024-11-26 04:30:09.323882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.352 [2024-11-26 04:30:09.323910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.352 [2024-11-26 04:30:09.337574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.352 [2024-11-26 04:30:09.337606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.352 [2024-11-26 04:30:09.347972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.352 [2024-11-26 04:30:09.347999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.352 [2024-11-26 04:30:09.359158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.352 [2024-11-26 04:30:09.359189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.352 [2024-11-26 04:30:09.370240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.352 [2024-11-26 04:30:09.370271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.381288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.381319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.394879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.394908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.405612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.405643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.417255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.417287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.430821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.430849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.441236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.441267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.452150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.452181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.463208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.463239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.474512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.474543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.487644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.487675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.498290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.498330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.509860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.509888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.521133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.521163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.532543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.532574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.543877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.543905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.556971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.556999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.353 [2024-11-26 04:30:09.567634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.353 [2024-11-26 04:30:09.567666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.578928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.578956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.591506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.591537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.601928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.601956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.613905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.613934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.625648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.625680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.639307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.639338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.649967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.650006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.661182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.661213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.674184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.674215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.684468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.684499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.696536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.696566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.707587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.707618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.718336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.718378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.729932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.729976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.741743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.741772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.753034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.753065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.764612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.764643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.775544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.775575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.786752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.786780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.800200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.800231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.810017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.810048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.611 [2024-11-26 04:30:09.821189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.611 [2024-11-26 04:30:09.821220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.834368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.834399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.844488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.844518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.855400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.855430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.866149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.866180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.876967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.877011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.888054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.888085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.899385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.899416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.910855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.910883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.923696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.923740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.934421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.934462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.946091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.946122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.957856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.957884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.969164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.969196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.980299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.980329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:09.993431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:09.993462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:10.004394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:10.004425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:10.016564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:10.016601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:10.027532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:10.027565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:10.039286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:10.039322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:10.050790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:10.050825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:10.061891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:10.061919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:10.073195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:10.073227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:30.870 [2024-11-26 04:30:10.085333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:30.870 [2024-11-26 04:30:10.085365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.096672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.096729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.109701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.109747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.120304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.120335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.131498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.131529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.145096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.145128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.155669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.155712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.166748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.166776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.178326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.178357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.189884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.189912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.201702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.201749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.214726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.214771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.224895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.224923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.235821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.235849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.248701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.248757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.259019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.259064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.270054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.270085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.282959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.283003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.292816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.292845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.304848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.304876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.316259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.316289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.327337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.327368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.129 [2024-11-26 04:30:10.338834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.129 [2024-11-26 04:30:10.338862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.352167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.352198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.362659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.362700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.374288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.374318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.385543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.385574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.397047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.397078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.408348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.408378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.419467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.419498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.430618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.430648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.441851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.441878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.453159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.453190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.464170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.464201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.475451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.475483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.488611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.488643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.498947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.498976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.510213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.510243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.521516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.521547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.532794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.532822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.543809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.543838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.555285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.555316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.566869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.566897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.389 [2024-11-26 04:30:10.578254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.389 [2024-11-26 04:30:10.578285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.390 [2024-11-26 04:30:10.591506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.390 [2024-11-26 04:30:10.591537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.390 [2024-11-26 04:30:10.602357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.390 [2024-11-26 04:30:10.602387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.649 [2024-11-26 04:30:10.613611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.649 [2024-11-26 04:30:10.613642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.649 [2024-11-26 04:30:10.624704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.649 [2024-11-26 04:30:10.624748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.649 [2024-11-26 04:30:10.636680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.649 [2024-11-26 04:30:10.636735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.649 [2024-11-26 04:30:10.648147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.649 [2024-11-26 04:30:10.648179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.649 [2024-11-26 04:30:10.661891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.649 [2024-11-26 04:30:10.661919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.649 [2024-11-26 04:30:10.672771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.649 [2024-11-26 04:30:10.672799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.649 [2024-11-26 04:30:10.684195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.649 [2024-11-26 04:30:10.684226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.649 [2024-11-26 04:30:10.695464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.649 [2024-11-26 04:30:10.695495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.649 [2024-11-26 04:30:10.706756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.649 [2024-11-26 04:30:10.706784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.649 [2024-11-26 04:30:10.718602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.649 [2024-11-26 04:30:10.718633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.649 [2024-11-26 04:30:10.730069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.649 [2024-11-26 04:30:10.730101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.650 [2024-11-26 04:30:10.741123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.650 [2024-11-26 04:30:10.741153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.650 [2024-11-26 04:30:10.752485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.650 [2024-11-26 04:30:10.752515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.650 [2024-11-26 04:30:10.763438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.650 [2024-11-26 04:30:10.763469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.650 [2024-11-26 04:30:10.774520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.650 [2024-11-26 04:30:10.774552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.650 [2024-11-26 04:30:10.786043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.650 [2024-11-26 04:30:10.786074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.650 [2024-11-26 04:30:10.797512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.650 [2024-11-26 04:30:10.797543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.650 [2024-11-26 04:30:10.809173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.650 [2024-11-26 04:30:10.809203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.650 [2024-11-26 04:30:10.820611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.650 [2024-11-26 04:30:10.820643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.650 [2024-11-26 04:30:10.831804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.650 [2024-11-26 04:30:10.831831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.650 [2024-11-26 04:30:10.842783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.650 [2024-11-26 04:30:10.842811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.650 [2024-11-26 04:30:10.853857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.650 [2024-11-26 04:30:10.853886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.650 [2024-11-26 04:30:10.865411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.650 [2024-11-26 04:30:10.865451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.909 [2024-11-26 04:30:10.877210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.909 [2024-11-26 04:30:10.877241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.909 [2024-11-26 04:30:10.888546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.909 [2024-11-26 04:30:10.888577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.909 [2024-11-26 04:30:10.901500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.909 [2024-11-26 04:30:10.901531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.909 [2024-11-26 04:30:10.911887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.909 [2024-11-26 04:30:10.911915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.909 [2024-11-26 04:30:10.923634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.909 [2024-11-26 04:30:10.923665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.909 [2024-11-26 04:30:10.935482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.909 [2024-11-26 04:30:10.935513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.909 [2024-11-26 04:30:10.947149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.909 [2024-11-26 04:30:10.947180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.909 [2024-11-26 04:30:10.958885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.909 [2024-11-26 04:30:10.958913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.909 [2024-11-26 04:30:10.969585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:10.969615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:10.981156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:10.981187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:10.992620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:10.992651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:11.004341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:11.004372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:11.015464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:11.015505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:11.026907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:11.026935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:11.038579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:11.038610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:11.050338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:11.050369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:11.061551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:11.061582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:11.072759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:11.072802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:11.085747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:11.085775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:11.096121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:11.096152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:11.107623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:11.107654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:11.118935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:11.118978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:31.910 [2024-11-26 04:30:11.131496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:31.910 [2024-11-26 04:30:11.131527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.141570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.141601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.153450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.153481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.164391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.164422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.177900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.177927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.188683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.188741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.199974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.200018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.212890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.212918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.222825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.222853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.234125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.234168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.244954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.245000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.255834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.255863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.266922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.266961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.278086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.278117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.289268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.289298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.169 [2024-11-26 04:30:11.300436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.169 [2024-11-26 04:30:11.300467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.170 [2024-11-26 04:30:11.313393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.170 [2024-11-26 04:30:11.313424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.170 [2024-11-26 04:30:11.323855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.170 [2024-11-26 04:30:11.323884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.170 [2024-11-26 04:30:11.334565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.170 [2024-11-26 04:30:11.334596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.170 [2024-11-26 04:30:11.345900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.170 [2024-11-26 04:30:11.345928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.170 [2024-11-26 04:30:11.357545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.170 [2024-11-26 04:30:11.357576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.170 [2024-11-26 04:30:11.368806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.170 [2024-11-26 04:30:11.368835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.170 [2024-11-26 04:30:11.380076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.170 [2024-11-26 04:30:11.380107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.428 [2024-11-26 04:30:11.391807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.428 [2024-11-26 04:30:11.391836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.428 [2024-11-26 04:30:11.403213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.428 [2024-11-26 04:30:11.403244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.428 [2024-11-26 04:30:11.414771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.428 [2024-11-26 04:30:11.414798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.428 [2024-11-26 04:30:11.426239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.428 [2024-11-26 04:30:11.426270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.428 [2024-11-26 04:30:11.439315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.428 [2024-11-26 04:30:11.439345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.428 [2024-11-26 04:30:11.449408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.428 [2024-11-26 04:30:11.449450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.428 [2024-11-26 04:30:11.460302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.428 [2024-11-26 04:30:11.460333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.428 [2024-11-26 04:30:11.471463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.428 [2024-11-26 04:30:11.471494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.428 [2024-11-26 04:30:11.482607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.428 [2024-11-26 04:30:11.482637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.428 [2024-11-26 04:30:11.495498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.428 [2024-11-26 04:30:11.495529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.428 [2024-11-26 04:30:11.505766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.428 [2024-11-26 04:30:11.505793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.428 [2024-11-26 04:30:11.517215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.428 [2024-11-26 04:30:11.517246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.429 [2024-11-26 04:30:11.528172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.429 [2024-11-26 04:30:11.528202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.429 [2024-11-26 04:30:11.539534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.429 [2024-11-26 04:30:11.539565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.429 [2024-11-26 04:30:11.552923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.429 [2024-11-26 04:30:11.552951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.429 [2024-11-26 04:30:11.563416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.429 [2024-11-26 04:30:11.563447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.429 [2024-11-26 04:30:11.575103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.429 [2024-11-26 04:30:11.575134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.429 [2024-11-26 04:30:11.588694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.429 [2024-11-26 04:30:11.588740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.429 [2024-11-26 04:30:11.599125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.429 [2024-11-26 04:30:11.599155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.429 [2024-11-26 04:30:11.610971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.429 [2024-11-26 04:30:11.611014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.429 [2024-11-26 04:30:11.622529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.429 [2024-11-26 04:30:11.622559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.429 [2024-11-26 04:30:11.633901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.429 [2024-11-26 04:30:11.633929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.429 [2024-11-26 04:30:11.645006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.429 [2024-11-26 04:30:11.645037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.687 [2024-11-26 04:30:11.656375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.687 [2024-11-26 04:30:11.656406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.687 [2024-11-26 04:30:11.667395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.687 [2024-11-26 04:30:11.667435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.687 [2024-11-26 04:30:11.678676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.687 [2024-11-26 04:30:11.678720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.687 [2024-11-26 04:30:11.689581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.687 [2024-11-26 04:30:11.689612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.687 [2024-11-26 04:30:11.702711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.687 [2024-11-26 04:30:11.702742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.687 [2024-11-26 04:30:11.713435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.687 [2024-11-26 04:30:11.713466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.687 [2024-11-26 04:30:11.724468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.687 [2024-11-26 04:30:11.724499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.687 [2024-11-26 04:30:11.737875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.687 [2024-11-26 04:30:11.737903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.687 [2024-11-26 04:30:11.748705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.687 [2024-11-26 04:30:11.748748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.687 [2024-11-26 04:30:11.759786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.687 [2024-11-26 04:30:11.759814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.687 [2024-11-26 04:30:11.772566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.687 [2024-11-26 04:30:11.772596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.688 [2024-11-26 04:30:11.783012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.688 [2024-11-26 04:30:11.783058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.688 [2024-11-26 04:30:11.794931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.688 [2024-11-26 04:30:11.794958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.688 [2024-11-26 04:30:11.806308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.688 [2024-11-26 04:30:11.806339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.688 [2024-11-26 04:30:11.819795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.688 [2024-11-26 04:30:11.819822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.688 [2024-11-26 04:30:11.830411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.688 [2024-11-26 04:30:11.830441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.688 [2024-11-26 04:30:11.841291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.688 [2024-11-26 04:30:11.841321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.688 [2024-11-26 04:30:11.852781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.688 [2024-11-26 04:30:11.852809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.688 [2024-11-26 04:30:11.864045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.688 [2024-11-26 04:30:11.864078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.688 [2024-11-26 04:30:11.875585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.688 [2024-11-26 04:30:11.875616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.688 [2024-11-26 04:30:11.887173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.688 [2024-11-26 04:30:11.887205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.688 [2024-11-26 04:30:11.898220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.688 [2024-11-26 04:30:11.898251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:11.909699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:11.909749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:11.920936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:11.920964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:11.932121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:11.932151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:11.943661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:11.943704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:11.954981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:11.955008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:11.968077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:11.968108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:11.978583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:11.978614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:11.989667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:11.989709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.002753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.002781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.012694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.012740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.024905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.024934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.035760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.035788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.046758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.046800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.057917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.057945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.071168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.071199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.081798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.081827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.092469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.092500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.105315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.105346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.115623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.115654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.126990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.127020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.140132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.140163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.150386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.150416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:32.947 [2024-11-26 04:30:12.161296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:32.947 [2024-11-26 04:30:12.161326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.206 [2024-11-26 04:30:12.172271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.206 [2024-11-26 04:30:12.172302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.206 [2024-11-26 04:30:12.183422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.183452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.196760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.196803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.207929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.207957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.219005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.219036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.229642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.229672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.242433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.242464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.252210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.252240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.263937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.263965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.274731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.274759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.285709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.285752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.298926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.298954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.309649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.309680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.321007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.321039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.333702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.333749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.343848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.343875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.354579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.354610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.368105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.368136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.378369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.378399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.389810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.389839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.401184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.401215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.412052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.412084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.207 [2024-11-26 04:30:12.424788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.207 [2024-11-26 04:30:12.424818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.434571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.434603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.447098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.447129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.458355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.458386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.471385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.471417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.481394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.481425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.493306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.493337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.504732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.504761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.517663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.517706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.528458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.528489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.539861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.539889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.551089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.551120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.564011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.564042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.574644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.574674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.585807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.585835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.598891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.598919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.608910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.608938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.620228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.620259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.630957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.631002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.642336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.642367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.653746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.653774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.664900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.664930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.466 [2024-11-26 04:30:12.676090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.466 [2024-11-26 04:30:12.676121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.725 [2024-11-26 04:30:12.689309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.725 [2024-11-26 04:30:12.689339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.725 [2024-11-26 04:30:12.699148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.725 [2024-11-26 04:30:12.699179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.725 [2024-11-26 04:30:12.709963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.725 [2024-11-26 04:30:12.709991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.725 [2024-11-26 04:30:12.723082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.725 [2024-11-26 04:30:12.723113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.725 [2024-11-26 04:30:12.732438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.725 [2024-11-26 04:30:12.732469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.725 [2024-11-26 04:30:12.744301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.725 [2024-11-26 04:30:12.744341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.725 [2024-11-26 04:30:12.755310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.725 [2024-11-26 04:30:12.755340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.725 [2024-11-26 04:30:12.766544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.725 [2024-11-26 04:30:12.766575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.777418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.777449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.788659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.788698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.801509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.801540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.811208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.811238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.823271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.823301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.836360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.836390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.847274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.847304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.859159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.859189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.871061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.871092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.882378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.882408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.893854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.893882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.904945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.904990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.918340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.918371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.929245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.929275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.726 [2024-11-26 04:30:12.940453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.726 [2024-11-26 04:30:12.940484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:12.952142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:12.952172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:12.963168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:12.963209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:12.976251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:12.976281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:12.986917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:12.986944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:12.998666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:12.998706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.010054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.010085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.021561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.021592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.033285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.033316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.044619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.044649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.055950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.055978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.067565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.067597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.079403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.079434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.092656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.092696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.103398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.103430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.114824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.114852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.125007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.125038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 00:18:33.984 Latency(us) 00:18:33.984 [2024-11-26T03:30:13.210Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:33.984 [2024-11-26T03:30:13.210Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:18:33.984 Nvme1n1 : 5.01 11302.70 88.30 0.00 0.00 11309.72 4830.25 23592.96 00:18:33.984 [2024-11-26T03:30:13.210Z] =================================================================================================================== 00:18:33.984 [2024-11-26T03:30:13.210Z] Total : 11302.70 88.30 0.00 0.00 11309.72 4830.25 23592.96 00:18:33.984 [2024-11-26 04:30:13.130948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.130990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.138983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.139023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.147043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.147088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.984 [2024-11-26 04:30:13.155071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.984 [2024-11-26 04:30:13.155126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.985 [2024-11-26 04:30:13.163090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.985 [2024-11-26 04:30:13.163143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.985 [2024-11-26 04:30:13.171103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.985 [2024-11-26 04:30:13.171149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.985 [2024-11-26 04:30:13.179132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.985 [2024-11-26 04:30:13.179187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.985 [2024-11-26 04:30:13.187164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.985 [2024-11-26 04:30:13.187221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.985 [2024-11-26 04:30:13.195174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.985 [2024-11-26 04:30:13.195229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:33.985 [2024-11-26 04:30:13.203212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:33.985 [2024-11-26 04:30:13.203269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.211228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.211281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.227307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.227386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.235299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.235355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.243317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.243373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.251341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.251396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.259368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.259426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.267370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.267419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.275361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.275392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.283379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.283410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.291459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.291515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.299486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.299555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.307484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.307533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.315469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.315495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.323528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.323579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.331548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.331596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.339609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.339666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.347557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.244 [2024-11-26 04:30:13.347582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.244 [2024-11-26 04:30:13.355578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.245 [2024-11-26 04:30:13.355601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.245 [2024-11-26 04:30:13.363598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:34.245 [2024-11-26 04:30:13.363621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:34.245 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (2922213) - No such process 00:18:34.245 04:30:13 -- target/zcopy.sh@49 -- # wait 2922213 00:18:34.245 04:30:13 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:18:34.245 04:30:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.245 04:30:13 -- common/autotest_common.sh@10 -- # set +x 00:18:34.245 04:30:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.245 04:30:13 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:18:34.245 04:30:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.245 04:30:13 -- common/autotest_common.sh@10 -- # set +x 00:18:34.245 delay0 00:18:34.245 04:30:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.245 04:30:13 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:18:34.245 04:30:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.245 04:30:13 -- common/autotest_common.sh@10 -- # set +x 00:18:34.245 04:30:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.245 04:30:13 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:18:34.245 EAL: No free 2048 kB hugepages reported on node 1 00:18:34.503 [2024-11-26 04:30:13.475540] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:18:41.060 Initializing NVMe Controllers 00:18:41.060 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:41.060 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:41.060 Initialization complete. Launching workers. 00:18:41.060 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 63 00:18:41.060 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 350, failed to submit 33 00:18:41.060 success 150, unsuccess 200, failed 0 00:18:41.060 04:30:19 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:18:41.060 04:30:19 -- target/zcopy.sh@60 -- # nvmftestfini 00:18:41.060 04:30:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:41.060 04:30:19 -- nvmf/common.sh@116 -- # sync 00:18:41.060 04:30:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:41.060 04:30:19 -- nvmf/common.sh@119 -- # set +e 00:18:41.060 04:30:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:41.060 04:30:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:41.060 rmmod nvme_tcp 00:18:41.060 rmmod nvme_fabrics 00:18:41.060 rmmod nvme_keyring 00:18:41.060 04:30:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:41.060 04:30:19 -- nvmf/common.sh@123 -- # set -e 00:18:41.060 04:30:19 -- nvmf/common.sh@124 -- # return 0 00:18:41.060 04:30:19 -- nvmf/common.sh@477 -- # '[' -n 2920475 ']' 00:18:41.060 04:30:19 -- nvmf/common.sh@478 -- # killprocess 2920475 00:18:41.060 04:30:19 -- common/autotest_common.sh@936 -- # '[' -z 2920475 ']' 00:18:41.060 04:30:19 -- common/autotest_common.sh@940 -- # kill -0 2920475 00:18:41.060 04:30:19 -- common/autotest_common.sh@941 -- # uname 00:18:41.060 04:30:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:41.060 04:30:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2920475 00:18:41.060 04:30:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:41.060 04:30:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:41.060 04:30:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2920475' 00:18:41.060 killing process with pid 2920475 00:18:41.060 04:30:19 -- common/autotest_common.sh@955 -- # kill 2920475 00:18:41.060 04:30:19 -- common/autotest_common.sh@960 -- # wait 2920475 00:18:41.060 04:30:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:41.060 04:30:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:41.060 04:30:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:41.060 04:30:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:41.061 04:30:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:41.061 04:30:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:41.061 04:30:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:41.061 04:30:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:42.970 04:30:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:42.970 00:18:42.970 real 0m28.442s 00:18:42.970 user 0m41.898s 00:18:42.970 sys 0m8.094s 00:18:42.970 04:30:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:42.970 04:30:21 -- common/autotest_common.sh@10 -- # set +x 00:18:42.970 ************************************ 00:18:42.970 END TEST nvmf_zcopy 00:18:42.970 ************************************ 00:18:42.970 04:30:21 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:42.970 04:30:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:42.970 04:30:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:42.970 04:30:21 -- common/autotest_common.sh@10 -- # set +x 00:18:42.970 ************************************ 00:18:42.970 START TEST nvmf_nmic 00:18:42.970 ************************************ 00:18:42.970 04:30:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:42.970 * Looking for test storage... 00:18:42.970 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:42.970 04:30:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:42.970 04:30:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:42.970 04:30:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:42.970 04:30:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:42.970 04:30:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:42.970 04:30:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:42.970 04:30:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:42.970 04:30:22 -- scripts/common.sh@335 -- # IFS=.-: 00:18:42.970 04:30:22 -- scripts/common.sh@335 -- # read -ra ver1 00:18:42.970 04:30:22 -- scripts/common.sh@336 -- # IFS=.-: 00:18:42.970 04:30:22 -- scripts/common.sh@336 -- # read -ra ver2 00:18:42.970 04:30:22 -- scripts/common.sh@337 -- # local 'op=<' 00:18:42.970 04:30:22 -- scripts/common.sh@339 -- # ver1_l=2 00:18:42.970 04:30:22 -- scripts/common.sh@340 -- # ver2_l=1 00:18:42.970 04:30:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:42.970 04:30:22 -- scripts/common.sh@343 -- # case "$op" in 00:18:42.970 04:30:22 -- scripts/common.sh@344 -- # : 1 00:18:42.970 04:30:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:42.970 04:30:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:42.970 04:30:22 -- scripts/common.sh@364 -- # decimal 1 00:18:42.970 04:30:22 -- scripts/common.sh@352 -- # local d=1 00:18:42.970 04:30:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:42.970 04:30:22 -- scripts/common.sh@354 -- # echo 1 00:18:42.970 04:30:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:42.970 04:30:22 -- scripts/common.sh@365 -- # decimal 2 00:18:42.970 04:30:22 -- scripts/common.sh@352 -- # local d=2 00:18:42.970 04:30:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:42.970 04:30:22 -- scripts/common.sh@354 -- # echo 2 00:18:42.970 04:30:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:42.970 04:30:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:42.970 04:30:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:42.970 04:30:22 -- scripts/common.sh@367 -- # return 0 00:18:42.970 04:30:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:42.970 04:30:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:42.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:42.970 --rc genhtml_branch_coverage=1 00:18:42.970 --rc genhtml_function_coverage=1 00:18:42.970 --rc genhtml_legend=1 00:18:42.970 --rc geninfo_all_blocks=1 00:18:42.970 --rc geninfo_unexecuted_blocks=1 00:18:42.970 00:18:42.970 ' 00:18:42.970 04:30:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:42.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:42.970 --rc genhtml_branch_coverage=1 00:18:42.970 --rc genhtml_function_coverage=1 00:18:42.970 --rc genhtml_legend=1 00:18:42.970 --rc geninfo_all_blocks=1 00:18:42.970 --rc geninfo_unexecuted_blocks=1 00:18:42.970 00:18:42.970 ' 00:18:42.970 04:30:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:42.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:42.970 --rc genhtml_branch_coverage=1 00:18:42.970 --rc genhtml_function_coverage=1 00:18:42.970 --rc genhtml_legend=1 00:18:42.970 --rc geninfo_all_blocks=1 00:18:42.970 --rc geninfo_unexecuted_blocks=1 00:18:42.970 00:18:42.971 ' 00:18:42.971 04:30:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:42.971 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:42.971 --rc genhtml_branch_coverage=1 00:18:42.971 --rc genhtml_function_coverage=1 00:18:42.971 --rc genhtml_legend=1 00:18:42.971 --rc geninfo_all_blocks=1 00:18:42.971 --rc geninfo_unexecuted_blocks=1 00:18:42.971 00:18:42.971 ' 00:18:42.971 04:30:22 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:42.971 04:30:22 -- nvmf/common.sh@7 -- # uname -s 00:18:42.971 04:30:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:42.971 04:30:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:42.971 04:30:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:42.971 04:30:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:42.971 04:30:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:42.971 04:30:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:42.971 04:30:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:42.971 04:30:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:42.971 04:30:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:42.971 04:30:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:42.971 04:30:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:42.971 04:30:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:42.971 04:30:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:42.971 04:30:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:42.971 04:30:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:42.971 04:30:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:42.971 04:30:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:42.971 04:30:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:42.971 04:30:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:42.971 04:30:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:42.971 04:30:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:42.971 04:30:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:42.971 04:30:22 -- paths/export.sh@5 -- # export PATH 00:18:42.971 04:30:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:42.971 04:30:22 -- nvmf/common.sh@46 -- # : 0 00:18:42.971 04:30:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:42.971 04:30:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:42.971 04:30:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:42.971 04:30:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:42.971 04:30:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:42.971 04:30:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:42.971 04:30:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:42.971 04:30:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:42.971 04:30:22 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:42.971 04:30:22 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:42.971 04:30:22 -- target/nmic.sh@14 -- # nvmftestinit 00:18:42.971 04:30:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:42.971 04:30:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:42.971 04:30:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:42.971 04:30:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:42.971 04:30:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:42.971 04:30:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:42.971 04:30:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:42.971 04:30:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:42.971 04:30:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:42.971 04:30:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:42.971 04:30:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:42.971 04:30:22 -- common/autotest_common.sh@10 -- # set +x 00:18:45.505 04:30:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:45.505 04:30:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:45.505 04:30:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:45.505 04:30:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:45.505 04:30:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:45.505 04:30:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:45.505 04:30:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:45.505 04:30:24 -- nvmf/common.sh@294 -- # net_devs=() 00:18:45.505 04:30:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:45.505 04:30:24 -- nvmf/common.sh@295 -- # e810=() 00:18:45.505 04:30:24 -- nvmf/common.sh@295 -- # local -ga e810 00:18:45.505 04:30:24 -- nvmf/common.sh@296 -- # x722=() 00:18:45.505 04:30:24 -- nvmf/common.sh@296 -- # local -ga x722 00:18:45.505 04:30:24 -- nvmf/common.sh@297 -- # mlx=() 00:18:45.505 04:30:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:45.505 04:30:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:45.505 04:30:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:45.505 04:30:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:45.505 04:30:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:45.505 04:30:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:45.505 04:30:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:45.505 04:30:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:45.505 04:30:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:45.505 04:30:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:45.505 04:30:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:45.505 04:30:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:45.505 04:30:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:45.505 04:30:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:45.505 04:30:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:45.505 04:30:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:45.505 04:30:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:45.505 04:30:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:45.505 04:30:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:45.505 04:30:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:45.505 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:45.505 04:30:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:45.505 04:30:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:45.505 04:30:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:45.505 04:30:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:45.505 04:30:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:45.505 04:30:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:45.505 04:30:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:45.505 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:45.505 04:30:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:45.505 04:30:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:45.506 04:30:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:45.506 04:30:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:45.506 04:30:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:45.506 04:30:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:45.506 04:30:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:45.506 04:30:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:45.506 04:30:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:45.506 04:30:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:45.506 04:30:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:45.506 04:30:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:45.506 04:30:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:45.506 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:45.506 04:30:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:45.506 04:30:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:45.506 04:30:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:45.506 04:30:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:45.506 04:30:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:45.506 04:30:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:45.506 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:45.506 04:30:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:45.506 04:30:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:45.506 04:30:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:45.506 04:30:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:45.506 04:30:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:45.506 04:30:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:45.506 04:30:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:45.506 04:30:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:45.506 04:30:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:45.506 04:30:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:45.506 04:30:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:45.506 04:30:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:45.506 04:30:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:45.506 04:30:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:45.506 04:30:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:45.506 04:30:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:45.506 04:30:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:45.506 04:30:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:45.506 04:30:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:45.506 04:30:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:45.506 04:30:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:45.506 04:30:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:45.506 04:30:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:45.506 04:30:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:45.506 04:30:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:45.506 04:30:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:45.506 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:45.506 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.403 ms 00:18:45.506 00:18:45.506 --- 10.0.0.2 ping statistics --- 00:18:45.506 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:45.506 rtt min/avg/max/mdev = 0.403/0.403/0.403/0.000 ms 00:18:45.506 04:30:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:45.506 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:45.506 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.189 ms 00:18:45.506 00:18:45.506 --- 10.0.0.1 ping statistics --- 00:18:45.506 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:45.506 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:18:45.506 04:30:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:45.506 04:30:24 -- nvmf/common.sh@410 -- # return 0 00:18:45.506 04:30:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:45.506 04:30:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:45.506 04:30:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:45.506 04:30:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:45.506 04:30:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:45.506 04:30:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:45.506 04:30:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:45.506 04:30:24 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:18:45.506 04:30:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:45.506 04:30:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:45.506 04:30:24 -- common/autotest_common.sh@10 -- # set +x 00:18:45.506 04:30:24 -- nvmf/common.sh@469 -- # nvmfpid=2925915 00:18:45.506 04:30:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:45.506 04:30:24 -- nvmf/common.sh@470 -- # waitforlisten 2925915 00:18:45.506 04:30:24 -- common/autotest_common.sh@829 -- # '[' -z 2925915 ']' 00:18:45.506 04:30:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:45.506 04:30:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:45.506 04:30:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:45.506 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:45.506 04:30:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:45.506 04:30:24 -- common/autotest_common.sh@10 -- # set +x 00:18:45.506 [2024-11-26 04:30:24.514067] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:45.506 [2024-11-26 04:30:24.514154] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:45.506 EAL: No free 2048 kB hugepages reported on node 1 00:18:45.506 [2024-11-26 04:30:24.579588] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:45.506 [2024-11-26 04:30:24.664506] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:45.506 [2024-11-26 04:30:24.664655] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:45.506 [2024-11-26 04:30:24.664693] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:45.506 [2024-11-26 04:30:24.664707] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:45.506 [2024-11-26 04:30:24.664777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:45.506 [2024-11-26 04:30:24.664839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:45.506 [2024-11-26 04:30:24.664904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:45.506 [2024-11-26 04:30:24.664906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:46.442 04:30:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:46.442 04:30:25 -- common/autotest_common.sh@862 -- # return 0 00:18:46.442 04:30:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:46.442 04:30:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:46.442 04:30:25 -- common/autotest_common.sh@10 -- # set +x 00:18:46.442 04:30:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:46.442 04:30:25 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:46.442 04:30:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:46.442 04:30:25 -- common/autotest_common.sh@10 -- # set +x 00:18:46.442 [2024-11-26 04:30:25.562713] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:46.442 04:30:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:46.442 04:30:25 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:46.442 04:30:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:46.442 04:30:25 -- common/autotest_common.sh@10 -- # set +x 00:18:46.442 Malloc0 00:18:46.442 04:30:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:46.442 04:30:25 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:18:46.442 04:30:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:46.442 04:30:25 -- common/autotest_common.sh@10 -- # set +x 00:18:46.442 04:30:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:46.443 04:30:25 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:46.443 04:30:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:46.443 04:30:25 -- common/autotest_common.sh@10 -- # set +x 00:18:46.443 04:30:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:46.443 04:30:25 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:46.443 04:30:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:46.443 04:30:25 -- common/autotest_common.sh@10 -- # set +x 00:18:46.443 [2024-11-26 04:30:25.616302] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:46.443 04:30:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:46.443 04:30:25 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:18:46.443 test case1: single bdev can't be used in multiple subsystems 00:18:46.443 04:30:25 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:46.443 04:30:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:46.443 04:30:25 -- common/autotest_common.sh@10 -- # set +x 00:18:46.443 04:30:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:46.443 04:30:25 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:46.443 04:30:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:46.443 04:30:25 -- common/autotest_common.sh@10 -- # set +x 00:18:46.443 04:30:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:46.443 04:30:25 -- target/nmic.sh@28 -- # nmic_status=0 00:18:46.443 04:30:25 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:18:46.443 04:30:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:46.443 04:30:25 -- common/autotest_common.sh@10 -- # set +x 00:18:46.443 [2024-11-26 04:30:25.640144] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:18:46.443 [2024-11-26 04:30:25.640175] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:18:46.443 [2024-11-26 04:30:25.640190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:46.443 request: 00:18:46.443 { 00:18:46.443 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:18:46.443 "namespace": { 00:18:46.443 "bdev_name": "Malloc0" 00:18:46.443 }, 00:18:46.443 "method": "nvmf_subsystem_add_ns", 00:18:46.443 "req_id": 1 00:18:46.443 } 00:18:46.443 Got JSON-RPC error response 00:18:46.443 response: 00:18:46.443 { 00:18:46.443 "code": -32602, 00:18:46.443 "message": "Invalid parameters" 00:18:46.443 } 00:18:46.443 04:30:25 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:18:46.443 04:30:25 -- target/nmic.sh@29 -- # nmic_status=1 00:18:46.443 04:30:25 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:18:46.443 04:30:25 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:18:46.443 Adding namespace failed - expected result. 00:18:46.443 04:30:25 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:18:46.443 test case2: host connect to nvmf target in multiple paths 00:18:46.443 04:30:25 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:18:46.443 04:30:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:46.443 04:30:25 -- common/autotest_common.sh@10 -- # set +x 00:18:46.443 [2024-11-26 04:30:25.648259] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:18:46.443 04:30:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:46.443 04:30:25 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:47.377 04:30:26 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:18:47.942 04:30:26 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:18:47.942 04:30:26 -- common/autotest_common.sh@1187 -- # local i=0 00:18:47.942 04:30:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:18:47.942 04:30:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:18:47.942 04:30:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:18:49.840 04:30:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:18:49.840 04:30:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:18:49.840 04:30:28 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:18:49.840 04:30:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:18:49.840 04:30:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:18:49.840 04:30:28 -- common/autotest_common.sh@1197 -- # return 0 00:18:49.840 04:30:28 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:18:49.840 [global] 00:18:49.840 thread=1 00:18:49.840 invalidate=1 00:18:49.840 rw=write 00:18:49.840 time_based=1 00:18:49.840 runtime=1 00:18:49.840 ioengine=libaio 00:18:49.840 direct=1 00:18:49.840 bs=4096 00:18:49.840 iodepth=1 00:18:49.840 norandommap=0 00:18:49.840 numjobs=1 00:18:49.840 00:18:49.840 verify_dump=1 00:18:49.840 verify_backlog=512 00:18:49.840 verify_state_save=0 00:18:49.840 do_verify=1 00:18:49.840 verify=crc32c-intel 00:18:49.840 [job0] 00:18:49.840 filename=/dev/nvme0n1 00:18:49.840 Could not set queue depth (nvme0n1) 00:18:50.098 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:50.098 fio-3.35 00:18:50.098 Starting 1 thread 00:18:51.472 00:18:51.472 job0: (groupid=0, jobs=1): err= 0: pid=2926580: Tue Nov 26 04:30:30 2024 00:18:51.472 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:18:51.472 slat (nsec): min=5424, max=50484, avg=11792.48, stdev=6972.87 00:18:51.472 clat (usec): min=194, max=556, avg=255.84, stdev=42.13 00:18:51.472 lat (usec): min=210, max=577, avg=267.63, stdev=45.63 00:18:51.472 clat percentiles (usec): 00:18:51.472 | 1.00th=[ 206], 5.00th=[ 217], 10.00th=[ 223], 20.00th=[ 233], 00:18:51.472 | 30.00th=[ 239], 40.00th=[ 243], 50.00th=[ 249], 60.00th=[ 255], 00:18:51.472 | 70.00th=[ 265], 80.00th=[ 269], 90.00th=[ 281], 95.00th=[ 297], 00:18:51.472 | 99.00th=[ 478], 99.50th=[ 490], 99.90th=[ 519], 99.95th=[ 523], 00:18:51.472 | 99.99th=[ 553] 00:18:51.472 write: IOPS=2367, BW=9471KiB/s (9698kB/s)(9480KiB/1001msec); 0 zone resets 00:18:51.472 slat (nsec): min=6927, max=76133, avg=14322.06, stdev=8159.26 00:18:51.472 clat (usec): min=135, max=583, avg=169.63, stdev=23.73 00:18:51.472 lat (usec): min=143, max=591, avg=183.95, stdev=28.29 00:18:51.472 clat percentiles (usec): 00:18:51.472 | 1.00th=[ 139], 5.00th=[ 145], 10.00th=[ 149], 20.00th=[ 153], 00:18:51.472 | 30.00th=[ 157], 40.00th=[ 161], 50.00th=[ 167], 60.00th=[ 174], 00:18:51.472 | 70.00th=[ 178], 80.00th=[ 184], 90.00th=[ 194], 95.00th=[ 204], 00:18:51.472 | 99.00th=[ 239], 99.50th=[ 281], 99.90th=[ 424], 99.95th=[ 469], 00:18:51.472 | 99.99th=[ 586] 00:18:51.472 bw ( KiB/s): min=10688, max=10688, per=100.00%, avg=10688.00, stdev= 0.00, samples=1 00:18:51.472 iops : min= 2674, max= 2674, avg=2674.00, stdev= 0.00, samples=1 00:18:51.472 lat (usec) : 250=77.48%, 500=22.32%, 750=0.20% 00:18:51.472 cpu : usr=3.40%, sys=7.70%, ctx=4419, majf=0, minf=1 00:18:51.472 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:51.472 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:51.472 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:51.472 issued rwts: total=2048,2370,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:51.472 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:51.472 00:18:51.472 Run status group 0 (all jobs): 00:18:51.472 READ: bw=8184KiB/s (8380kB/s), 8184KiB/s-8184KiB/s (8380kB/s-8380kB/s), io=8192KiB (8389kB), run=1001-1001msec 00:18:51.472 WRITE: bw=9471KiB/s (9698kB/s), 9471KiB/s-9471KiB/s (9698kB/s-9698kB/s), io=9480KiB (9708kB), run=1001-1001msec 00:18:51.472 00:18:51.472 Disk stats (read/write): 00:18:51.472 nvme0n1: ios=1912/2048, merge=0/0, ticks=606/324, in_queue=930, util=99.80% 00:18:51.472 04:30:30 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:18:51.472 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:18:51.472 04:30:30 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:18:51.472 04:30:30 -- common/autotest_common.sh@1208 -- # local i=0 00:18:51.472 04:30:30 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:18:51.472 04:30:30 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:51.472 04:30:30 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:18:51.472 04:30:30 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:51.472 04:30:30 -- common/autotest_common.sh@1220 -- # return 0 00:18:51.472 04:30:30 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:18:51.472 04:30:30 -- target/nmic.sh@53 -- # nvmftestfini 00:18:51.472 04:30:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:51.472 04:30:30 -- nvmf/common.sh@116 -- # sync 00:18:51.472 04:30:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:51.472 04:30:30 -- nvmf/common.sh@119 -- # set +e 00:18:51.472 04:30:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:51.472 04:30:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:51.472 rmmod nvme_tcp 00:18:51.472 rmmod nvme_fabrics 00:18:51.472 rmmod nvme_keyring 00:18:51.472 04:30:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:51.472 04:30:30 -- nvmf/common.sh@123 -- # set -e 00:18:51.472 04:30:30 -- nvmf/common.sh@124 -- # return 0 00:18:51.472 04:30:30 -- nvmf/common.sh@477 -- # '[' -n 2925915 ']' 00:18:51.472 04:30:30 -- nvmf/common.sh@478 -- # killprocess 2925915 00:18:51.472 04:30:30 -- common/autotest_common.sh@936 -- # '[' -z 2925915 ']' 00:18:51.472 04:30:30 -- common/autotest_common.sh@940 -- # kill -0 2925915 00:18:51.472 04:30:30 -- common/autotest_common.sh@941 -- # uname 00:18:51.472 04:30:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:51.472 04:30:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2925915 00:18:51.472 04:30:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:51.472 04:30:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:51.472 04:30:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2925915' 00:18:51.472 killing process with pid 2925915 00:18:51.472 04:30:30 -- common/autotest_common.sh@955 -- # kill 2925915 00:18:51.472 04:30:30 -- common/autotest_common.sh@960 -- # wait 2925915 00:18:51.731 04:30:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:51.731 04:30:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:51.731 04:30:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:51.731 04:30:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:51.731 04:30:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:51.731 04:30:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:51.731 04:30:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:51.731 04:30:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:53.643 04:30:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:53.643 00:18:53.643 real 0m10.848s 00:18:53.643 user 0m25.616s 00:18:53.643 sys 0m2.664s 00:18:53.643 04:30:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:53.643 04:30:32 -- common/autotest_common.sh@10 -- # set +x 00:18:53.643 ************************************ 00:18:53.643 END TEST nvmf_nmic 00:18:53.643 ************************************ 00:18:53.902 04:30:32 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:18:53.902 04:30:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:53.902 04:30:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:53.902 04:30:32 -- common/autotest_common.sh@10 -- # set +x 00:18:53.902 ************************************ 00:18:53.902 START TEST nvmf_fio_target 00:18:53.902 ************************************ 00:18:53.903 04:30:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:18:53.903 * Looking for test storage... 00:18:53.903 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:53.903 04:30:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:53.903 04:30:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:53.903 04:30:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:53.903 04:30:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:53.903 04:30:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:53.903 04:30:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:53.903 04:30:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:53.903 04:30:33 -- scripts/common.sh@335 -- # IFS=.-: 00:18:53.903 04:30:33 -- scripts/common.sh@335 -- # read -ra ver1 00:18:53.903 04:30:33 -- scripts/common.sh@336 -- # IFS=.-: 00:18:53.903 04:30:33 -- scripts/common.sh@336 -- # read -ra ver2 00:18:53.903 04:30:33 -- scripts/common.sh@337 -- # local 'op=<' 00:18:53.903 04:30:33 -- scripts/common.sh@339 -- # ver1_l=2 00:18:53.903 04:30:33 -- scripts/common.sh@340 -- # ver2_l=1 00:18:53.903 04:30:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:53.903 04:30:33 -- scripts/common.sh@343 -- # case "$op" in 00:18:53.903 04:30:33 -- scripts/common.sh@344 -- # : 1 00:18:53.903 04:30:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:53.903 04:30:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:53.903 04:30:33 -- scripts/common.sh@364 -- # decimal 1 00:18:53.903 04:30:33 -- scripts/common.sh@352 -- # local d=1 00:18:53.903 04:30:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:53.903 04:30:33 -- scripts/common.sh@354 -- # echo 1 00:18:53.903 04:30:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:53.903 04:30:33 -- scripts/common.sh@365 -- # decimal 2 00:18:53.903 04:30:33 -- scripts/common.sh@352 -- # local d=2 00:18:53.903 04:30:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:53.903 04:30:33 -- scripts/common.sh@354 -- # echo 2 00:18:53.903 04:30:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:53.903 04:30:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:53.903 04:30:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:53.903 04:30:33 -- scripts/common.sh@367 -- # return 0 00:18:53.903 04:30:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:53.903 04:30:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:53.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:53.903 --rc genhtml_branch_coverage=1 00:18:53.903 --rc genhtml_function_coverage=1 00:18:53.903 --rc genhtml_legend=1 00:18:53.903 --rc geninfo_all_blocks=1 00:18:53.903 --rc geninfo_unexecuted_blocks=1 00:18:53.903 00:18:53.903 ' 00:18:53.903 04:30:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:53.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:53.903 --rc genhtml_branch_coverage=1 00:18:53.903 --rc genhtml_function_coverage=1 00:18:53.903 --rc genhtml_legend=1 00:18:53.903 --rc geninfo_all_blocks=1 00:18:53.903 --rc geninfo_unexecuted_blocks=1 00:18:53.903 00:18:53.903 ' 00:18:53.903 04:30:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:53.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:53.903 --rc genhtml_branch_coverage=1 00:18:53.903 --rc genhtml_function_coverage=1 00:18:53.903 --rc genhtml_legend=1 00:18:53.903 --rc geninfo_all_blocks=1 00:18:53.903 --rc geninfo_unexecuted_blocks=1 00:18:53.903 00:18:53.903 ' 00:18:53.903 04:30:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:53.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:53.903 --rc genhtml_branch_coverage=1 00:18:53.903 --rc genhtml_function_coverage=1 00:18:53.903 --rc genhtml_legend=1 00:18:53.903 --rc geninfo_all_blocks=1 00:18:53.903 --rc geninfo_unexecuted_blocks=1 00:18:53.903 00:18:53.903 ' 00:18:53.903 04:30:33 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:53.903 04:30:33 -- nvmf/common.sh@7 -- # uname -s 00:18:53.903 04:30:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:53.903 04:30:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:53.903 04:30:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:53.903 04:30:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:53.903 04:30:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:53.903 04:30:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:53.903 04:30:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:53.903 04:30:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:53.903 04:30:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:53.903 04:30:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:53.903 04:30:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:53.903 04:30:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:53.903 04:30:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:53.903 04:30:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:53.903 04:30:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:53.903 04:30:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:53.903 04:30:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:53.903 04:30:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:53.903 04:30:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:53.903 04:30:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.903 04:30:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.903 04:30:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.903 04:30:33 -- paths/export.sh@5 -- # export PATH 00:18:53.903 04:30:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.903 04:30:33 -- nvmf/common.sh@46 -- # : 0 00:18:53.903 04:30:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:53.903 04:30:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:53.903 04:30:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:53.903 04:30:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:53.903 04:30:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:53.903 04:30:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:53.903 04:30:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:53.903 04:30:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:53.903 04:30:33 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:53.903 04:30:33 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:53.903 04:30:33 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:53.903 04:30:33 -- target/fio.sh@16 -- # nvmftestinit 00:18:53.903 04:30:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:53.903 04:30:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:53.903 04:30:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:53.903 04:30:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:53.903 04:30:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:53.903 04:30:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:53.903 04:30:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:53.903 04:30:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:53.903 04:30:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:53.903 04:30:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:53.903 04:30:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:53.903 04:30:33 -- common/autotest_common.sh@10 -- # set +x 00:18:56.431 04:30:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:56.431 04:30:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:56.431 04:30:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:56.431 04:30:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:56.431 04:30:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:56.431 04:30:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:56.431 04:30:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:56.431 04:30:35 -- nvmf/common.sh@294 -- # net_devs=() 00:18:56.431 04:30:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:56.431 04:30:35 -- nvmf/common.sh@295 -- # e810=() 00:18:56.431 04:30:35 -- nvmf/common.sh@295 -- # local -ga e810 00:18:56.431 04:30:35 -- nvmf/common.sh@296 -- # x722=() 00:18:56.431 04:30:35 -- nvmf/common.sh@296 -- # local -ga x722 00:18:56.431 04:30:35 -- nvmf/common.sh@297 -- # mlx=() 00:18:56.431 04:30:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:56.431 04:30:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:56.431 04:30:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:56.431 04:30:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:56.431 04:30:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:56.431 04:30:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:56.431 04:30:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:56.431 04:30:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:56.431 04:30:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:56.431 04:30:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:56.431 04:30:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:56.431 04:30:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:56.431 04:30:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:56.431 04:30:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:56.431 04:30:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:56.431 04:30:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:56.431 04:30:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:56.431 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:56.431 04:30:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:56.431 04:30:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:56.431 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:56.431 04:30:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:56.431 04:30:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:56.431 04:30:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:56.431 04:30:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:56.431 04:30:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:56.431 04:30:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:56.431 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:56.431 04:30:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:56.431 04:30:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:56.431 04:30:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:56.431 04:30:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:56.431 04:30:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:56.431 04:30:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:56.431 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:56.431 04:30:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:56.431 04:30:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:56.431 04:30:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:56.431 04:30:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:56.431 04:30:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:56.432 04:30:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:56.432 04:30:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:56.432 04:30:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:56.432 04:30:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:56.432 04:30:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:56.432 04:30:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:56.432 04:30:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:56.432 04:30:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:56.432 04:30:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:56.432 04:30:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:56.432 04:30:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:56.432 04:30:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:56.432 04:30:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:56.432 04:30:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:56.432 04:30:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:56.432 04:30:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:56.432 04:30:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:56.432 04:30:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:56.432 04:30:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:56.432 04:30:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:56.432 04:30:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:56.432 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:56.432 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:18:56.432 00:18:56.432 --- 10.0.0.2 ping statistics --- 00:18:56.432 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:56.432 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:18:56.432 04:30:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:56.432 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:56.432 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:18:56.432 00:18:56.432 --- 10.0.0.1 ping statistics --- 00:18:56.432 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:56.432 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:18:56.432 04:30:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:56.432 04:30:35 -- nvmf/common.sh@410 -- # return 0 00:18:56.432 04:30:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:56.432 04:30:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:56.432 04:30:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:56.432 04:30:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:56.432 04:30:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:56.432 04:30:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:56.432 04:30:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:56.432 04:30:35 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:18:56.432 04:30:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:56.432 04:30:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:56.432 04:30:35 -- common/autotest_common.sh@10 -- # set +x 00:18:56.432 04:30:35 -- nvmf/common.sh@469 -- # nvmfpid=2928764 00:18:56.432 04:30:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:56.432 04:30:35 -- nvmf/common.sh@470 -- # waitforlisten 2928764 00:18:56.432 04:30:35 -- common/autotest_common.sh@829 -- # '[' -z 2928764 ']' 00:18:56.432 04:30:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:56.432 04:30:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:56.432 04:30:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:56.432 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:56.432 04:30:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:56.432 04:30:35 -- common/autotest_common.sh@10 -- # set +x 00:18:56.432 [2024-11-26 04:30:35.315130] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:56.432 [2024-11-26 04:30:35.315210] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:56.432 EAL: No free 2048 kB hugepages reported on node 1 00:18:56.432 [2024-11-26 04:30:35.383713] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:56.432 [2024-11-26 04:30:35.476823] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:56.432 [2024-11-26 04:30:35.477005] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:56.432 [2024-11-26 04:30:35.477024] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:56.432 [2024-11-26 04:30:35.477039] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:56.432 [2024-11-26 04:30:35.477111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:56.432 [2024-11-26 04:30:35.477143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:56.432 [2024-11-26 04:30:35.477198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:56.432 [2024-11-26 04:30:35.477201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:57.365 04:30:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:57.365 04:30:36 -- common/autotest_common.sh@862 -- # return 0 00:18:57.365 04:30:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:57.365 04:30:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:57.365 04:30:36 -- common/autotest_common.sh@10 -- # set +x 00:18:57.365 04:30:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:57.365 04:30:36 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:18:57.365 [2024-11-26 04:30:36.547235] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:57.365 04:30:36 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:57.930 04:30:36 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:18:57.930 04:30:36 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:58.188 04:30:37 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:18:58.188 04:30:37 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:58.446 04:30:37 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:18:58.446 04:30:37 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:58.705 04:30:37 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:18:58.705 04:30:37 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:18:58.962 04:30:37 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:59.220 04:30:38 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:18:59.220 04:30:38 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:59.478 04:30:38 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:18:59.478 04:30:38 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:59.737 04:30:38 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:18:59.737 04:30:38 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:18:59.995 04:30:39 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:00.252 04:30:39 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:00.252 04:30:39 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:00.510 04:30:39 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:00.510 04:30:39 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:00.767 04:30:39 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:01.026 [2024-11-26 04:30:40.032939] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:01.026 04:30:40 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:01.283 04:30:40 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:01.541 04:30:40 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:02.106 04:30:41 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:02.107 04:30:41 -- common/autotest_common.sh@1187 -- # local i=0 00:19:02.107 04:30:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:02.107 04:30:41 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:02.107 04:30:41 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:02.107 04:30:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:04.006 04:30:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:04.006 04:30:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:04.006 04:30:43 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:04.006 04:30:43 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:04.006 04:30:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:04.006 04:30:43 -- common/autotest_common.sh@1197 -- # return 0 00:19:04.006 04:30:43 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:04.006 [global] 00:19:04.006 thread=1 00:19:04.006 invalidate=1 00:19:04.006 rw=write 00:19:04.006 time_based=1 00:19:04.006 runtime=1 00:19:04.006 ioengine=libaio 00:19:04.006 direct=1 00:19:04.006 bs=4096 00:19:04.006 iodepth=1 00:19:04.006 norandommap=0 00:19:04.006 numjobs=1 00:19:04.006 00:19:04.006 verify_dump=1 00:19:04.006 verify_backlog=512 00:19:04.006 verify_state_save=0 00:19:04.006 do_verify=1 00:19:04.006 verify=crc32c-intel 00:19:04.006 [job0] 00:19:04.006 filename=/dev/nvme0n1 00:19:04.006 [job1] 00:19:04.006 filename=/dev/nvme0n2 00:19:04.006 [job2] 00:19:04.006 filename=/dev/nvme0n3 00:19:04.006 [job3] 00:19:04.006 filename=/dev/nvme0n4 00:19:04.304 Could not set queue depth (nvme0n1) 00:19:04.304 Could not set queue depth (nvme0n2) 00:19:04.304 Could not set queue depth (nvme0n3) 00:19:04.304 Could not set queue depth (nvme0n4) 00:19:04.304 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:04.304 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:04.304 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:04.304 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:04.304 fio-3.35 00:19:04.304 Starting 4 threads 00:19:05.712 00:19:05.712 job0: (groupid=0, jobs=1): err= 0: pid=2929909: Tue Nov 26 04:30:44 2024 00:19:05.712 read: IOPS=510, BW=2043KiB/s (2092kB/s)(2092KiB/1024msec) 00:19:05.712 slat (nsec): min=6461, max=64885, avg=12443.24, stdev=7859.39 00:19:05.712 clat (usec): min=208, max=42276, avg=1537.04, stdev=7111.61 00:19:05.712 lat (usec): min=216, max=42284, avg=1549.48, stdev=7114.22 00:19:05.712 clat percentiles (usec): 00:19:05.712 | 1.00th=[ 217], 5.00th=[ 225], 10.00th=[ 231], 20.00th=[ 241], 00:19:05.712 | 30.00th=[ 245], 40.00th=[ 249], 50.00th=[ 253], 60.00th=[ 258], 00:19:05.712 | 70.00th=[ 269], 80.00th=[ 310], 90.00th=[ 396], 95.00th=[ 519], 00:19:05.712 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:05.712 | 99.99th=[42206] 00:19:05.712 write: IOPS=1000, BW=4000KiB/s (4096kB/s)(4096KiB/1024msec); 0 zone resets 00:19:05.712 slat (nsec): min=8040, max=55713, avg=15951.35, stdev=7864.58 00:19:05.712 clat (usec): min=147, max=278, avg=186.32, stdev=16.92 00:19:05.712 lat (usec): min=156, max=301, avg=202.27, stdev=22.13 00:19:05.712 clat percentiles (usec): 00:19:05.712 | 1.00th=[ 155], 5.00th=[ 161], 10.00th=[ 165], 20.00th=[ 172], 00:19:05.712 | 30.00th=[ 176], 40.00th=[ 182], 50.00th=[ 186], 60.00th=[ 190], 00:19:05.712 | 70.00th=[ 194], 80.00th=[ 200], 90.00th=[ 208], 95.00th=[ 212], 00:19:05.712 | 99.00th=[ 231], 99.50th=[ 239], 99.90th=[ 245], 99.95th=[ 281], 00:19:05.712 | 99.99th=[ 281] 00:19:05.712 bw ( KiB/s): min= 3832, max= 4360, per=20.48%, avg=4096.00, stdev=373.35, samples=2 00:19:05.712 iops : min= 958, max= 1090, avg=1024.00, stdev=93.34, samples=2 00:19:05.712 lat (usec) : 250=81.06%, 500=17.13%, 750=0.78% 00:19:05.712 lat (msec) : 50=1.03% 00:19:05.712 cpu : usr=1.96%, sys=2.44%, ctx=1548, majf=0, minf=1 00:19:05.712 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:05.712 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.712 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.712 issued rwts: total=523,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.712 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:05.712 job1: (groupid=0, jobs=1): err= 0: pid=2929910: Tue Nov 26 04:30:44 2024 00:19:05.712 read: IOPS=1031, BW=4127KiB/s (4226kB/s)(4168KiB/1010msec) 00:19:05.712 slat (nsec): min=5647, max=46316, avg=9792.44, stdev=5260.34 00:19:05.712 clat (usec): min=197, max=42035, avg=640.26, stdev=3978.74 00:19:05.712 lat (usec): min=204, max=42052, avg=650.05, stdev=3980.47 00:19:05.712 clat percentiles (usec): 00:19:05.712 | 1.00th=[ 204], 5.00th=[ 210], 10.00th=[ 215], 20.00th=[ 219], 00:19:05.712 | 30.00th=[ 225], 40.00th=[ 231], 50.00th=[ 239], 60.00th=[ 253], 00:19:05.712 | 70.00th=[ 265], 80.00th=[ 277], 90.00th=[ 293], 95.00th=[ 322], 00:19:05.712 | 99.00th=[ 510], 99.50th=[41157], 99.90th=[41157], 99.95th=[42206], 00:19:05.712 | 99.99th=[42206] 00:19:05.712 write: IOPS=1520, BW=6083KiB/s (6229kB/s)(6144KiB/1010msec); 0 zone resets 00:19:05.712 slat (nsec): min=7323, max=55315, avg=16950.91, stdev=7295.06 00:19:05.712 clat (usec): min=146, max=310, avg=192.46, stdev=21.18 00:19:05.712 lat (usec): min=156, max=349, avg=209.42, stdev=23.37 00:19:05.712 clat percentiles (usec): 00:19:05.713 | 1.00th=[ 157], 5.00th=[ 163], 10.00th=[ 167], 20.00th=[ 176], 00:19:05.713 | 30.00th=[ 184], 40.00th=[ 188], 50.00th=[ 192], 60.00th=[ 194], 00:19:05.713 | 70.00th=[ 198], 80.00th=[ 202], 90.00th=[ 217], 95.00th=[ 243], 00:19:05.713 | 99.00th=[ 253], 99.50th=[ 265], 99.90th=[ 302], 99.95th=[ 310], 00:19:05.713 | 99.99th=[ 310] 00:19:05.713 bw ( KiB/s): min= 3472, max= 8816, per=30.72%, avg=6144.00, stdev=3778.78, samples=2 00:19:05.713 iops : min= 868, max= 2204, avg=1536.00, stdev=944.69, samples=2 00:19:05.713 lat (usec) : 250=82.54%, 500=16.99%, 750=0.08% 00:19:05.713 lat (msec) : 50=0.39% 00:19:05.713 cpu : usr=2.48%, sys=4.96%, ctx=2578, majf=0, minf=1 00:19:05.713 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:05.713 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.713 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.713 issued rwts: total=1042,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.713 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:05.713 job2: (groupid=0, jobs=1): err= 0: pid=2929911: Tue Nov 26 04:30:44 2024 00:19:05.713 read: IOPS=23, BW=94.9KiB/s (97.1kB/s)(96.0KiB/1012msec) 00:19:05.713 slat (nsec): min=6994, max=51100, avg=27077.17, stdev=11866.96 00:19:05.713 clat (usec): min=334, max=42051, avg=37940.80, stdev=11591.31 00:19:05.713 lat (usec): min=354, max=42065, avg=37967.88, stdev=11590.84 00:19:05.713 clat percentiles (usec): 00:19:05.713 | 1.00th=[ 334], 5.00th=[ 355], 10.00th=[40633], 20.00th=[41157], 00:19:05.713 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:19:05.713 | 70.00th=[41681], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:05.713 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:05.713 | 99.99th=[42206] 00:19:05.713 write: IOPS=505, BW=2024KiB/s (2072kB/s)(2048KiB/1012msec); 0 zone resets 00:19:05.713 slat (nsec): min=8117, max=38774, avg=9362.38, stdev=2129.46 00:19:05.713 clat (usec): min=156, max=251, avg=183.34, stdev=12.43 00:19:05.713 lat (usec): min=165, max=278, avg=192.70, stdev=12.99 00:19:05.713 clat percentiles (usec): 00:19:05.713 | 1.00th=[ 161], 5.00th=[ 165], 10.00th=[ 169], 20.00th=[ 174], 00:19:05.713 | 30.00th=[ 178], 40.00th=[ 180], 50.00th=[ 182], 60.00th=[ 186], 00:19:05.713 | 70.00th=[ 188], 80.00th=[ 194], 90.00th=[ 200], 95.00th=[ 206], 00:19:05.713 | 99.00th=[ 223], 99.50th=[ 225], 99.90th=[ 251], 99.95th=[ 251], 00:19:05.713 | 99.99th=[ 251] 00:19:05.713 bw ( KiB/s): min= 4096, max= 4096, per=20.48%, avg=4096.00, stdev= 0.00, samples=1 00:19:05.713 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:05.713 lat (usec) : 250=95.34%, 500=0.56% 00:19:05.713 lat (msec) : 50=4.10% 00:19:05.713 cpu : usr=0.40%, sys=0.59%, ctx=537, majf=0, minf=1 00:19:05.713 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:05.713 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.713 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.713 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.713 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:05.713 job3: (groupid=0, jobs=1): err= 0: pid=2929912: Tue Nov 26 04:30:44 2024 00:19:05.713 read: IOPS=1938, BW=7752KiB/s (7938kB/s)(7760KiB/1001msec) 00:19:05.713 slat (nsec): min=5839, max=54998, avg=11898.89, stdev=5255.10 00:19:05.713 clat (usec): min=222, max=416, avg=266.59, stdev=22.06 00:19:05.713 lat (usec): min=228, max=448, avg=278.48, stdev=25.87 00:19:05.713 clat percentiles (usec): 00:19:05.713 | 1.00th=[ 231], 5.00th=[ 237], 10.00th=[ 241], 20.00th=[ 245], 00:19:05.713 | 30.00th=[ 251], 40.00th=[ 255], 50.00th=[ 265], 60.00th=[ 273], 00:19:05.713 | 70.00th=[ 281], 80.00th=[ 285], 90.00th=[ 293], 95.00th=[ 302], 00:19:05.713 | 99.00th=[ 322], 99.50th=[ 330], 99.90th=[ 375], 99.95th=[ 416], 00:19:05.713 | 99.99th=[ 416] 00:19:05.713 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:05.713 slat (nsec): min=7475, max=46928, avg=17581.66, stdev=6526.66 00:19:05.713 clat (usec): min=150, max=3336, avg=198.39, stdev=72.42 00:19:05.713 lat (usec): min=161, max=3344, avg=215.98, stdev=72.64 00:19:05.713 clat percentiles (usec): 00:19:05.713 | 1.00th=[ 157], 5.00th=[ 165], 10.00th=[ 174], 20.00th=[ 182], 00:19:05.713 | 30.00th=[ 188], 40.00th=[ 192], 50.00th=[ 194], 60.00th=[ 198], 00:19:05.713 | 70.00th=[ 204], 80.00th=[ 210], 90.00th=[ 227], 95.00th=[ 243], 00:19:05.713 | 99.00th=[ 255], 99.50th=[ 258], 99.90th=[ 285], 99.95th=[ 293], 00:19:05.713 | 99.99th=[ 3326] 00:19:05.713 bw ( KiB/s): min= 8192, max= 8192, per=40.96%, avg=8192.00, stdev= 0.00, samples=1 00:19:05.713 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:05.713 lat (usec) : 250=65.25%, 500=34.73% 00:19:05.713 lat (msec) : 4=0.03% 00:19:05.713 cpu : usr=4.90%, sys=7.50%, ctx=3988, majf=0, minf=1 00:19:05.713 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:05.713 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.713 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.713 issued rwts: total=1940,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.713 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:05.713 00:19:05.713 Run status group 0 (all jobs): 00:19:05.713 READ: bw=13.5MiB/s (14.1MB/s), 94.9KiB/s-7752KiB/s (97.1kB/s-7938kB/s), io=13.8MiB (14.5MB), run=1001-1024msec 00:19:05.713 WRITE: bw=19.5MiB/s (20.5MB/s), 2024KiB/s-8184KiB/s (2072kB/s-8380kB/s), io=20.0MiB (21.0MB), run=1001-1024msec 00:19:05.713 00:19:05.713 Disk stats (read/write): 00:19:05.713 nvme0n1: ios=540/1024, merge=0/0, ticks=1456/178, in_queue=1634, util=85.27% 00:19:05.713 nvme0n2: ios=1088/1536, merge=0/0, ticks=564/264, in_queue=828, util=90.74% 00:19:05.713 nvme0n3: ios=42/512, merge=0/0, ticks=1661/84, in_queue=1745, util=93.61% 00:19:05.713 nvme0n4: ios=1593/1924, merge=0/0, ticks=457/363, in_queue=820, util=95.67% 00:19:05.713 04:30:44 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:05.713 [global] 00:19:05.713 thread=1 00:19:05.713 invalidate=1 00:19:05.713 rw=randwrite 00:19:05.713 time_based=1 00:19:05.713 runtime=1 00:19:05.713 ioengine=libaio 00:19:05.713 direct=1 00:19:05.713 bs=4096 00:19:05.713 iodepth=1 00:19:05.713 norandommap=0 00:19:05.713 numjobs=1 00:19:05.713 00:19:05.713 verify_dump=1 00:19:05.713 verify_backlog=512 00:19:05.713 verify_state_save=0 00:19:05.713 do_verify=1 00:19:05.713 verify=crc32c-intel 00:19:05.713 [job0] 00:19:05.713 filename=/dev/nvme0n1 00:19:05.713 [job1] 00:19:05.713 filename=/dev/nvme0n2 00:19:05.713 [job2] 00:19:05.713 filename=/dev/nvme0n3 00:19:05.713 [job3] 00:19:05.713 filename=/dev/nvme0n4 00:19:05.713 Could not set queue depth (nvme0n1) 00:19:05.713 Could not set queue depth (nvme0n2) 00:19:05.713 Could not set queue depth (nvme0n3) 00:19:05.713 Could not set queue depth (nvme0n4) 00:19:05.713 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:05.713 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:05.713 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:05.713 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:05.713 fio-3.35 00:19:05.713 Starting 4 threads 00:19:07.092 00:19:07.092 job0: (groupid=0, jobs=1): err= 0: pid=2930150: Tue Nov 26 04:30:46 2024 00:19:07.092 read: IOPS=22, BW=88.5KiB/s (90.6kB/s)(92.0KiB/1040msec) 00:19:07.092 slat (nsec): min=13301, max=34322, avg=25597.09, stdev=9191.97 00:19:07.092 clat (usec): min=40673, max=42046, avg=41347.56, stdev=520.55 00:19:07.092 lat (usec): min=40695, max=42064, avg=41373.15, stdev=520.03 00:19:07.092 clat percentiles (usec): 00:19:07.092 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:07.092 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:07.092 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:07.092 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:07.092 | 99.99th=[42206] 00:19:07.092 write: IOPS=492, BW=1969KiB/s (2016kB/s)(2048KiB/1040msec); 0 zone resets 00:19:07.092 slat (nsec): min=5733, max=53888, avg=7284.12, stdev=3095.23 00:19:07.092 clat (usec): min=135, max=222, avg=162.20, stdev=13.10 00:19:07.092 lat (usec): min=141, max=249, avg=169.48, stdev=13.72 00:19:07.092 clat percentiles (usec): 00:19:07.092 | 1.00th=[ 139], 5.00th=[ 145], 10.00th=[ 147], 20.00th=[ 151], 00:19:07.092 | 30.00th=[ 155], 40.00th=[ 157], 50.00th=[ 161], 60.00th=[ 163], 00:19:07.092 | 70.00th=[ 167], 80.00th=[ 174], 90.00th=[ 180], 95.00th=[ 188], 00:19:07.092 | 99.00th=[ 198], 99.50th=[ 206], 99.90th=[ 223], 99.95th=[ 223], 00:19:07.092 | 99.99th=[ 223] 00:19:07.092 bw ( KiB/s): min= 4087, max= 4087, per=51.89%, avg=4087.00, stdev= 0.00, samples=1 00:19:07.092 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:19:07.092 lat (usec) : 250=95.70% 00:19:07.092 lat (msec) : 50=4.30% 00:19:07.092 cpu : usr=0.19%, sys=0.38%, ctx=535, majf=0, minf=1 00:19:07.092 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:07.092 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:07.092 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:07.092 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:07.093 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:07.093 job1: (groupid=0, jobs=1): err= 0: pid=2930151: Tue Nov 26 04:30:46 2024 00:19:07.093 read: IOPS=38, BW=154KiB/s (158kB/s)(160KiB/1040msec) 00:19:07.093 slat (nsec): min=5889, max=35276, avg=24257.33, stdev=10084.59 00:19:07.093 clat (usec): min=288, max=41962, avg=22793.95, stdev=20584.31 00:19:07.093 lat (usec): min=306, max=41976, avg=22818.20, stdev=20580.15 00:19:07.093 clat percentiles (usec): 00:19:07.093 | 1.00th=[ 289], 5.00th=[ 289], 10.00th=[ 297], 20.00th=[ 314], 00:19:07.093 | 30.00th=[ 351], 40.00th=[ 359], 50.00th=[40633], 60.00th=[40633], 00:19:07.093 | 70.00th=[41157], 80.00th=[41681], 90.00th=[41681], 95.00th=[41681], 00:19:07.093 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:07.093 | 99.99th=[42206] 00:19:07.093 write: IOPS=492, BW=1969KiB/s (2016kB/s)(2048KiB/1040msec); 0 zone resets 00:19:07.093 slat (nsec): min=6684, max=26849, avg=8270.48, stdev=2350.48 00:19:07.093 clat (usec): min=167, max=345, avg=232.30, stdev=21.90 00:19:07.093 lat (usec): min=183, max=353, avg=240.57, stdev=21.82 00:19:07.093 clat percentiles (usec): 00:19:07.093 | 1.00th=[ 190], 5.00th=[ 198], 10.00th=[ 206], 20.00th=[ 217], 00:19:07.093 | 30.00th=[ 223], 40.00th=[ 227], 50.00th=[ 231], 60.00th=[ 237], 00:19:07.093 | 70.00th=[ 241], 80.00th=[ 247], 90.00th=[ 258], 95.00th=[ 265], 00:19:07.093 | 99.00th=[ 306], 99.50th=[ 318], 99.90th=[ 347], 99.95th=[ 347], 00:19:07.093 | 99.99th=[ 347] 00:19:07.093 bw ( KiB/s): min= 4087, max= 4087, per=51.89%, avg=4087.00, stdev= 0.00, samples=1 00:19:07.093 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:19:07.093 lat (usec) : 250=78.08%, 500=17.93% 00:19:07.093 lat (msec) : 50=3.99% 00:19:07.093 cpu : usr=0.19%, sys=0.48%, ctx=554, majf=0, minf=1 00:19:07.093 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:07.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:07.093 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:07.093 issued rwts: total=40,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:07.093 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:07.093 job2: (groupid=0, jobs=1): err= 0: pid=2930152: Tue Nov 26 04:30:46 2024 00:19:07.093 read: IOPS=20, BW=81.9KiB/s (83.8kB/s)(84.0KiB/1026msec) 00:19:07.093 slat (nsec): min=7112, max=36689, avg=27704.81, stdev=11124.58 00:19:07.093 clat (usec): min=40609, max=42014, avg=41327.88, stdev=515.86 00:19:07.093 lat (usec): min=40616, max=42031, avg=41355.58, stdev=519.22 00:19:07.093 clat percentiles (usec): 00:19:07.093 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:07.093 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:07.093 | 70.00th=[41681], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:07.093 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:07.093 | 99.99th=[42206] 00:19:07.093 write: IOPS=499, BW=1996KiB/s (2044kB/s)(2048KiB/1026msec); 0 zone resets 00:19:07.093 slat (nsec): min=7564, max=41754, avg=12299.52, stdev=5141.25 00:19:07.093 clat (usec): min=146, max=484, avg=286.64, stdev=98.20 00:19:07.093 lat (usec): min=154, max=508, avg=298.94, stdev=100.74 00:19:07.093 clat percentiles (usec): 00:19:07.093 | 1.00th=[ 151], 5.00th=[ 155], 10.00th=[ 159], 20.00th=[ 165], 00:19:07.093 | 30.00th=[ 182], 40.00th=[ 281], 50.00th=[ 302], 60.00th=[ 322], 00:19:07.093 | 70.00th=[ 351], 80.00th=[ 396], 90.00th=[ 408], 95.00th=[ 420], 00:19:07.093 | 99.00th=[ 469], 99.50th=[ 478], 99.90th=[ 486], 99.95th=[ 486], 00:19:07.093 | 99.99th=[ 486] 00:19:07.093 bw ( KiB/s): min= 4087, max= 4087, per=51.89%, avg=4087.00, stdev= 0.00, samples=1 00:19:07.093 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:19:07.093 lat (usec) : 250=33.40%, 500=62.66% 00:19:07.093 lat (msec) : 50=3.94% 00:19:07.093 cpu : usr=0.49%, sys=0.78%, ctx=534, majf=0, minf=1 00:19:07.093 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:07.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:07.093 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:07.093 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:07.093 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:07.093 job3: (groupid=0, jobs=1): err= 0: pid=2930153: Tue Nov 26 04:30:46 2024 00:19:07.093 read: IOPS=24, BW=96.2KiB/s (98.5kB/s)(100KiB/1040msec) 00:19:07.093 slat (nsec): min=6768, max=35767, avg=25615.56, stdev=10449.47 00:19:07.093 clat (usec): min=324, max=42056, avg=36475.57, stdev=13628.40 00:19:07.093 lat (usec): min=343, max=42075, avg=36501.19, stdev=13632.99 00:19:07.093 clat percentiles (usec): 00:19:07.093 | 1.00th=[ 326], 5.00th=[ 338], 10.00th=[ 355], 20.00th=[40633], 00:19:07.093 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:07.093 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:07.093 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:07.093 | 99.99th=[42206] 00:19:07.093 write: IOPS=492, BW=1969KiB/s (2016kB/s)(2048KiB/1040msec); 0 zone resets 00:19:07.093 slat (nsec): min=6435, max=29820, avg=8390.57, stdev=3108.68 00:19:07.093 clat (usec): min=166, max=451, avg=232.99, stdev=27.49 00:19:07.093 lat (usec): min=183, max=477, avg=241.38, stdev=27.26 00:19:07.093 clat percentiles (usec): 00:19:07.093 | 1.00th=[ 178], 5.00th=[ 198], 10.00th=[ 204], 20.00th=[ 217], 00:19:07.093 | 30.00th=[ 221], 40.00th=[ 227], 50.00th=[ 231], 60.00th=[ 235], 00:19:07.093 | 70.00th=[ 241], 80.00th=[ 249], 90.00th=[ 260], 95.00th=[ 273], 00:19:07.093 | 99.00th=[ 359], 99.50th=[ 379], 99.90th=[ 453], 99.95th=[ 453], 00:19:07.093 | 99.99th=[ 453] 00:19:07.093 bw ( KiB/s): min= 4087, max= 4087, per=51.89%, avg=4087.00, stdev= 0.00, samples=1 00:19:07.093 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:19:07.093 lat (usec) : 250=78.96%, 500=16.95% 00:19:07.093 lat (msec) : 50=4.10% 00:19:07.093 cpu : usr=0.10%, sys=0.48%, ctx=538, majf=0, minf=1 00:19:07.093 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:07.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:07.093 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:07.093 issued rwts: total=25,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:07.093 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:07.093 00:19:07.093 Run status group 0 (all jobs): 00:19:07.093 READ: bw=419KiB/s (429kB/s), 81.9KiB/s-154KiB/s (83.8kB/s-158kB/s), io=436KiB (446kB), run=1026-1040msec 00:19:07.093 WRITE: bw=7877KiB/s (8066kB/s), 1969KiB/s-1996KiB/s (2016kB/s-2044kB/s), io=8192KiB (8389kB), run=1026-1040msec 00:19:07.093 00:19:07.093 Disk stats (read/write): 00:19:07.093 nvme0n1: ios=68/512, merge=0/0, ticks=1018/79, in_queue=1097, util=95.29% 00:19:07.093 nvme0n2: ios=72/512, merge=0/0, ticks=1211/110, in_queue=1321, util=99.70% 00:19:07.093 nvme0n3: ios=42/512, merge=0/0, ticks=1655/138, in_queue=1793, util=98.13% 00:19:07.093 nvme0n4: ios=66/512, merge=0/0, ticks=1631/114, in_queue=1745, util=99.27% 00:19:07.093 04:30:46 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:07.093 [global] 00:19:07.093 thread=1 00:19:07.093 invalidate=1 00:19:07.093 rw=write 00:19:07.093 time_based=1 00:19:07.093 runtime=1 00:19:07.093 ioengine=libaio 00:19:07.093 direct=1 00:19:07.093 bs=4096 00:19:07.093 iodepth=128 00:19:07.093 norandommap=0 00:19:07.093 numjobs=1 00:19:07.093 00:19:07.093 verify_dump=1 00:19:07.093 verify_backlog=512 00:19:07.093 verify_state_save=0 00:19:07.093 do_verify=1 00:19:07.093 verify=crc32c-intel 00:19:07.093 [job0] 00:19:07.093 filename=/dev/nvme0n1 00:19:07.093 [job1] 00:19:07.093 filename=/dev/nvme0n2 00:19:07.093 [job2] 00:19:07.093 filename=/dev/nvme0n3 00:19:07.093 [job3] 00:19:07.093 filename=/dev/nvme0n4 00:19:07.093 Could not set queue depth (nvme0n1) 00:19:07.093 Could not set queue depth (nvme0n2) 00:19:07.093 Could not set queue depth (nvme0n3) 00:19:07.093 Could not set queue depth (nvme0n4) 00:19:07.354 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:07.354 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:07.354 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:07.354 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:07.354 fio-3.35 00:19:07.354 Starting 4 threads 00:19:08.731 00:19:08.731 job0: (groupid=0, jobs=1): err= 0: pid=2930388: Tue Nov 26 04:30:47 2024 00:19:08.731 read: IOPS=3020, BW=11.8MiB/s (12.4MB/s)(12.0MiB/1017msec) 00:19:08.731 slat (usec): min=2, max=20429, avg=165.73, stdev=1270.15 00:19:08.731 clat (usec): min=5912, max=68512, avg=20027.33, stdev=12592.02 00:19:08.731 lat (usec): min=5921, max=68530, avg=20193.06, stdev=12691.28 00:19:08.732 clat percentiles (usec): 00:19:08.732 | 1.00th=[ 6194], 5.00th=[ 9503], 10.00th=[ 9765], 20.00th=[10945], 00:19:08.732 | 30.00th=[11469], 40.00th=[12518], 50.00th=[14746], 60.00th=[20317], 00:19:08.732 | 70.00th=[22676], 80.00th=[24773], 90.00th=[37487], 95.00th=[49021], 00:19:08.732 | 99.00th=[63177], 99.50th=[65799], 99.90th=[68682], 99.95th=[68682], 00:19:08.732 | 99.99th=[68682] 00:19:08.732 write: IOPS=3459, BW=13.5MiB/s (14.2MB/s)(13.7MiB/1017msec); 0 zone resets 00:19:08.732 slat (usec): min=4, max=15436, avg=129.27, stdev=700.84 00:19:08.732 clat (usec): min=1304, max=68525, avg=19172.63, stdev=8498.02 00:19:08.732 lat (usec): min=1314, max=68555, avg=19301.91, stdev=8552.78 00:19:08.732 clat percentiles (usec): 00:19:08.732 | 1.00th=[ 5800], 5.00th=[ 8094], 10.00th=[10159], 20.00th=[11076], 00:19:08.732 | 30.00th=[11731], 40.00th=[16450], 50.00th=[20317], 60.00th=[23462], 00:19:08.732 | 70.00th=[24249], 80.00th=[25035], 90.00th=[26608], 95.00th=[34341], 00:19:08.732 | 99.00th=[44303], 99.50th=[44827], 99.90th=[63177], 99.95th=[68682], 00:19:08.732 | 99.99th=[68682] 00:19:08.732 bw ( KiB/s): min=11928, max=15200, per=19.22%, avg=13564.00, stdev=2313.65, samples=2 00:19:08.732 iops : min= 2982, max= 3800, avg=3391.00, stdev=578.41, samples=2 00:19:08.732 lat (msec) : 2=0.06%, 4=0.09%, 10=10.26%, 20=43.78%, 50=43.40% 00:19:08.732 lat (msec) : 100=2.41% 00:19:08.732 cpu : usr=4.43%, sys=7.09%, ctx=307, majf=0, minf=1 00:19:08.732 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:19:08.732 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.732 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:08.732 issued rwts: total=3072,3518,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.732 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:08.732 job1: (groupid=0, jobs=1): err= 0: pid=2930389: Tue Nov 26 04:30:47 2024 00:19:08.732 read: IOPS=6119, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1004msec) 00:19:08.732 slat (usec): min=2, max=9659, avg=83.76, stdev=589.91 00:19:08.732 clat (usec): min=3691, max=19995, avg=10492.02, stdev=2787.06 00:19:08.732 lat (usec): min=3697, max=22256, avg=10575.78, stdev=2823.60 00:19:08.732 clat percentiles (usec): 00:19:08.732 | 1.00th=[ 4490], 5.00th=[ 7373], 10.00th=[ 8094], 20.00th=[ 8848], 00:19:08.732 | 30.00th=[ 9110], 40.00th=[ 9241], 50.00th=[ 9634], 60.00th=[ 9765], 00:19:08.732 | 70.00th=[11076], 80.00th=[12387], 90.00th=[14615], 95.00th=[16909], 00:19:08.732 | 99.00th=[18744], 99.50th=[19268], 99.90th=[19792], 99.95th=[20055], 00:19:08.732 | 99.99th=[20055] 00:19:08.732 write: IOPS=6427, BW=25.1MiB/s (26.3MB/s)(25.2MiB/1004msec); 0 zone resets 00:19:08.732 slat (usec): min=3, max=9182, avg=69.20, stdev=394.08 00:19:08.732 clat (usec): min=1579, max=19993, avg=9660.50, stdev=2156.97 00:19:08.732 lat (usec): min=2476, max=19999, avg=9729.69, stdev=2187.10 00:19:08.732 clat percentiles (usec): 00:19:08.732 | 1.00th=[ 3326], 5.00th=[ 4817], 10.00th=[ 6259], 20.00th=[ 8455], 00:19:08.732 | 30.00th=[ 9765], 40.00th=[10159], 50.00th=[10421], 60.00th=[10552], 00:19:08.732 | 70.00th=[10683], 80.00th=[10814], 90.00th=[11207], 95.00th=[11469], 00:19:08.732 | 99.00th=[15270], 99.50th=[15401], 99.90th=[19268], 99.95th=[19792], 00:19:08.732 | 99.99th=[20055] 00:19:08.732 bw ( KiB/s): min=24720, max=25880, per=35.85%, avg=25300.00, stdev=820.24, samples=2 00:19:08.732 iops : min= 6180, max= 6470, avg=6325.00, stdev=205.06, samples=2 00:19:08.732 lat (msec) : 2=0.01%, 4=1.85%, 10=48.09%, 20=50.05% 00:19:08.732 cpu : usr=5.98%, sys=6.88%, ctx=700, majf=0, minf=1 00:19:08.732 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:08.732 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.732 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:08.732 issued rwts: total=6144,6453,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.732 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:08.732 job2: (groupid=0, jobs=1): err= 0: pid=2930390: Tue Nov 26 04:30:47 2024 00:19:08.732 read: IOPS=2013, BW=8055KiB/s (8248kB/s)(8192KiB/1017msec) 00:19:08.732 slat (usec): min=2, max=26326, avg=184.02, stdev=1420.71 00:19:08.732 clat (usec): min=5362, max=70012, avg=24089.35, stdev=10294.52 00:19:08.732 lat (usec): min=5371, max=70021, avg=24273.36, stdev=10363.57 00:19:08.732 clat percentiles (usec): 00:19:08.732 | 1.00th=[12256], 5.00th=[13173], 10.00th=[13566], 20.00th=[14353], 00:19:08.732 | 30.00th=[18220], 40.00th=[21365], 50.00th=[22152], 60.00th=[22414], 00:19:08.732 | 70.00th=[29230], 80.00th=[30278], 90.00th=[39584], 95.00th=[43779], 00:19:08.732 | 99.00th=[60556], 99.50th=[60556], 99.90th=[60556], 99.95th=[60556], 00:19:08.732 | 99.99th=[69731] 00:19:08.732 write: IOPS=2492, BW=9971KiB/s (10.2MB/s)(9.90MiB/1017msec); 0 zone resets 00:19:08.732 slat (usec): min=3, max=67327, avg=225.57, stdev=1901.85 00:19:08.732 clat (msec): min=4, max=101, avg=25.87, stdev= 7.89 00:19:08.732 lat (msec): min=4, max=145, avg=26.09, stdev= 8.27 00:19:08.732 clat percentiles (msec): 00:19:08.732 | 1.00th=[ 8], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 21], 00:19:08.732 | 30.00th=[ 24], 40.00th=[ 24], 50.00th=[ 25], 60.00th=[ 26], 00:19:08.732 | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 36], 95.00th=[ 41], 00:19:08.732 | 99.00th=[ 52], 99.50th=[ 52], 99.90th=[ 57], 99.95th=[ 57], 00:19:08.732 | 99.99th=[ 102] 00:19:08.732 bw ( KiB/s): min= 8192, max=11072, per=13.65%, avg=9632.00, stdev=2036.47, samples=2 00:19:08.732 iops : min= 2048, max= 2768, avg=2408.00, stdev=509.12, samples=2 00:19:08.732 lat (msec) : 10=1.61%, 20=21.71%, 50=74.62%, 100=2.03%, 250=0.02% 00:19:08.732 cpu : usr=2.66%, sys=3.64%, ctx=281, majf=0, minf=1 00:19:08.732 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:19:08.732 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.732 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:08.732 issued rwts: total=2048,2535,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.732 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:08.732 job3: (groupid=0, jobs=1): err= 0: pid=2930391: Tue Nov 26 04:30:47 2024 00:19:08.732 read: IOPS=5084, BW=19.9MiB/s (20.8MB/s)(20.0MiB/1007msec) 00:19:08.732 slat (usec): min=2, max=11119, avg=90.34, stdev=477.35 00:19:08.732 clat (usec): min=878, max=25186, avg=12103.01, stdev=1967.54 00:19:08.732 lat (usec): min=897, max=25205, avg=12193.35, stdev=2006.56 00:19:08.732 clat percentiles (usec): 00:19:08.732 | 1.00th=[ 1778], 5.00th=[ 9896], 10.00th=[10814], 20.00th=[11731], 00:19:08.732 | 30.00th=[11863], 40.00th=[11994], 50.00th=[12125], 60.00th=[12387], 00:19:08.732 | 70.00th=[12518], 80.00th=[12780], 90.00th=[13173], 95.00th=[13960], 00:19:08.732 | 99.00th=[19006], 99.50th=[20055], 99.90th=[25035], 99.95th=[25035], 00:19:08.732 | 99.99th=[25297] 00:19:08.732 write: IOPS=5401, BW=21.1MiB/s (22.1MB/s)(21.2MiB/1007msec); 0 zone resets 00:19:08.732 slat (usec): min=4, max=11092, avg=86.04, stdev=504.28 00:19:08.732 clat (usec): min=457, max=24763, avg=12034.38, stdev=2054.17 00:19:08.732 lat (usec): min=468, max=25155, avg=12120.42, stdev=2064.46 00:19:08.732 clat percentiles (usec): 00:19:08.732 | 1.00th=[ 3982], 5.00th=[ 8586], 10.00th=[ 9503], 20.00th=[11731], 00:19:08.732 | 30.00th=[12125], 40.00th=[12387], 50.00th=[12518], 60.00th=[12518], 00:19:08.732 | 70.00th=[12649], 80.00th=[13042], 90.00th=[13566], 95.00th=[13960], 00:19:08.732 | 99.00th=[15664], 99.50th=[15926], 99.90th=[17695], 99.95th=[21890], 00:19:08.732 | 99.99th=[24773] 00:19:08.732 bw ( KiB/s): min=20480, max=22008, per=30.10%, avg=21244.00, stdev=1080.46, samples=2 00:19:08.732 iops : min= 5120, max= 5502, avg=5311.00, stdev=270.11, samples=2 00:19:08.732 lat (usec) : 500=0.03%, 1000=0.09% 00:19:08.732 lat (msec) : 2=0.61%, 4=0.64%, 10=8.17%, 20=90.22%, 50=0.25% 00:19:08.732 cpu : usr=6.66%, sys=12.33%, ctx=481, majf=0, minf=1 00:19:08.732 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:08.732 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.732 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:08.732 issued rwts: total=5120,5439,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.732 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:08.732 00:19:08.732 Run status group 0 (all jobs): 00:19:08.732 READ: bw=62.9MiB/s (66.0MB/s), 8055KiB/s-23.9MiB/s (8248kB/s-25.1MB/s), io=64.0MiB (67.1MB), run=1004-1017msec 00:19:08.732 WRITE: bw=68.9MiB/s (72.3MB/s), 9971KiB/s-25.1MiB/s (10.2MB/s-26.3MB/s), io=70.1MiB (73.5MB), run=1004-1017msec 00:19:08.732 00:19:08.732 Disk stats (read/write): 00:19:08.732 nvme0n1: ios=2602/3031, merge=0/0, ticks=48055/54275, in_queue=102330, util=86.77% 00:19:08.732 nvme0n2: ios=5170/5550, merge=0/0, ticks=52009/51628, in_queue=103637, util=91.17% 00:19:08.732 nvme0n3: ios=1596/2048, merge=0/0, ticks=38970/51531, in_queue=90501, util=95.42% 00:19:08.732 nvme0n4: ios=4294/4608, merge=0/0, ticks=17308/18153, in_queue=35461, util=94.33% 00:19:08.732 04:30:47 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:08.732 [global] 00:19:08.732 thread=1 00:19:08.732 invalidate=1 00:19:08.732 rw=randwrite 00:19:08.732 time_based=1 00:19:08.732 runtime=1 00:19:08.732 ioengine=libaio 00:19:08.732 direct=1 00:19:08.732 bs=4096 00:19:08.732 iodepth=128 00:19:08.732 norandommap=0 00:19:08.732 numjobs=1 00:19:08.732 00:19:08.732 verify_dump=1 00:19:08.732 verify_backlog=512 00:19:08.732 verify_state_save=0 00:19:08.732 do_verify=1 00:19:08.732 verify=crc32c-intel 00:19:08.732 [job0] 00:19:08.732 filename=/dev/nvme0n1 00:19:08.732 [job1] 00:19:08.732 filename=/dev/nvme0n2 00:19:08.732 [job2] 00:19:08.732 filename=/dev/nvme0n3 00:19:08.732 [job3] 00:19:08.732 filename=/dev/nvme0n4 00:19:08.732 Could not set queue depth (nvme0n1) 00:19:08.732 Could not set queue depth (nvme0n2) 00:19:08.732 Could not set queue depth (nvme0n3) 00:19:08.732 Could not set queue depth (nvme0n4) 00:19:08.732 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:08.732 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:08.732 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:08.732 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:08.732 fio-3.35 00:19:08.732 Starting 4 threads 00:19:10.109 00:19:10.109 job0: (groupid=0, jobs=1): err= 0: pid=2930743: Tue Nov 26 04:30:49 2024 00:19:10.109 read: IOPS=5626, BW=22.0MiB/s (23.0MB/s)(22.0MiB/1001msec) 00:19:10.109 slat (usec): min=3, max=5309, avg=82.22, stdev=483.56 00:19:10.109 clat (usec): min=5997, max=17525, avg=10749.11, stdev=1279.51 00:19:10.109 lat (usec): min=6011, max=17540, avg=10831.33, stdev=1336.49 00:19:10.109 clat percentiles (usec): 00:19:10.109 | 1.00th=[ 7373], 5.00th=[ 8717], 10.00th=[ 9503], 20.00th=[10159], 00:19:10.109 | 30.00th=[10290], 40.00th=[10552], 50.00th=[10683], 60.00th=[10814], 00:19:10.109 | 70.00th=[10945], 80.00th=[11338], 90.00th=[12256], 95.00th=[13304], 00:19:10.109 | 99.00th=[15008], 99.50th=[15270], 99.90th=[16319], 99.95th=[16319], 00:19:10.109 | 99.99th=[17433] 00:19:10.109 write: IOPS=5690, BW=22.2MiB/s (23.3MB/s)(22.2MiB/1001msec); 0 zone resets 00:19:10.109 slat (usec): min=4, max=24990, avg=84.83, stdev=542.86 00:19:10.109 clat (usec): min=246, max=36555, avg=11594.25, stdev=3711.17 00:19:10.109 lat (usec): min=4281, max=37110, avg=11679.08, stdev=3729.05 00:19:10.109 clat percentiles (usec): 00:19:10.109 | 1.00th=[ 5800], 5.00th=[ 8717], 10.00th=[10159], 20.00th=[10552], 00:19:10.109 | 30.00th=[10683], 40.00th=[10945], 50.00th=[11207], 60.00th=[11338], 00:19:10.109 | 70.00th=[11600], 80.00th=[11863], 90.00th=[12256], 95.00th=[13829], 00:19:10.109 | 99.00th=[34866], 99.50th=[35914], 99.90th=[36439], 99.95th=[36439], 00:19:10.109 | 99.99th=[36439] 00:19:10.109 bw ( KiB/s): min=22776, max=22776, per=33.16%, avg=22776.00, stdev= 0.00, samples=1 00:19:10.109 iops : min= 5694, max= 5694, avg=5694.00, stdev= 0.00, samples=1 00:19:10.109 lat (usec) : 250=0.01% 00:19:10.109 lat (msec) : 10=13.59%, 20=85.28%, 50=1.12% 00:19:10.109 cpu : usr=7.10%, sys=9.80%, ctx=506, majf=0, minf=1 00:19:10.109 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:10.109 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.109 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:10.109 issued rwts: total=5632,5696,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:10.109 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:10.109 job1: (groupid=0, jobs=1): err= 0: pid=2930744: Tue Nov 26 04:30:49 2024 00:19:10.109 read: IOPS=3938, BW=15.4MiB/s (16.1MB/s)(15.5MiB/1006msec) 00:19:10.109 slat (usec): min=2, max=10849, avg=108.08, stdev=713.26 00:19:10.109 clat (usec): min=3628, max=31657, avg=13417.81, stdev=4187.68 00:19:10.109 lat (usec): min=5237, max=31663, avg=13525.89, stdev=4233.15 00:19:10.109 clat percentiles (usec): 00:19:10.109 | 1.00th=[ 7898], 5.00th=[ 8586], 10.00th=[10159], 20.00th=[10552], 00:19:10.109 | 30.00th=[11076], 40.00th=[11338], 50.00th=[12649], 60.00th=[13304], 00:19:10.109 | 70.00th=[13829], 80.00th=[15401], 90.00th=[18744], 95.00th=[22938], 00:19:10.109 | 99.00th=[29754], 99.50th=[30802], 99.90th=[31589], 99.95th=[31589], 00:19:10.109 | 99.99th=[31589] 00:19:10.109 write: IOPS=4071, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1006msec); 0 zone resets 00:19:10.109 slat (usec): min=4, max=12937, avg=130.76, stdev=711.18 00:19:10.109 clat (usec): min=2864, max=48699, avg=18146.57, stdev=9291.50 00:19:10.109 lat (usec): min=2870, max=48724, avg=18277.33, stdev=9360.72 00:19:10.109 clat percentiles (usec): 00:19:10.109 | 1.00th=[ 3785], 5.00th=[ 7570], 10.00th=[ 8979], 20.00th=[10290], 00:19:10.109 | 30.00th=[10683], 40.00th=[11994], 50.00th=[14615], 60.00th=[22152], 00:19:10.109 | 70.00th=[23200], 80.00th=[26346], 90.00th=[30278], 95.00th=[35390], 00:19:10.109 | 99.00th=[43254], 99.50th=[44827], 99.90th=[48497], 99.95th=[48497], 00:19:10.109 | 99.99th=[48497] 00:19:10.109 bw ( KiB/s): min=16384, max=16384, per=23.85%, avg=16384.00, stdev= 0.00, samples=2 00:19:10.109 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:19:10.109 lat (msec) : 4=0.52%, 10=10.61%, 20=63.40%, 50=25.47% 00:19:10.109 cpu : usr=4.98%, sys=6.47%, ctx=392, majf=0, minf=1 00:19:10.109 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:10.109 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.109 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:10.109 issued rwts: total=3962,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:10.109 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:10.109 job2: (groupid=0, jobs=1): err= 0: pid=2930745: Tue Nov 26 04:30:49 2024 00:19:10.109 read: IOPS=2031, BW=8127KiB/s (8322kB/s)(8192KiB/1008msec) 00:19:10.109 slat (usec): min=2, max=20482, avg=196.70, stdev=1208.32 00:19:10.109 clat (usec): min=10209, max=93944, avg=20923.16, stdev=10928.91 00:19:10.109 lat (usec): min=10218, max=93957, avg=21119.86, stdev=11112.32 00:19:10.109 clat percentiles (usec): 00:19:10.109 | 1.00th=[12387], 5.00th=[14615], 10.00th=[15008], 20.00th=[15270], 00:19:10.109 | 30.00th=[16909], 40.00th=[17171], 50.00th=[17957], 60.00th=[18744], 00:19:10.109 | 70.00th=[19006], 80.00th=[20055], 90.00th=[29230], 95.00th=[44303], 00:19:10.109 | 99.00th=[67634], 99.50th=[74974], 99.90th=[84411], 99.95th=[84411], 00:19:10.109 | 99.99th=[93848] 00:19:10.109 write: IOPS=2379, BW=9520KiB/s (9748kB/s)(9596KiB/1008msec); 0 zone resets 00:19:10.109 slat (usec): min=3, max=24484, avg=244.42, stdev=1259.66 00:19:10.109 clat (msec): min=4, max=118, avg=34.89, stdev=24.32 00:19:10.109 lat (msec): min=9, max=118, avg=35.14, stdev=24.45 00:19:10.109 clat percentiles (msec): 00:19:10.109 | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 14], 20.00th=[ 17], 00:19:10.109 | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 23], 60.00th=[ 34], 00:19:10.109 | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 64], 95.00th=[ 96], 00:19:10.109 | 99.00th=[ 112], 99.50th=[ 117], 99.90th=[ 118], 99.95th=[ 118], 00:19:10.109 | 99.99th=[ 118] 00:19:10.109 bw ( KiB/s): min= 8040, max=10128, per=13.22%, avg=9084.00, stdev=1476.44, samples=2 00:19:10.109 iops : min= 2010, max= 2532, avg=2271.00, stdev=369.11, samples=2 00:19:10.109 lat (msec) : 10=0.58%, 20=52.60%, 50=33.87%, 100=11.24%, 250=1.71% 00:19:10.109 cpu : usr=1.69%, sys=2.58%, ctx=308, majf=0, minf=1 00:19:10.109 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:10.109 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.109 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:10.109 issued rwts: total=2048,2399,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:10.109 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:10.109 job3: (groupid=0, jobs=1): err= 0: pid=2930746: Tue Nov 26 04:30:49 2024 00:19:10.109 read: IOPS=4941, BW=19.3MiB/s (20.2MB/s)(19.4MiB/1004msec) 00:19:10.109 slat (usec): min=2, max=8719, avg=97.36, stdev=509.00 00:19:10.109 clat (usec): min=493, max=22041, avg=12621.12, stdev=1748.51 00:19:10.109 lat (usec): min=3083, max=22053, avg=12718.48, stdev=1740.02 00:19:10.109 clat percentiles (usec): 00:19:10.109 | 1.00th=[ 4752], 5.00th=[ 9765], 10.00th=[10945], 20.00th=[11469], 00:19:10.109 | 30.00th=[12387], 40.00th=[12649], 50.00th=[12911], 60.00th=[13173], 00:19:10.109 | 70.00th=[13435], 80.00th=[13698], 90.00th=[14222], 95.00th=[14877], 00:19:10.109 | 99.00th=[15795], 99.50th=[16319], 99.90th=[17433], 99.95th=[17695], 00:19:10.109 | 99.99th=[22152] 00:19:10.109 write: IOPS=5099, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1004msec); 0 zone resets 00:19:10.109 slat (usec): min=3, max=5856, avg=86.94, stdev=438.35 00:19:10.109 clat (usec): min=3743, max=42575, avg=12581.58, stdev=2833.99 00:19:10.109 lat (usec): min=3749, max=42582, avg=12668.52, stdev=2833.35 00:19:10.109 clat percentiles (usec): 00:19:10.109 | 1.00th=[ 6325], 5.00th=[ 9765], 10.00th=[10421], 20.00th=[10945], 00:19:10.109 | 30.00th=[11731], 40.00th=[12387], 50.00th=[12911], 60.00th=[13042], 00:19:10.109 | 70.00th=[13304], 80.00th=[13566], 90.00th=[14222], 95.00th=[14877], 00:19:10.109 | 99.00th=[18220], 99.50th=[32900], 99.90th=[42730], 99.95th=[42730], 00:19:10.109 | 99.99th=[42730] 00:19:10.109 bw ( KiB/s): min=20480, max=20480, per=29.81%, avg=20480.00, stdev= 0.00, samples=2 00:19:10.109 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=2 00:19:10.109 lat (usec) : 500=0.01% 00:19:10.109 lat (msec) : 4=0.64%, 10=5.66%, 20=93.27%, 50=0.41% 00:19:10.109 cpu : usr=6.48%, sys=7.88%, ctx=511, majf=0, minf=1 00:19:10.109 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:10.109 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:10.109 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:10.109 issued rwts: total=4961,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:10.109 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:10.109 00:19:10.109 Run status group 0 (all jobs): 00:19:10.109 READ: bw=64.3MiB/s (67.5MB/s), 8127KiB/s-22.0MiB/s (8322kB/s-23.0MB/s), io=64.9MiB (68.0MB), run=1001-1008msec 00:19:10.109 WRITE: bw=67.1MiB/s (70.3MB/s), 9520KiB/s-22.2MiB/s (9748kB/s-23.3MB/s), io=67.6MiB (70.9MB), run=1001-1008msec 00:19:10.109 00:19:10.109 Disk stats (read/write): 00:19:10.109 nvme0n1: ios=4653/4983, merge=0/0, ticks=24818/25338, in_queue=50156, util=98.80% 00:19:10.109 nvme0n2: ios=3622/3623, merge=0/0, ticks=45151/55863, in_queue=101014, util=97.97% 00:19:10.109 nvme0n3: ios=1536/1927, merge=0/0, ticks=13016/22309, in_queue=35325, util=89.05% 00:19:10.109 nvme0n4: ios=4102/4554, merge=0/0, ticks=19031/18809, in_queue=37840, util=93.07% 00:19:10.109 04:30:49 -- target/fio.sh@55 -- # sync 00:19:10.109 04:30:49 -- target/fio.sh@59 -- # fio_pid=2930888 00:19:10.109 04:30:49 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:10.109 04:30:49 -- target/fio.sh@61 -- # sleep 3 00:19:10.109 [global] 00:19:10.109 thread=1 00:19:10.109 invalidate=1 00:19:10.109 rw=read 00:19:10.109 time_based=1 00:19:10.109 runtime=10 00:19:10.109 ioengine=libaio 00:19:10.109 direct=1 00:19:10.109 bs=4096 00:19:10.109 iodepth=1 00:19:10.109 norandommap=1 00:19:10.109 numjobs=1 00:19:10.109 00:19:10.109 [job0] 00:19:10.109 filename=/dev/nvme0n1 00:19:10.109 [job1] 00:19:10.109 filename=/dev/nvme0n2 00:19:10.109 [job2] 00:19:10.109 filename=/dev/nvme0n3 00:19:10.110 [job3] 00:19:10.110 filename=/dev/nvme0n4 00:19:10.110 Could not set queue depth (nvme0n1) 00:19:10.110 Could not set queue depth (nvme0n2) 00:19:10.110 Could not set queue depth (nvme0n3) 00:19:10.110 Could not set queue depth (nvme0n4) 00:19:10.110 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:10.110 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:10.110 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:10.110 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:10.110 fio-3.35 00:19:10.110 Starting 4 threads 00:19:13.396 04:30:52 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:13.396 04:30:52 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:13.396 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=3219456, buflen=4096 00:19:13.396 fio: pid=2930979, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:13.396 04:30:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:13.396 04:30:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:13.653 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=434176, buflen=4096 00:19:13.653 fio: pid=2930978, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:13.653 04:30:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:13.653 04:30:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:13.912 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=13127680, buflen=4096 00:19:13.912 fio: pid=2930976, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:14.171 04:30:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:14.171 04:30:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:14.171 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=2703360, buflen=4096 00:19:14.171 fio: pid=2930977, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:14.171 00:19:14.171 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2930976: Tue Nov 26 04:30:53 2024 00:19:14.171 read: IOPS=932, BW=3730KiB/s (3820kB/s)(12.5MiB/3437msec) 00:19:14.171 slat (usec): min=5, max=7854, avg=10.61, stdev=138.66 00:19:14.171 clat (usec): min=191, max=42642, avg=1052.01, stdev=5602.23 00:19:14.171 lat (usec): min=197, max=42659, avg=1060.17, stdev=5604.47 00:19:14.171 clat percentiles (usec): 00:19:14.171 | 1.00th=[ 204], 5.00th=[ 217], 10.00th=[ 223], 20.00th=[ 235], 00:19:14.171 | 30.00th=[ 245], 40.00th=[ 255], 50.00th=[ 289], 60.00th=[ 297], 00:19:14.171 | 70.00th=[ 297], 80.00th=[ 297], 90.00th=[ 306], 95.00th=[ 322], 00:19:14.171 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:19:14.171 | 99.99th=[42730] 00:19:14.171 bw ( KiB/s): min= 96, max=13208, per=82.86%, avg=4260.00, stdev=4890.28, samples=6 00:19:14.171 iops : min= 24, max= 3302, avg=1065.00, stdev=1222.57, samples=6 00:19:14.171 lat (usec) : 250=34.90%, 500=63.01%, 750=0.12%, 1000=0.03% 00:19:14.171 lat (msec) : 50=1.90% 00:19:14.171 cpu : usr=0.58%, sys=1.08%, ctx=3210, majf=0, minf=1 00:19:14.171 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.171 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.171 issued rwts: total=3206,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.171 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.171 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2930977: Tue Nov 26 04:30:53 2024 00:19:14.171 read: IOPS=178, BW=713KiB/s (730kB/s)(2640KiB/3701msec) 00:19:14.171 slat (nsec): min=4258, max=49674, avg=7971.07, stdev=7268.81 00:19:14.171 clat (usec): min=211, max=43110, avg=5561.50, stdev=13818.80 00:19:14.171 lat (usec): min=216, max=43127, avg=5569.45, stdev=13824.71 00:19:14.171 clat percentiles (usec): 00:19:14.171 | 1.00th=[ 221], 5.00th=[ 229], 10.00th=[ 235], 20.00th=[ 243], 00:19:14.171 | 30.00th=[ 245], 40.00th=[ 249], 50.00th=[ 253], 60.00th=[ 255], 00:19:14.171 | 70.00th=[ 260], 80.00th=[ 269], 90.00th=[41157], 95.00th=[41681], 00:19:14.171 | 99.00th=[42206], 99.50th=[42206], 99.90th=[43254], 99.95th=[43254], 00:19:14.171 | 99.99th=[43254] 00:19:14.171 bw ( KiB/s): min= 96, max= 4664, per=14.57%, avg=749.00, stdev=1726.35, samples=7 00:19:14.171 iops : min= 24, max= 1166, avg=187.14, stdev=431.64, samples=7 00:19:14.171 lat (usec) : 250=44.02%, 500=42.81% 00:19:14.171 lat (msec) : 2=0.15%, 50=12.86% 00:19:14.171 cpu : usr=0.03%, sys=0.16%, ctx=664, majf=0, minf=2 00:19:14.171 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.171 complete : 0=0.2%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.171 issued rwts: total=661,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.171 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.171 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2930978: Tue Nov 26 04:30:53 2024 00:19:14.171 read: IOPS=33, BW=133KiB/s (136kB/s)(424KiB/3181msec) 00:19:14.171 slat (usec): min=11, max=8935, avg=110.63, stdev=861.22 00:19:14.171 clat (usec): min=365, max=42873, avg=29794.23, stdev=18434.45 00:19:14.171 lat (usec): min=401, max=50025, avg=29905.74, stdev=18501.41 00:19:14.171 clat percentiles (usec): 00:19:14.171 | 1.00th=[ 371], 5.00th=[ 379], 10.00th=[ 396], 20.00th=[ 445], 00:19:14.171 | 30.00th=[40633], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:14.171 | 70.00th=[41157], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:14.171 | 99.00th=[42206], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:19:14.171 | 99.99th=[42730] 00:19:14.171 bw ( KiB/s): min= 88, max= 176, per=2.65%, avg=136.00, stdev=36.49, samples=6 00:19:14.171 iops : min= 22, max= 44, avg=34.00, stdev= 9.12, samples=6 00:19:14.172 lat (usec) : 500=26.17% 00:19:14.172 lat (msec) : 2=0.93%, 10=0.93%, 50=71.03% 00:19:14.172 cpu : usr=0.19%, sys=0.00%, ctx=110, majf=0, minf=1 00:19:14.172 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.172 complete : 0=0.9%, 4=99.1%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.172 issued rwts: total=107,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.172 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.172 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2930979: Tue Nov 26 04:30:53 2024 00:19:14.172 read: IOPS=271, BW=1083KiB/s (1109kB/s)(3144KiB/2903msec) 00:19:14.172 slat (nsec): min=4204, max=47331, avg=9473.95, stdev=7761.03 00:19:14.172 clat (usec): min=203, max=42043, avg=3651.20, stdev=11357.60 00:19:14.172 lat (usec): min=213, max=42057, avg=3660.65, stdev=11361.50 00:19:14.172 clat percentiles (usec): 00:19:14.172 | 1.00th=[ 210], 5.00th=[ 215], 10.00th=[ 219], 20.00th=[ 223], 00:19:14.172 | 30.00th=[ 227], 40.00th=[ 231], 50.00th=[ 235], 60.00th=[ 239], 00:19:14.172 | 70.00th=[ 247], 80.00th=[ 269], 90.00th=[ 404], 95.00th=[41157], 00:19:14.172 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:14.172 | 99.99th=[42206] 00:19:14.172 bw ( KiB/s): min= 96, max= 1576, per=7.70%, avg=396.80, stdev=659.23, samples=5 00:19:14.172 iops : min= 24, max= 394, avg=99.20, stdev=164.81, samples=5 00:19:14.172 lat (usec) : 250=71.41%, 500=20.08%, 750=0.13% 00:19:14.172 lat (msec) : 50=8.26% 00:19:14.172 cpu : usr=0.07%, sys=0.31%, ctx=787, majf=0, minf=2 00:19:14.172 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.172 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.172 issued rwts: total=787,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.172 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.172 00:19:14.172 Run status group 0 (all jobs): 00:19:14.172 READ: bw=5141KiB/s (5265kB/s), 133KiB/s-3730KiB/s (136kB/s-3820kB/s), io=18.6MiB (19.5MB), run=2903-3701msec 00:19:14.172 00:19:14.172 Disk stats (read/write): 00:19:14.172 nvme0n1: ios=3243/0, merge=0/0, ticks=3889/0, in_queue=3889, util=99.57% 00:19:14.172 nvme0n2: ios=702/0, merge=0/0, ticks=4681/0, in_queue=4681, util=99.71% 00:19:14.172 nvme0n3: ios=156/0, merge=0/0, ticks=4057/0, in_queue=4057, util=99.44% 00:19:14.172 nvme0n4: ios=785/0, merge=0/0, ticks=2827/0, in_queue=2827, util=96.75% 00:19:14.430 04:30:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:14.430 04:30:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:14.688 04:30:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:14.688 04:30:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:14.946 04:30:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:14.946 04:30:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:15.205 04:30:54 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:15.205 04:30:54 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:15.463 04:30:54 -- target/fio.sh@69 -- # fio_status=0 00:19:15.463 04:30:54 -- target/fio.sh@70 -- # wait 2930888 00:19:15.463 04:30:54 -- target/fio.sh@70 -- # fio_status=4 00:19:15.463 04:30:54 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:15.463 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:15.463 04:30:54 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:15.463 04:30:54 -- common/autotest_common.sh@1208 -- # local i=0 00:19:15.463 04:30:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:15.463 04:30:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:15.463 04:30:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:15.463 04:30:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:15.463 04:30:54 -- common/autotest_common.sh@1220 -- # return 0 00:19:15.463 04:30:54 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:15.463 04:30:54 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:15.463 nvmf hotplug test: fio failed as expected 00:19:15.463 04:30:54 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:15.722 04:30:54 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:15.722 04:30:54 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:15.722 04:30:54 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:15.722 04:30:54 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:15.722 04:30:54 -- target/fio.sh@91 -- # nvmftestfini 00:19:15.722 04:30:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:15.722 04:30:54 -- nvmf/common.sh@116 -- # sync 00:19:15.722 04:30:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:15.722 04:30:54 -- nvmf/common.sh@119 -- # set +e 00:19:15.722 04:30:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:15.722 04:30:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:15.722 rmmod nvme_tcp 00:19:15.722 rmmod nvme_fabrics 00:19:15.722 rmmod nvme_keyring 00:19:15.981 04:30:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:15.981 04:30:54 -- nvmf/common.sh@123 -- # set -e 00:19:15.982 04:30:54 -- nvmf/common.sh@124 -- # return 0 00:19:15.982 04:30:54 -- nvmf/common.sh@477 -- # '[' -n 2928764 ']' 00:19:15.982 04:30:54 -- nvmf/common.sh@478 -- # killprocess 2928764 00:19:15.982 04:30:54 -- common/autotest_common.sh@936 -- # '[' -z 2928764 ']' 00:19:15.982 04:30:54 -- common/autotest_common.sh@940 -- # kill -0 2928764 00:19:15.982 04:30:54 -- common/autotest_common.sh@941 -- # uname 00:19:15.982 04:30:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:15.982 04:30:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2928764 00:19:15.982 04:30:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:15.982 04:30:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:15.982 04:30:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2928764' 00:19:15.982 killing process with pid 2928764 00:19:15.982 04:30:54 -- common/autotest_common.sh@955 -- # kill 2928764 00:19:15.982 04:30:54 -- common/autotest_common.sh@960 -- # wait 2928764 00:19:16.241 04:30:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:16.241 04:30:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:16.241 04:30:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:16.241 04:30:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:16.241 04:30:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:16.241 04:30:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:16.241 04:30:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:16.241 04:30:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:18.150 04:30:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:18.150 00:19:18.150 real 0m24.392s 00:19:18.150 user 1m26.131s 00:19:18.150 sys 0m6.207s 00:19:18.150 04:30:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:18.150 04:30:57 -- common/autotest_common.sh@10 -- # set +x 00:19:18.150 ************************************ 00:19:18.150 END TEST nvmf_fio_target 00:19:18.150 ************************************ 00:19:18.150 04:30:57 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:18.150 04:30:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:18.151 04:30:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:18.151 04:30:57 -- common/autotest_common.sh@10 -- # set +x 00:19:18.151 ************************************ 00:19:18.151 START TEST nvmf_bdevio 00:19:18.151 ************************************ 00:19:18.151 04:30:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:18.151 * Looking for test storage... 00:19:18.151 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:18.151 04:30:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:18.151 04:30:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:18.151 04:30:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:18.411 04:30:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:18.411 04:30:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:18.411 04:30:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:18.411 04:30:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:18.411 04:30:57 -- scripts/common.sh@335 -- # IFS=.-: 00:19:18.411 04:30:57 -- scripts/common.sh@335 -- # read -ra ver1 00:19:18.411 04:30:57 -- scripts/common.sh@336 -- # IFS=.-: 00:19:18.411 04:30:57 -- scripts/common.sh@336 -- # read -ra ver2 00:19:18.411 04:30:57 -- scripts/common.sh@337 -- # local 'op=<' 00:19:18.411 04:30:57 -- scripts/common.sh@339 -- # ver1_l=2 00:19:18.411 04:30:57 -- scripts/common.sh@340 -- # ver2_l=1 00:19:18.411 04:30:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:18.411 04:30:57 -- scripts/common.sh@343 -- # case "$op" in 00:19:18.411 04:30:57 -- scripts/common.sh@344 -- # : 1 00:19:18.411 04:30:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:18.411 04:30:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:18.411 04:30:57 -- scripts/common.sh@364 -- # decimal 1 00:19:18.411 04:30:57 -- scripts/common.sh@352 -- # local d=1 00:19:18.411 04:30:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:18.411 04:30:57 -- scripts/common.sh@354 -- # echo 1 00:19:18.411 04:30:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:18.411 04:30:57 -- scripts/common.sh@365 -- # decimal 2 00:19:18.411 04:30:57 -- scripts/common.sh@352 -- # local d=2 00:19:18.411 04:30:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:18.411 04:30:57 -- scripts/common.sh@354 -- # echo 2 00:19:18.411 04:30:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:18.411 04:30:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:18.411 04:30:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:18.411 04:30:57 -- scripts/common.sh@367 -- # return 0 00:19:18.411 04:30:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:18.411 04:30:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:18.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:18.411 --rc genhtml_branch_coverage=1 00:19:18.411 --rc genhtml_function_coverage=1 00:19:18.411 --rc genhtml_legend=1 00:19:18.411 --rc geninfo_all_blocks=1 00:19:18.411 --rc geninfo_unexecuted_blocks=1 00:19:18.411 00:19:18.411 ' 00:19:18.411 04:30:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:18.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:18.411 --rc genhtml_branch_coverage=1 00:19:18.411 --rc genhtml_function_coverage=1 00:19:18.411 --rc genhtml_legend=1 00:19:18.411 --rc geninfo_all_blocks=1 00:19:18.411 --rc geninfo_unexecuted_blocks=1 00:19:18.411 00:19:18.411 ' 00:19:18.411 04:30:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:18.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:18.411 --rc genhtml_branch_coverage=1 00:19:18.411 --rc genhtml_function_coverage=1 00:19:18.411 --rc genhtml_legend=1 00:19:18.411 --rc geninfo_all_blocks=1 00:19:18.411 --rc geninfo_unexecuted_blocks=1 00:19:18.411 00:19:18.411 ' 00:19:18.411 04:30:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:18.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:18.411 --rc genhtml_branch_coverage=1 00:19:18.411 --rc genhtml_function_coverage=1 00:19:18.411 --rc genhtml_legend=1 00:19:18.411 --rc geninfo_all_blocks=1 00:19:18.411 --rc geninfo_unexecuted_blocks=1 00:19:18.411 00:19:18.411 ' 00:19:18.411 04:30:57 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:18.411 04:30:57 -- nvmf/common.sh@7 -- # uname -s 00:19:18.411 04:30:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:18.411 04:30:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:18.411 04:30:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:18.411 04:30:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:18.411 04:30:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:18.411 04:30:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:18.411 04:30:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:18.411 04:30:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:18.411 04:30:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:18.411 04:30:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:18.412 04:30:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:18.412 04:30:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:18.412 04:30:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:18.412 04:30:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:18.412 04:30:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:18.412 04:30:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:18.412 04:30:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:18.412 04:30:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:18.412 04:30:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:18.412 04:30:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.412 04:30:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.412 04:30:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.412 04:30:57 -- paths/export.sh@5 -- # export PATH 00:19:18.412 04:30:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.412 04:30:57 -- nvmf/common.sh@46 -- # : 0 00:19:18.412 04:30:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:18.412 04:30:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:18.412 04:30:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:18.412 04:30:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:18.412 04:30:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:18.412 04:30:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:18.412 04:30:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:18.412 04:30:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:18.412 04:30:57 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:18.412 04:30:57 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:18.412 04:30:57 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:18.412 04:30:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:18.412 04:30:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:18.412 04:30:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:18.412 04:30:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:18.412 04:30:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:18.412 04:30:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:18.412 04:30:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:18.412 04:30:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:18.412 04:30:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:18.412 04:30:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:18.412 04:30:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:18.412 04:30:57 -- common/autotest_common.sh@10 -- # set +x 00:19:20.319 04:30:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:20.319 04:30:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:20.319 04:30:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:20.319 04:30:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:20.319 04:30:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:20.319 04:30:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:20.319 04:30:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:20.319 04:30:59 -- nvmf/common.sh@294 -- # net_devs=() 00:19:20.319 04:30:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:20.319 04:30:59 -- nvmf/common.sh@295 -- # e810=() 00:19:20.319 04:30:59 -- nvmf/common.sh@295 -- # local -ga e810 00:19:20.319 04:30:59 -- nvmf/common.sh@296 -- # x722=() 00:19:20.319 04:30:59 -- nvmf/common.sh@296 -- # local -ga x722 00:19:20.319 04:30:59 -- nvmf/common.sh@297 -- # mlx=() 00:19:20.319 04:30:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:20.319 04:30:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:20.319 04:30:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:20.319 04:30:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:20.319 04:30:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:20.319 04:30:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:20.319 04:30:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:20.319 04:30:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:20.319 04:30:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:20.319 04:30:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:20.319 04:30:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:20.319 04:30:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:20.319 04:30:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:20.319 04:30:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:20.319 04:30:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:20.319 04:30:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:20.319 04:30:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:20.319 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:20.319 04:30:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:20.319 04:30:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:20.319 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:20.319 04:30:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:20.319 04:30:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:20.319 04:30:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:20.319 04:30:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:20.319 04:30:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:20.319 04:30:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:20.319 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:20.319 04:30:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:20.319 04:30:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:20.319 04:30:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:20.319 04:30:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:20.319 04:30:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:20.319 04:30:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:20.319 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:20.319 04:30:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:20.319 04:30:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:20.319 04:30:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:20.319 04:30:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:20.319 04:30:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:20.319 04:30:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:20.319 04:30:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:20.319 04:30:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:20.319 04:30:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:20.319 04:30:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:20.319 04:30:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:20.319 04:30:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:20.319 04:30:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:20.319 04:30:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:20.319 04:30:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:20.319 04:30:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:20.319 04:30:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:20.319 04:30:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:20.319 04:30:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:20.319 04:30:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:20.319 04:30:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:20.320 04:30:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:20.320 04:30:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:20.320 04:30:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:20.320 04:30:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:20.320 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:20.320 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:19:20.320 00:19:20.320 --- 10.0.0.2 ping statistics --- 00:19:20.320 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:20.320 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:19:20.320 04:30:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:20.320 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:20.320 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:19:20.320 00:19:20.320 --- 10.0.0.1 ping statistics --- 00:19:20.320 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:20.320 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:19:20.320 04:30:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:20.320 04:30:59 -- nvmf/common.sh@410 -- # return 0 00:19:20.320 04:30:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:20.320 04:30:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:20.320 04:30:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:20.320 04:30:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:20.320 04:30:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:20.320 04:30:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:20.320 04:30:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:20.320 04:30:59 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:20.320 04:30:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:20.320 04:30:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:20.320 04:30:59 -- common/autotest_common.sh@10 -- # set +x 00:19:20.320 04:30:59 -- nvmf/common.sh@469 -- # nvmfpid=2933635 00:19:20.320 04:30:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:20.320 04:30:59 -- nvmf/common.sh@470 -- # waitforlisten 2933635 00:19:20.320 04:30:59 -- common/autotest_common.sh@829 -- # '[' -z 2933635 ']' 00:19:20.320 04:30:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:20.320 04:30:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:20.320 04:30:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:20.320 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:20.320 04:30:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:20.320 04:30:59 -- common/autotest_common.sh@10 -- # set +x 00:19:20.580 [2024-11-26 04:30:59.586541] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:20.580 [2024-11-26 04:30:59.586622] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:20.580 EAL: No free 2048 kB hugepages reported on node 1 00:19:20.580 [2024-11-26 04:30:59.662516] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:20.580 [2024-11-26 04:30:59.756921] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:20.580 [2024-11-26 04:30:59.757099] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:20.580 [2024-11-26 04:30:59.757118] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:20.580 [2024-11-26 04:30:59.757132] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:20.580 [2024-11-26 04:30:59.757226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:20.580 [2024-11-26 04:30:59.757283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:20.580 [2024-11-26 04:30:59.757336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:20.580 [2024-11-26 04:30:59.757339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:21.515 04:31:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:21.515 04:31:00 -- common/autotest_common.sh@862 -- # return 0 00:19:21.515 04:31:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:21.515 04:31:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:21.515 04:31:00 -- common/autotest_common.sh@10 -- # set +x 00:19:21.515 04:31:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:21.515 04:31:00 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:21.515 04:31:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.515 04:31:00 -- common/autotest_common.sh@10 -- # set +x 00:19:21.515 [2024-11-26 04:31:00.622438] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:21.515 04:31:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.515 04:31:00 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:21.515 04:31:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.515 04:31:00 -- common/autotest_common.sh@10 -- # set +x 00:19:21.515 Malloc0 00:19:21.515 04:31:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.515 04:31:00 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:21.515 04:31:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.515 04:31:00 -- common/autotest_common.sh@10 -- # set +x 00:19:21.515 04:31:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.515 04:31:00 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:21.515 04:31:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.515 04:31:00 -- common/autotest_common.sh@10 -- # set +x 00:19:21.515 04:31:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.515 04:31:00 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:21.515 04:31:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.516 04:31:00 -- common/autotest_common.sh@10 -- # set +x 00:19:21.516 [2024-11-26 04:31:00.673654] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:21.516 04:31:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.516 04:31:00 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:21.516 04:31:00 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:21.516 04:31:00 -- nvmf/common.sh@520 -- # config=() 00:19:21.516 04:31:00 -- nvmf/common.sh@520 -- # local subsystem config 00:19:21.516 04:31:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:21.516 04:31:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:21.516 { 00:19:21.516 "params": { 00:19:21.516 "name": "Nvme$subsystem", 00:19:21.516 "trtype": "$TEST_TRANSPORT", 00:19:21.516 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:21.516 "adrfam": "ipv4", 00:19:21.516 "trsvcid": "$NVMF_PORT", 00:19:21.516 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:21.516 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:21.516 "hdgst": ${hdgst:-false}, 00:19:21.516 "ddgst": ${ddgst:-false} 00:19:21.516 }, 00:19:21.516 "method": "bdev_nvme_attach_controller" 00:19:21.516 } 00:19:21.516 EOF 00:19:21.516 )") 00:19:21.516 04:31:00 -- nvmf/common.sh@542 -- # cat 00:19:21.516 04:31:00 -- nvmf/common.sh@544 -- # jq . 00:19:21.516 04:31:00 -- nvmf/common.sh@545 -- # IFS=, 00:19:21.516 04:31:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:21.516 "params": { 00:19:21.516 "name": "Nvme1", 00:19:21.516 "trtype": "tcp", 00:19:21.516 "traddr": "10.0.0.2", 00:19:21.516 "adrfam": "ipv4", 00:19:21.516 "trsvcid": "4420", 00:19:21.516 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:21.516 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:21.516 "hdgst": false, 00:19:21.516 "ddgst": false 00:19:21.516 }, 00:19:21.516 "method": "bdev_nvme_attach_controller" 00:19:21.516 }' 00:19:21.516 [2024-11-26 04:31:00.714521] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:21.516 [2024-11-26 04:31:00.714606] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2933797 ] 00:19:21.775 EAL: No free 2048 kB hugepages reported on node 1 00:19:21.775 [2024-11-26 04:31:00.775046] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:21.775 [2024-11-26 04:31:00.861323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:21.775 [2024-11-26 04:31:00.861374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:21.775 [2024-11-26 04:31:00.861377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:22.033 [2024-11-26 04:31:01.194624] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:22.033 [2024-11-26 04:31:01.194679] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:22.033 I/O targets: 00:19:22.033 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:22.033 00:19:22.034 00:19:22.034 CUnit - A unit testing framework for C - Version 2.1-3 00:19:22.034 http://cunit.sourceforge.net/ 00:19:22.034 00:19:22.034 00:19:22.034 Suite: bdevio tests on: Nvme1n1 00:19:22.034 Test: blockdev write read block ...passed 00:19:22.293 Test: blockdev write zeroes read block ...passed 00:19:22.293 Test: blockdev write zeroes read no split ...passed 00:19:22.293 Test: blockdev write zeroes read split ...passed 00:19:22.293 Test: blockdev write zeroes read split partial ...passed 00:19:22.293 Test: blockdev reset ...[2024-11-26 04:31:01.312183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:22.293 [2024-11-26 04:31:01.312296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18ade40 (9): Bad file descriptor 00:19:22.293 [2024-11-26 04:31:01.405838] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:22.293 passed 00:19:22.293 Test: blockdev write read 8 blocks ...passed 00:19:22.293 Test: blockdev write read size > 128k ...passed 00:19:22.293 Test: blockdev write read invalid size ...passed 00:19:22.293 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:22.293 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:22.293 Test: blockdev write read max offset ...passed 00:19:22.553 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:22.553 Test: blockdev writev readv 8 blocks ...passed 00:19:22.553 Test: blockdev writev readv 30 x 1block ...passed 00:19:22.553 Test: blockdev writev readv block ...passed 00:19:22.553 Test: blockdev writev readv size > 128k ...passed 00:19:22.553 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:22.553 Test: blockdev comparev and writev ...[2024-11-26 04:31:01.620785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:22.553 [2024-11-26 04:31:01.620821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:22.553 [2024-11-26 04:31:01.620844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:22.554 [2024-11-26 04:31:01.620861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:22.554 [2024-11-26 04:31:01.621185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:22.554 [2024-11-26 04:31:01.621209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:22.554 [2024-11-26 04:31:01.621231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:22.554 [2024-11-26 04:31:01.621247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:22.554 [2024-11-26 04:31:01.621559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:22.554 [2024-11-26 04:31:01.621581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:22.554 [2024-11-26 04:31:01.621602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:22.554 [2024-11-26 04:31:01.621619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:22.554 [2024-11-26 04:31:01.621929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:22.554 [2024-11-26 04:31:01.621956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:22.554 [2024-11-26 04:31:01.621978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:22.554 [2024-11-26 04:31:01.621993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:22.554 passed 00:19:22.554 Test: blockdev nvme passthru rw ...passed 00:19:22.554 Test: blockdev nvme passthru vendor specific ...[2024-11-26 04:31:01.704929] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:22.554 [2024-11-26 04:31:01.704957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:22.554 [2024-11-26 04:31:01.705108] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:22.554 [2024-11-26 04:31:01.705131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:22.554 [2024-11-26 04:31:01.705278] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:22.554 [2024-11-26 04:31:01.705300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:22.554 [2024-11-26 04:31:01.705446] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:22.554 [2024-11-26 04:31:01.705468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:22.554 passed 00:19:22.554 Test: blockdev nvme admin passthru ...passed 00:19:22.554 Test: blockdev copy ...passed 00:19:22.554 00:19:22.554 Run Summary: Type Total Ran Passed Failed Inactive 00:19:22.554 suites 1 1 n/a 0 0 00:19:22.554 tests 23 23 23 0 0 00:19:22.554 asserts 152 152 152 0 n/a 00:19:22.554 00:19:22.554 Elapsed time = 1.142 seconds 00:19:22.813 04:31:01 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:22.813 04:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.813 04:31:01 -- common/autotest_common.sh@10 -- # set +x 00:19:22.813 04:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.813 04:31:01 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:22.813 04:31:01 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:22.813 04:31:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:22.813 04:31:01 -- nvmf/common.sh@116 -- # sync 00:19:22.813 04:31:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:22.813 04:31:01 -- nvmf/common.sh@119 -- # set +e 00:19:22.813 04:31:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:22.813 04:31:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:22.813 rmmod nvme_tcp 00:19:22.813 rmmod nvme_fabrics 00:19:22.813 rmmod nvme_keyring 00:19:22.813 04:31:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:22.813 04:31:02 -- nvmf/common.sh@123 -- # set -e 00:19:22.813 04:31:02 -- nvmf/common.sh@124 -- # return 0 00:19:22.813 04:31:02 -- nvmf/common.sh@477 -- # '[' -n 2933635 ']' 00:19:22.813 04:31:02 -- nvmf/common.sh@478 -- # killprocess 2933635 00:19:22.813 04:31:02 -- common/autotest_common.sh@936 -- # '[' -z 2933635 ']' 00:19:22.813 04:31:02 -- common/autotest_common.sh@940 -- # kill -0 2933635 00:19:22.813 04:31:02 -- common/autotest_common.sh@941 -- # uname 00:19:22.813 04:31:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:22.813 04:31:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2933635 00:19:23.071 04:31:02 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:23.072 04:31:02 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:23.072 04:31:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2933635' 00:19:23.072 killing process with pid 2933635 00:19:23.072 04:31:02 -- common/autotest_common.sh@955 -- # kill 2933635 00:19:23.072 04:31:02 -- common/autotest_common.sh@960 -- # wait 2933635 00:19:23.332 04:31:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:23.332 04:31:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:23.332 04:31:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:23.332 04:31:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:23.332 04:31:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:23.332 04:31:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:23.332 04:31:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:23.332 04:31:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:25.237 04:31:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:25.237 00:19:25.237 real 0m7.030s 00:19:25.237 user 0m13.575s 00:19:25.237 sys 0m2.062s 00:19:25.237 04:31:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:25.237 04:31:04 -- common/autotest_common.sh@10 -- # set +x 00:19:25.237 ************************************ 00:19:25.237 END TEST nvmf_bdevio 00:19:25.237 ************************************ 00:19:25.237 04:31:04 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:25.237 04:31:04 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:25.237 04:31:04 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:19:25.237 04:31:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:25.237 04:31:04 -- common/autotest_common.sh@10 -- # set +x 00:19:25.237 ************************************ 00:19:25.237 START TEST nvmf_bdevio_no_huge 00:19:25.237 ************************************ 00:19:25.237 04:31:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:25.237 * Looking for test storage... 00:19:25.237 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:25.237 04:31:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:25.237 04:31:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:25.237 04:31:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:25.497 04:31:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:25.497 04:31:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:25.497 04:31:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:25.497 04:31:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:25.497 04:31:04 -- scripts/common.sh@335 -- # IFS=.-: 00:19:25.497 04:31:04 -- scripts/common.sh@335 -- # read -ra ver1 00:19:25.497 04:31:04 -- scripts/common.sh@336 -- # IFS=.-: 00:19:25.497 04:31:04 -- scripts/common.sh@336 -- # read -ra ver2 00:19:25.497 04:31:04 -- scripts/common.sh@337 -- # local 'op=<' 00:19:25.497 04:31:04 -- scripts/common.sh@339 -- # ver1_l=2 00:19:25.497 04:31:04 -- scripts/common.sh@340 -- # ver2_l=1 00:19:25.497 04:31:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:25.497 04:31:04 -- scripts/common.sh@343 -- # case "$op" in 00:19:25.497 04:31:04 -- scripts/common.sh@344 -- # : 1 00:19:25.497 04:31:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:25.497 04:31:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:25.497 04:31:04 -- scripts/common.sh@364 -- # decimal 1 00:19:25.498 04:31:04 -- scripts/common.sh@352 -- # local d=1 00:19:25.498 04:31:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:25.498 04:31:04 -- scripts/common.sh@354 -- # echo 1 00:19:25.498 04:31:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:25.498 04:31:04 -- scripts/common.sh@365 -- # decimal 2 00:19:25.498 04:31:04 -- scripts/common.sh@352 -- # local d=2 00:19:25.498 04:31:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:25.498 04:31:04 -- scripts/common.sh@354 -- # echo 2 00:19:25.498 04:31:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:25.498 04:31:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:25.498 04:31:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:25.498 04:31:04 -- scripts/common.sh@367 -- # return 0 00:19:25.498 04:31:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:25.498 04:31:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:25.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.498 --rc genhtml_branch_coverage=1 00:19:25.498 --rc genhtml_function_coverage=1 00:19:25.498 --rc genhtml_legend=1 00:19:25.498 --rc geninfo_all_blocks=1 00:19:25.498 --rc geninfo_unexecuted_blocks=1 00:19:25.498 00:19:25.498 ' 00:19:25.498 04:31:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:25.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.498 --rc genhtml_branch_coverage=1 00:19:25.498 --rc genhtml_function_coverage=1 00:19:25.498 --rc genhtml_legend=1 00:19:25.498 --rc geninfo_all_blocks=1 00:19:25.498 --rc geninfo_unexecuted_blocks=1 00:19:25.498 00:19:25.498 ' 00:19:25.498 04:31:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:25.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.498 --rc genhtml_branch_coverage=1 00:19:25.498 --rc genhtml_function_coverage=1 00:19:25.498 --rc genhtml_legend=1 00:19:25.498 --rc geninfo_all_blocks=1 00:19:25.498 --rc geninfo_unexecuted_blocks=1 00:19:25.498 00:19:25.498 ' 00:19:25.498 04:31:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:25.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.498 --rc genhtml_branch_coverage=1 00:19:25.498 --rc genhtml_function_coverage=1 00:19:25.498 --rc genhtml_legend=1 00:19:25.498 --rc geninfo_all_blocks=1 00:19:25.498 --rc geninfo_unexecuted_blocks=1 00:19:25.498 00:19:25.498 ' 00:19:25.498 04:31:04 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:25.498 04:31:04 -- nvmf/common.sh@7 -- # uname -s 00:19:25.498 04:31:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:25.498 04:31:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:25.498 04:31:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:25.498 04:31:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:25.498 04:31:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:25.498 04:31:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:25.498 04:31:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:25.498 04:31:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:25.498 04:31:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:25.498 04:31:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:25.498 04:31:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:25.498 04:31:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:25.498 04:31:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:25.498 04:31:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:25.498 04:31:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:25.498 04:31:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:25.498 04:31:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:25.498 04:31:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:25.498 04:31:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:25.498 04:31:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.498 04:31:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.498 04:31:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.498 04:31:04 -- paths/export.sh@5 -- # export PATH 00:19:25.498 04:31:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.498 04:31:04 -- nvmf/common.sh@46 -- # : 0 00:19:25.498 04:31:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:25.498 04:31:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:25.498 04:31:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:25.498 04:31:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:25.498 04:31:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:25.498 04:31:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:25.498 04:31:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:25.498 04:31:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:25.498 04:31:04 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:25.498 04:31:04 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:25.498 04:31:04 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:25.498 04:31:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:25.498 04:31:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:25.498 04:31:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:25.498 04:31:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:25.498 04:31:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:25.498 04:31:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:25.498 04:31:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:25.498 04:31:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:25.498 04:31:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:25.498 04:31:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:25.498 04:31:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:25.498 04:31:04 -- common/autotest_common.sh@10 -- # set +x 00:19:27.402 04:31:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:27.402 04:31:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:27.402 04:31:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:27.402 04:31:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:27.402 04:31:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:27.402 04:31:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:27.402 04:31:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:27.402 04:31:06 -- nvmf/common.sh@294 -- # net_devs=() 00:19:27.402 04:31:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:27.402 04:31:06 -- nvmf/common.sh@295 -- # e810=() 00:19:27.402 04:31:06 -- nvmf/common.sh@295 -- # local -ga e810 00:19:27.402 04:31:06 -- nvmf/common.sh@296 -- # x722=() 00:19:27.402 04:31:06 -- nvmf/common.sh@296 -- # local -ga x722 00:19:27.402 04:31:06 -- nvmf/common.sh@297 -- # mlx=() 00:19:27.402 04:31:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:27.402 04:31:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:27.402 04:31:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:27.402 04:31:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:27.402 04:31:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:27.402 04:31:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:27.402 04:31:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:27.402 04:31:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:27.402 04:31:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:27.402 04:31:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:27.402 04:31:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:27.402 04:31:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:27.402 04:31:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:27.402 04:31:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:27.402 04:31:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:27.402 04:31:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:27.402 04:31:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:27.402 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:27.402 04:31:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:27.402 04:31:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:27.402 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:27.402 04:31:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:27.402 04:31:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:27.402 04:31:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:27.402 04:31:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:27.402 04:31:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:27.402 04:31:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:27.402 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:27.402 04:31:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:27.402 04:31:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:27.402 04:31:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:27.402 04:31:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:27.402 04:31:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:27.402 04:31:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:27.402 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:27.402 04:31:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:27.402 04:31:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:27.402 04:31:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:27.402 04:31:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:27.402 04:31:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:27.402 04:31:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:27.403 04:31:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:27.403 04:31:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:27.403 04:31:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:27.403 04:31:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:27.403 04:31:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:27.403 04:31:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:27.403 04:31:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:27.403 04:31:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:27.403 04:31:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:27.403 04:31:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:27.403 04:31:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:27.403 04:31:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:27.403 04:31:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:27.403 04:31:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:27.403 04:31:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:27.403 04:31:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:27.661 04:31:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:27.661 04:31:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:27.661 04:31:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:27.661 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:27.661 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:19:27.661 00:19:27.661 --- 10.0.0.2 ping statistics --- 00:19:27.661 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:27.661 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:19:27.661 04:31:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:27.661 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:27.661 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:19:27.661 00:19:27.661 --- 10.0.0.1 ping statistics --- 00:19:27.661 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:27.661 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:19:27.661 04:31:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:27.661 04:31:06 -- nvmf/common.sh@410 -- # return 0 00:19:27.661 04:31:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:27.661 04:31:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:27.661 04:31:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:27.661 04:31:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:27.661 04:31:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:27.661 04:31:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:27.661 04:31:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:27.661 04:31:06 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:27.661 04:31:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:27.661 04:31:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:27.661 04:31:06 -- common/autotest_common.sh@10 -- # set +x 00:19:27.661 04:31:06 -- nvmf/common.sh@469 -- # nvmfpid=2935886 00:19:27.661 04:31:06 -- nvmf/common.sh@470 -- # waitforlisten 2935886 00:19:27.661 04:31:06 -- common/autotest_common.sh@829 -- # '[' -z 2935886 ']' 00:19:27.661 04:31:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:27.661 04:31:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:27.661 04:31:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:27.661 04:31:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:27.661 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:27.661 04:31:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:27.661 04:31:06 -- common/autotest_common.sh@10 -- # set +x 00:19:27.661 [2024-11-26 04:31:06.725956] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:27.661 [2024-11-26 04:31:06.726078] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:27.661 [2024-11-26 04:31:06.793022] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:27.661 [2024-11-26 04:31:06.876406] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:27.661 [2024-11-26 04:31:06.876547] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:27.661 [2024-11-26 04:31:06.876566] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:27.661 [2024-11-26 04:31:06.876580] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:27.661 [2024-11-26 04:31:06.876654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:27.661 [2024-11-26 04:31:06.876703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:27.661 [2024-11-26 04:31:06.876755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:27.661 [2024-11-26 04:31:06.876757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:28.597 04:31:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:28.597 04:31:07 -- common/autotest_common.sh@862 -- # return 0 00:19:28.597 04:31:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:28.597 04:31:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:28.597 04:31:07 -- common/autotest_common.sh@10 -- # set +x 00:19:28.597 04:31:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:28.597 04:31:07 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:28.597 04:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.597 04:31:07 -- common/autotest_common.sh@10 -- # set +x 00:19:28.597 [2024-11-26 04:31:07.776962] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:28.597 04:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.597 04:31:07 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:28.597 04:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.597 04:31:07 -- common/autotest_common.sh@10 -- # set +x 00:19:28.597 Malloc0 00:19:28.597 04:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.597 04:31:07 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:28.597 04:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.597 04:31:07 -- common/autotest_common.sh@10 -- # set +x 00:19:28.597 04:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.597 04:31:07 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:28.597 04:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.597 04:31:07 -- common/autotest_common.sh@10 -- # set +x 00:19:28.597 04:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.598 04:31:07 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:28.598 04:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:28.598 04:31:07 -- common/autotest_common.sh@10 -- # set +x 00:19:28.598 [2024-11-26 04:31:07.815543] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:28.598 04:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:28.856 04:31:07 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:28.856 04:31:07 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:28.856 04:31:07 -- nvmf/common.sh@520 -- # config=() 00:19:28.856 04:31:07 -- nvmf/common.sh@520 -- # local subsystem config 00:19:28.856 04:31:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:28.856 04:31:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:28.856 { 00:19:28.856 "params": { 00:19:28.856 "name": "Nvme$subsystem", 00:19:28.856 "trtype": "$TEST_TRANSPORT", 00:19:28.856 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:28.856 "adrfam": "ipv4", 00:19:28.856 "trsvcid": "$NVMF_PORT", 00:19:28.856 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:28.856 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:28.856 "hdgst": ${hdgst:-false}, 00:19:28.856 "ddgst": ${ddgst:-false} 00:19:28.856 }, 00:19:28.856 "method": "bdev_nvme_attach_controller" 00:19:28.856 } 00:19:28.856 EOF 00:19:28.856 )") 00:19:28.856 04:31:07 -- nvmf/common.sh@542 -- # cat 00:19:28.856 04:31:07 -- nvmf/common.sh@544 -- # jq . 00:19:28.856 04:31:07 -- nvmf/common.sh@545 -- # IFS=, 00:19:28.856 04:31:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:28.856 "params": { 00:19:28.856 "name": "Nvme1", 00:19:28.856 "trtype": "tcp", 00:19:28.856 "traddr": "10.0.0.2", 00:19:28.856 "adrfam": "ipv4", 00:19:28.856 "trsvcid": "4420", 00:19:28.856 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:28.856 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:28.856 "hdgst": false, 00:19:28.856 "ddgst": false 00:19:28.856 }, 00:19:28.856 "method": "bdev_nvme_attach_controller" 00:19:28.856 }' 00:19:28.856 [2024-11-26 04:31:07.860851] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:28.856 [2024-11-26 04:31:07.860937] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid2936047 ] 00:19:28.856 [2024-11-26 04:31:07.920547] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:28.856 [2024-11-26 04:31:08.006008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:28.856 [2024-11-26 04:31:08.006059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:28.856 [2024-11-26 04:31:08.006063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:29.114 [2024-11-26 04:31:08.159377] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:29.114 [2024-11-26 04:31:08.159443] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:29.114 I/O targets: 00:19:29.114 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:29.114 00:19:29.114 00:19:29.114 CUnit - A unit testing framework for C - Version 2.1-3 00:19:29.114 http://cunit.sourceforge.net/ 00:19:29.114 00:19:29.114 00:19:29.114 Suite: bdevio tests on: Nvme1n1 00:19:29.114 Test: blockdev write read block ...passed 00:19:29.114 Test: blockdev write zeroes read block ...passed 00:19:29.114 Test: blockdev write zeroes read no split ...passed 00:19:29.114 Test: blockdev write zeroes read split ...passed 00:19:29.114 Test: blockdev write zeroes read split partial ...passed 00:19:29.114 Test: blockdev reset ...[2024-11-26 04:31:08.325072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:29.114 [2024-11-26 04:31:08.325183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b287c0 (9): Bad file descriptor 00:19:29.373 [2024-11-26 04:31:08.339083] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:29.373 passed 00:19:29.373 Test: blockdev write read 8 blocks ...passed 00:19:29.373 Test: blockdev write read size > 128k ...passed 00:19:29.373 Test: blockdev write read invalid size ...passed 00:19:29.373 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:29.373 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:29.373 Test: blockdev write read max offset ...passed 00:19:29.373 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:29.373 Test: blockdev writev readv 8 blocks ...passed 00:19:29.373 Test: blockdev writev readv 30 x 1block ...passed 00:19:29.373 Test: blockdev writev readv block ...passed 00:19:29.373 Test: blockdev writev readv size > 128k ...passed 00:19:29.373 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:29.373 Test: blockdev comparev and writev ...[2024-11-26 04:31:08.592855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.373 [2024-11-26 04:31:08.592891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:29.373 [2024-11-26 04:31:08.592915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.373 [2024-11-26 04:31:08.592932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:29.373 [2024-11-26 04:31:08.593240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.373 [2024-11-26 04:31:08.593264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:29.373 [2024-11-26 04:31:08.593287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.373 [2024-11-26 04:31:08.593310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:29.373 [2024-11-26 04:31:08.593622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.373 [2024-11-26 04:31:08.593647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:29.373 [2024-11-26 04:31:08.593669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.373 [2024-11-26 04:31:08.593692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:29.373 [2024-11-26 04:31:08.594001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.373 [2024-11-26 04:31:08.594024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:29.373 [2024-11-26 04:31:08.594046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.373 [2024-11-26 04:31:08.594061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:29.631 passed 00:19:29.631 Test: blockdev nvme passthru rw ...passed 00:19:29.631 Test: blockdev nvme passthru vendor specific ...[2024-11-26 04:31:08.676968] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:29.631 [2024-11-26 04:31:08.676998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:29.631 [2024-11-26 04:31:08.677145] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:29.631 [2024-11-26 04:31:08.677169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:29.631 [2024-11-26 04:31:08.677319] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:29.631 [2024-11-26 04:31:08.677343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:29.631 [2024-11-26 04:31:08.677490] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:29.631 [2024-11-26 04:31:08.677513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:29.631 passed 00:19:29.631 Test: blockdev nvme admin passthru ...passed 00:19:29.631 Test: blockdev copy ...passed 00:19:29.631 00:19:29.631 Run Summary: Type Total Ran Passed Failed Inactive 00:19:29.631 suites 1 1 n/a 0 0 00:19:29.631 tests 23 23 23 0 0 00:19:29.631 asserts 152 152 152 0 n/a 00:19:29.632 00:19:29.632 Elapsed time = 1.151 seconds 00:19:29.890 04:31:09 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:29.890 04:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.890 04:31:09 -- common/autotest_common.sh@10 -- # set +x 00:19:29.890 04:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.890 04:31:09 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:29.890 04:31:09 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:29.890 04:31:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:29.890 04:31:09 -- nvmf/common.sh@116 -- # sync 00:19:29.890 04:31:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:29.890 04:31:09 -- nvmf/common.sh@119 -- # set +e 00:19:29.890 04:31:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:29.890 04:31:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:29.890 rmmod nvme_tcp 00:19:29.890 rmmod nvme_fabrics 00:19:29.890 rmmod nvme_keyring 00:19:29.890 04:31:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:29.890 04:31:09 -- nvmf/common.sh@123 -- # set -e 00:19:29.890 04:31:09 -- nvmf/common.sh@124 -- # return 0 00:19:29.890 04:31:09 -- nvmf/common.sh@477 -- # '[' -n 2935886 ']' 00:19:29.890 04:31:09 -- nvmf/common.sh@478 -- # killprocess 2935886 00:19:29.890 04:31:09 -- common/autotest_common.sh@936 -- # '[' -z 2935886 ']' 00:19:29.890 04:31:09 -- common/autotest_common.sh@940 -- # kill -0 2935886 00:19:29.890 04:31:09 -- common/autotest_common.sh@941 -- # uname 00:19:29.890 04:31:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:29.890 04:31:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2935886 00:19:30.149 04:31:09 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:30.149 04:31:09 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:30.149 04:31:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2935886' 00:19:30.149 killing process with pid 2935886 00:19:30.149 04:31:09 -- common/autotest_common.sh@955 -- # kill 2935886 00:19:30.149 04:31:09 -- common/autotest_common.sh@960 -- # wait 2935886 00:19:30.409 04:31:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:30.409 04:31:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:30.409 04:31:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:30.409 04:31:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:30.409 04:31:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:30.409 04:31:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:30.409 04:31:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:30.409 04:31:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.949 04:31:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:32.949 00:19:32.949 real 0m7.226s 00:19:32.949 user 0m13.262s 00:19:32.949 sys 0m2.581s 00:19:32.949 04:31:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:32.949 04:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:32.949 ************************************ 00:19:32.949 END TEST nvmf_bdevio_no_huge 00:19:32.949 ************************************ 00:19:32.949 04:31:11 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:32.949 04:31:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:32.949 04:31:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:32.949 04:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:32.949 ************************************ 00:19:32.949 START TEST nvmf_tls 00:19:32.949 ************************************ 00:19:32.949 04:31:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:32.949 * Looking for test storage... 00:19:32.949 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:32.949 04:31:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:32.949 04:31:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:32.949 04:31:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:32.949 04:31:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:32.949 04:31:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:32.949 04:31:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:32.949 04:31:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:32.949 04:31:11 -- scripts/common.sh@335 -- # IFS=.-: 00:19:32.949 04:31:11 -- scripts/common.sh@335 -- # read -ra ver1 00:19:32.949 04:31:11 -- scripts/common.sh@336 -- # IFS=.-: 00:19:32.949 04:31:11 -- scripts/common.sh@336 -- # read -ra ver2 00:19:32.949 04:31:11 -- scripts/common.sh@337 -- # local 'op=<' 00:19:32.949 04:31:11 -- scripts/common.sh@339 -- # ver1_l=2 00:19:32.949 04:31:11 -- scripts/common.sh@340 -- # ver2_l=1 00:19:32.949 04:31:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:32.949 04:31:11 -- scripts/common.sh@343 -- # case "$op" in 00:19:32.949 04:31:11 -- scripts/common.sh@344 -- # : 1 00:19:32.949 04:31:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:32.949 04:31:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:32.949 04:31:11 -- scripts/common.sh@364 -- # decimal 1 00:19:32.949 04:31:11 -- scripts/common.sh@352 -- # local d=1 00:19:32.949 04:31:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:32.949 04:31:11 -- scripts/common.sh@354 -- # echo 1 00:19:32.949 04:31:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:32.949 04:31:11 -- scripts/common.sh@365 -- # decimal 2 00:19:32.949 04:31:11 -- scripts/common.sh@352 -- # local d=2 00:19:32.949 04:31:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:32.949 04:31:11 -- scripts/common.sh@354 -- # echo 2 00:19:32.949 04:31:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:32.949 04:31:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:32.949 04:31:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:32.949 04:31:11 -- scripts/common.sh@367 -- # return 0 00:19:32.949 04:31:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:32.949 04:31:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:32.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.949 --rc genhtml_branch_coverage=1 00:19:32.949 --rc genhtml_function_coverage=1 00:19:32.949 --rc genhtml_legend=1 00:19:32.949 --rc geninfo_all_blocks=1 00:19:32.949 --rc geninfo_unexecuted_blocks=1 00:19:32.949 00:19:32.949 ' 00:19:32.949 04:31:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:32.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.949 --rc genhtml_branch_coverage=1 00:19:32.949 --rc genhtml_function_coverage=1 00:19:32.949 --rc genhtml_legend=1 00:19:32.949 --rc geninfo_all_blocks=1 00:19:32.949 --rc geninfo_unexecuted_blocks=1 00:19:32.949 00:19:32.950 ' 00:19:32.950 04:31:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:32.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.950 --rc genhtml_branch_coverage=1 00:19:32.950 --rc genhtml_function_coverage=1 00:19:32.950 --rc genhtml_legend=1 00:19:32.950 --rc geninfo_all_blocks=1 00:19:32.950 --rc geninfo_unexecuted_blocks=1 00:19:32.950 00:19:32.950 ' 00:19:32.950 04:31:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:32.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.950 --rc genhtml_branch_coverage=1 00:19:32.950 --rc genhtml_function_coverage=1 00:19:32.950 --rc genhtml_legend=1 00:19:32.950 --rc geninfo_all_blocks=1 00:19:32.950 --rc geninfo_unexecuted_blocks=1 00:19:32.950 00:19:32.950 ' 00:19:32.950 04:31:11 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:32.950 04:31:11 -- nvmf/common.sh@7 -- # uname -s 00:19:32.950 04:31:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:32.950 04:31:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:32.950 04:31:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:32.950 04:31:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:32.950 04:31:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:32.950 04:31:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:32.950 04:31:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:32.950 04:31:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:32.950 04:31:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:32.950 04:31:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:32.950 04:31:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:32.950 04:31:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:32.950 04:31:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:32.950 04:31:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:32.950 04:31:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:32.950 04:31:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:32.950 04:31:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:32.950 04:31:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:32.950 04:31:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:32.950 04:31:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.950 04:31:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.950 04:31:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.950 04:31:11 -- paths/export.sh@5 -- # export PATH 00:19:32.950 04:31:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.950 04:31:11 -- nvmf/common.sh@46 -- # : 0 00:19:32.950 04:31:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:32.950 04:31:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:32.950 04:31:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:32.950 04:31:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:32.950 04:31:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:32.950 04:31:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:32.950 04:31:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:32.950 04:31:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:32.950 04:31:11 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:32.950 04:31:11 -- target/tls.sh@71 -- # nvmftestinit 00:19:32.950 04:31:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:32.950 04:31:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:32.950 04:31:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:32.950 04:31:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:32.950 04:31:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:32.950 04:31:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:32.950 04:31:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:32.950 04:31:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.950 04:31:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:32.950 04:31:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:32.950 04:31:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:32.950 04:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:34.853 04:31:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:34.853 04:31:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:34.853 04:31:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:34.853 04:31:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:34.853 04:31:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:34.853 04:31:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:34.853 04:31:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:34.853 04:31:13 -- nvmf/common.sh@294 -- # net_devs=() 00:19:34.853 04:31:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:34.853 04:31:13 -- nvmf/common.sh@295 -- # e810=() 00:19:34.853 04:31:13 -- nvmf/common.sh@295 -- # local -ga e810 00:19:34.853 04:31:13 -- nvmf/common.sh@296 -- # x722=() 00:19:34.853 04:31:13 -- nvmf/common.sh@296 -- # local -ga x722 00:19:34.853 04:31:13 -- nvmf/common.sh@297 -- # mlx=() 00:19:34.853 04:31:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:34.853 04:31:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:34.853 04:31:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:34.853 04:31:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:34.853 04:31:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:34.853 04:31:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:34.853 04:31:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:34.853 04:31:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:34.853 04:31:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:34.853 04:31:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:34.853 04:31:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:34.853 04:31:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:34.853 04:31:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:34.853 04:31:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:34.853 04:31:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:34.853 04:31:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:34.853 04:31:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:34.853 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:34.853 04:31:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:34.853 04:31:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:34.853 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:34.853 04:31:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:34.853 04:31:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:34.853 04:31:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:34.853 04:31:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:34.853 04:31:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:34.853 04:31:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:34.853 04:31:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:34.853 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:34.853 04:31:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:34.853 04:31:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:34.853 04:31:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:34.853 04:31:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:34.853 04:31:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:34.853 04:31:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:34.853 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:34.853 04:31:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:34.853 04:31:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:34.853 04:31:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:34.854 04:31:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:34.854 04:31:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:34.854 04:31:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:34.854 04:31:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:34.854 04:31:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:34.854 04:31:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:34.854 04:31:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:34.854 04:31:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:34.854 04:31:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:34.854 04:31:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:34.854 04:31:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:34.854 04:31:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:34.854 04:31:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:34.854 04:31:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:34.854 04:31:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:34.854 04:31:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:34.854 04:31:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:34.854 04:31:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:34.854 04:31:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:34.854 04:31:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:34.854 04:31:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:34.854 04:31:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:34.854 04:31:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:34.854 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:34.854 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.335 ms 00:19:34.854 00:19:34.854 --- 10.0.0.2 ping statistics --- 00:19:34.854 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:34.854 rtt min/avg/max/mdev = 0.335/0.335/0.335/0.000 ms 00:19:34.854 04:31:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:34.854 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:34.854 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:19:34.854 00:19:34.854 --- 10.0.0.1 ping statistics --- 00:19:34.854 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:34.854 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:19:34.854 04:31:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:34.854 04:31:13 -- nvmf/common.sh@410 -- # return 0 00:19:34.854 04:31:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:34.854 04:31:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:34.854 04:31:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:34.854 04:31:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:34.854 04:31:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:34.854 04:31:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:34.854 04:31:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:34.854 04:31:13 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:19:34.854 04:31:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:34.854 04:31:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:34.854 04:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:34.854 04:31:13 -- nvmf/common.sh@469 -- # nvmfpid=2938261 00:19:34.854 04:31:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:19:34.854 04:31:13 -- nvmf/common.sh@470 -- # waitforlisten 2938261 00:19:34.854 04:31:13 -- common/autotest_common.sh@829 -- # '[' -z 2938261 ']' 00:19:34.854 04:31:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:34.854 04:31:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:34.854 04:31:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:34.854 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:34.854 04:31:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:34.854 04:31:13 -- common/autotest_common.sh@10 -- # set +x 00:19:34.854 [2024-11-26 04:31:13.918277] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:34.854 [2024-11-26 04:31:13.918360] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:34.854 EAL: No free 2048 kB hugepages reported on node 1 00:19:34.854 [2024-11-26 04:31:13.993535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:35.113 [2024-11-26 04:31:14.082030] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:35.113 [2024-11-26 04:31:14.082214] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:35.113 [2024-11-26 04:31:14.082234] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:35.113 [2024-11-26 04:31:14.082249] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:35.113 [2024-11-26 04:31:14.082280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:35.113 04:31:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:35.113 04:31:14 -- common/autotest_common.sh@862 -- # return 0 00:19:35.113 04:31:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:35.113 04:31:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:35.113 04:31:14 -- common/autotest_common.sh@10 -- # set +x 00:19:35.113 04:31:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:35.113 04:31:14 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:19:35.113 04:31:14 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:19:35.370 true 00:19:35.370 04:31:14 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:35.370 04:31:14 -- target/tls.sh@82 -- # jq -r .tls_version 00:19:35.628 04:31:14 -- target/tls.sh@82 -- # version=0 00:19:35.628 04:31:14 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:19:35.628 04:31:14 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:35.886 04:31:14 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:35.886 04:31:14 -- target/tls.sh@90 -- # jq -r .tls_version 00:19:36.145 04:31:15 -- target/tls.sh@90 -- # version=13 00:19:36.145 04:31:15 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:19:36.145 04:31:15 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:19:36.404 04:31:15 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:36.404 04:31:15 -- target/tls.sh@98 -- # jq -r .tls_version 00:19:36.663 04:31:15 -- target/tls.sh@98 -- # version=7 00:19:36.663 04:31:15 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:19:36.663 04:31:15 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:36.663 04:31:15 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:19:36.921 04:31:16 -- target/tls.sh@105 -- # ktls=false 00:19:36.921 04:31:16 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:19:36.921 04:31:16 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:19:37.179 04:31:16 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:37.179 04:31:16 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:19:37.437 04:31:16 -- target/tls.sh@113 -- # ktls=true 00:19:37.437 04:31:16 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:19:37.437 04:31:16 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:19:37.695 04:31:16 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:37.695 04:31:16 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:19:37.954 04:31:17 -- target/tls.sh@121 -- # ktls=false 00:19:37.954 04:31:17 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:19:37.954 04:31:17 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:19:37.954 04:31:17 -- target/tls.sh@49 -- # local key hash crc 00:19:37.954 04:31:17 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:19:37.954 04:31:17 -- target/tls.sh@51 -- # hash=01 00:19:37.954 04:31:17 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:19:37.954 04:31:17 -- target/tls.sh@52 -- # gzip -1 -c 00:19:37.954 04:31:17 -- target/tls.sh@52 -- # tail -c8 00:19:37.954 04:31:17 -- target/tls.sh@52 -- # head -c 4 00:19:37.954 04:31:17 -- target/tls.sh@52 -- # crc='p$H�' 00:19:37.954 04:31:17 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:37.954 04:31:17 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:19:37.954 04:31:17 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:37.954 04:31:17 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:37.954 04:31:17 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:19:37.954 04:31:17 -- target/tls.sh@49 -- # local key hash crc 00:19:37.954 04:31:17 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:19:37.954 04:31:17 -- target/tls.sh@51 -- # hash=01 00:19:37.954 04:31:17 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:19:37.954 04:31:17 -- target/tls.sh@52 -- # gzip -1 -c 00:19:37.954 04:31:17 -- target/tls.sh@52 -- # head -c 4 00:19:37.954 04:31:17 -- target/tls.sh@52 -- # tail -c8 00:19:37.954 04:31:17 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:19:37.954 04:31:17 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:37.954 04:31:17 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:19:37.954 04:31:17 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:37.954 04:31:17 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:37.954 04:31:17 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:37.954 04:31:17 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:37.954 04:31:17 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:37.954 04:31:17 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:37.954 04:31:17 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:37.954 04:31:17 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:37.954 04:31:17 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:38.212 04:31:17 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:19:38.469 04:31:17 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:38.470 04:31:17 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:38.470 04:31:17 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:38.769 [2024-11-26 04:31:17.933956] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:38.769 04:31:17 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:39.062 04:31:18 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:39.320 [2024-11-26 04:31:18.451372] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:39.320 [2024-11-26 04:31:18.451630] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:39.320 04:31:18 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:39.578 malloc0 00:19:39.578 04:31:18 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:39.837 04:31:18 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:40.095 04:31:19 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:40.095 EAL: No free 2048 kB hugepages reported on node 1 00:19:52.309 Initializing NVMe Controllers 00:19:52.309 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:52.309 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:52.309 Initialization complete. Launching workers. 00:19:52.309 ======================================================== 00:19:52.309 Latency(us) 00:19:52.309 Device Information : IOPS MiB/s Average min max 00:19:52.309 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7875.89 30.77 8128.68 1180.53 10661.53 00:19:52.309 ======================================================== 00:19:52.309 Total : 7875.89 30.77 8128.68 1180.53 10661.53 00:19:52.309 00:19:52.309 04:31:29 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:52.309 04:31:29 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:52.310 04:31:29 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:52.310 04:31:29 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:52.310 04:31:29 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:19:52.310 04:31:29 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:52.310 04:31:29 -- target/tls.sh@28 -- # bdevperf_pid=2940100 00:19:52.310 04:31:29 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:52.310 04:31:29 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:52.310 04:31:29 -- target/tls.sh@31 -- # waitforlisten 2940100 /var/tmp/bdevperf.sock 00:19:52.310 04:31:29 -- common/autotest_common.sh@829 -- # '[' -z 2940100 ']' 00:19:52.310 04:31:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:52.310 04:31:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:52.310 04:31:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:52.310 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:52.310 04:31:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:52.310 04:31:29 -- common/autotest_common.sh@10 -- # set +x 00:19:52.310 [2024-11-26 04:31:29.349608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:52.310 [2024-11-26 04:31:29.349703] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2940100 ] 00:19:52.310 EAL: No free 2048 kB hugepages reported on node 1 00:19:52.310 [2024-11-26 04:31:29.410444] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:52.310 [2024-11-26 04:31:29.492002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:52.310 04:31:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:52.310 04:31:30 -- common/autotest_common.sh@862 -- # return 0 00:19:52.310 04:31:30 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:52.310 [2024-11-26 04:31:30.614623] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:52.310 TLSTESTn1 00:19:52.310 04:31:30 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:19:52.310 Running I/O for 10 seconds... 00:20:02.299 00:20:02.299 Latency(us) 00:20:02.299 [2024-11-26T03:31:41.525Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:02.299 [2024-11-26T03:31:41.525Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:02.299 Verification LBA range: start 0x0 length 0x2000 00:20:02.299 TLSTESTn1 : 10.01 4455.42 17.40 0.00 0.00 28696.06 4781.70 45049.93 00:20:02.299 [2024-11-26T03:31:41.525Z] =================================================================================================================== 00:20:02.299 [2024-11-26T03:31:41.525Z] Total : 4455.42 17.40 0.00 0.00 28696.06 4781.70 45049.93 00:20:02.299 0 00:20:02.299 04:31:40 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:02.299 04:31:40 -- target/tls.sh@45 -- # killprocess 2940100 00:20:02.299 04:31:40 -- common/autotest_common.sh@936 -- # '[' -z 2940100 ']' 00:20:02.299 04:31:40 -- common/autotest_common.sh@940 -- # kill -0 2940100 00:20:02.299 04:31:40 -- common/autotest_common.sh@941 -- # uname 00:20:02.299 04:31:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:02.299 04:31:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2940100 00:20:02.299 04:31:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:02.299 04:31:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:02.299 04:31:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2940100' 00:20:02.299 killing process with pid 2940100 00:20:02.299 04:31:40 -- common/autotest_common.sh@955 -- # kill 2940100 00:20:02.299 Received shutdown signal, test time was about 10.000000 seconds 00:20:02.299 00:20:02.299 Latency(us) 00:20:02.299 [2024-11-26T03:31:41.525Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:02.299 [2024-11-26T03:31:41.525Z] =================================================================================================================== 00:20:02.299 [2024-11-26T03:31:41.525Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:02.299 04:31:40 -- common/autotest_common.sh@960 -- # wait 2940100 00:20:02.299 04:31:41 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:02.299 04:31:41 -- common/autotest_common.sh@650 -- # local es=0 00:20:02.299 04:31:41 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:02.299 04:31:41 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:02.299 04:31:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:02.299 04:31:41 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:02.299 04:31:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:02.299 04:31:41 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:02.299 04:31:41 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:02.299 04:31:41 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:02.299 04:31:41 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:02.299 04:31:41 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:02.299 04:31:41 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:02.299 04:31:41 -- target/tls.sh@28 -- # bdevperf_pid=2941588 00:20:02.299 04:31:41 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:02.299 04:31:41 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:02.299 04:31:41 -- target/tls.sh@31 -- # waitforlisten 2941588 /var/tmp/bdevperf.sock 00:20:02.299 04:31:41 -- common/autotest_common.sh@829 -- # '[' -z 2941588 ']' 00:20:02.299 04:31:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:02.299 04:31:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:02.299 04:31:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:02.299 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:02.299 04:31:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:02.299 04:31:41 -- common/autotest_common.sh@10 -- # set +x 00:20:02.299 [2024-11-26 04:31:41.147603] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:02.299 [2024-11-26 04:31:41.147704] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941588 ] 00:20:02.299 EAL: No free 2048 kB hugepages reported on node 1 00:20:02.299 [2024-11-26 04:31:41.205214] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:02.299 [2024-11-26 04:31:41.286580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:02.299 04:31:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:02.299 04:31:41 -- common/autotest_common.sh@862 -- # return 0 00:20:02.299 04:31:41 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:02.560 [2024-11-26 04:31:41.651567] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:02.560 [2024-11-26 04:31:41.659937] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:02.560 [2024-11-26 04:31:41.660153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5ab840 (107): Transport endpoint is not connected 00:20:02.560 [2024-11-26 04:31:41.661143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5ab840 (9): Bad file descriptor 00:20:02.560 [2024-11-26 04:31:41.662142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:02.560 [2024-11-26 04:31:41.662162] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:02.560 [2024-11-26 04:31:41.662175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:02.560 request: 00:20:02.560 { 00:20:02.560 "name": "TLSTEST", 00:20:02.560 "trtype": "tcp", 00:20:02.560 "traddr": "10.0.0.2", 00:20:02.560 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:02.560 "adrfam": "ipv4", 00:20:02.560 "trsvcid": "4420", 00:20:02.560 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:02.560 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:02.560 "method": "bdev_nvme_attach_controller", 00:20:02.560 "req_id": 1 00:20:02.560 } 00:20:02.560 Got JSON-RPC error response 00:20:02.560 response: 00:20:02.560 { 00:20:02.560 "code": -32602, 00:20:02.560 "message": "Invalid parameters" 00:20:02.560 } 00:20:02.560 04:31:41 -- target/tls.sh@36 -- # killprocess 2941588 00:20:02.560 04:31:41 -- common/autotest_common.sh@936 -- # '[' -z 2941588 ']' 00:20:02.560 04:31:41 -- common/autotest_common.sh@940 -- # kill -0 2941588 00:20:02.560 04:31:41 -- common/autotest_common.sh@941 -- # uname 00:20:02.560 04:31:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:02.560 04:31:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2941588 00:20:02.560 04:31:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:02.560 04:31:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:02.560 04:31:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2941588' 00:20:02.560 killing process with pid 2941588 00:20:02.560 04:31:41 -- common/autotest_common.sh@955 -- # kill 2941588 00:20:02.560 Received shutdown signal, test time was about 10.000000 seconds 00:20:02.560 00:20:02.560 Latency(us) 00:20:02.560 [2024-11-26T03:31:41.786Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:02.560 [2024-11-26T03:31:41.786Z] =================================================================================================================== 00:20:02.560 [2024-11-26T03:31:41.786Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:02.560 04:31:41 -- common/autotest_common.sh@960 -- # wait 2941588 00:20:02.820 04:31:41 -- target/tls.sh@37 -- # return 1 00:20:02.820 04:31:41 -- common/autotest_common.sh@653 -- # es=1 00:20:02.820 04:31:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:02.820 04:31:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:02.820 04:31:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:02.820 04:31:41 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:02.820 04:31:41 -- common/autotest_common.sh@650 -- # local es=0 00:20:02.820 04:31:41 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:02.820 04:31:41 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:02.820 04:31:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:02.820 04:31:41 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:02.820 04:31:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:02.820 04:31:41 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:02.820 04:31:41 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:02.820 04:31:41 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:02.820 04:31:41 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:02.820 04:31:41 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:02.820 04:31:41 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:02.820 04:31:41 -- target/tls.sh@28 -- # bdevperf_pid=2941609 00:20:02.820 04:31:41 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:02.820 04:31:41 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:02.820 04:31:41 -- target/tls.sh@31 -- # waitforlisten 2941609 /var/tmp/bdevperf.sock 00:20:02.820 04:31:41 -- common/autotest_common.sh@829 -- # '[' -z 2941609 ']' 00:20:02.820 04:31:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:02.820 04:31:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:02.820 04:31:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:02.820 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:02.820 04:31:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:02.820 04:31:41 -- common/autotest_common.sh@10 -- # set +x 00:20:02.820 [2024-11-26 04:31:41.986336] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:02.820 [2024-11-26 04:31:41.986424] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941609 ] 00:20:02.820 EAL: No free 2048 kB hugepages reported on node 1 00:20:03.078 [2024-11-26 04:31:42.046373] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:03.078 [2024-11-26 04:31:42.137269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:04.013 04:31:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:04.013 04:31:42 -- common/autotest_common.sh@862 -- # return 0 00:20:04.013 04:31:42 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:04.013 [2024-11-26 04:31:43.206112] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:04.013 [2024-11-26 04:31:43.213859] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:04.013 [2024-11-26 04:31:43.213890] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:04.013 [2024-11-26 04:31:43.213926] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:04.013 [2024-11-26 04:31:43.214929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c0840 (107): Transport endpoint is not connected 00:20:04.013 [2024-11-26 04:31:43.215916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c0840 (9): Bad file descriptor 00:20:04.013 [2024-11-26 04:31:43.216915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:04.013 [2024-11-26 04:31:43.216934] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:04.013 [2024-11-26 04:31:43.216946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:04.013 request: 00:20:04.013 { 00:20:04.013 "name": "TLSTEST", 00:20:04.013 "trtype": "tcp", 00:20:04.013 "traddr": "10.0.0.2", 00:20:04.013 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:04.013 "adrfam": "ipv4", 00:20:04.013 "trsvcid": "4420", 00:20:04.013 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:04.013 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:04.013 "method": "bdev_nvme_attach_controller", 00:20:04.013 "req_id": 1 00:20:04.013 } 00:20:04.013 Got JSON-RPC error response 00:20:04.013 response: 00:20:04.013 { 00:20:04.013 "code": -32602, 00:20:04.013 "message": "Invalid parameters" 00:20:04.013 } 00:20:04.013 04:31:43 -- target/tls.sh@36 -- # killprocess 2941609 00:20:04.013 04:31:43 -- common/autotest_common.sh@936 -- # '[' -z 2941609 ']' 00:20:04.013 04:31:43 -- common/autotest_common.sh@940 -- # kill -0 2941609 00:20:04.013 04:31:43 -- common/autotest_common.sh@941 -- # uname 00:20:04.273 04:31:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:04.273 04:31:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2941609 00:20:04.273 04:31:43 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:04.273 04:31:43 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:04.273 04:31:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2941609' 00:20:04.273 killing process with pid 2941609 00:20:04.273 04:31:43 -- common/autotest_common.sh@955 -- # kill 2941609 00:20:04.273 Received shutdown signal, test time was about 10.000000 seconds 00:20:04.273 00:20:04.273 Latency(us) 00:20:04.273 [2024-11-26T03:31:43.499Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:04.273 [2024-11-26T03:31:43.499Z] =================================================================================================================== 00:20:04.273 [2024-11-26T03:31:43.499Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:04.273 04:31:43 -- common/autotest_common.sh@960 -- # wait 2941609 00:20:04.532 04:31:43 -- target/tls.sh@37 -- # return 1 00:20:04.532 04:31:43 -- common/autotest_common.sh@653 -- # es=1 00:20:04.532 04:31:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:04.532 04:31:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:04.532 04:31:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:04.532 04:31:43 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:04.532 04:31:43 -- common/autotest_common.sh@650 -- # local es=0 00:20:04.532 04:31:43 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:04.532 04:31:43 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:04.532 04:31:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:04.532 04:31:43 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:04.532 04:31:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:04.532 04:31:43 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:04.532 04:31:43 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:04.532 04:31:43 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:04.532 04:31:43 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:04.532 04:31:43 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:04.532 04:31:43 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:04.532 04:31:43 -- target/tls.sh@28 -- # bdevperf_pid=2941876 00:20:04.532 04:31:43 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:04.532 04:31:43 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:04.532 04:31:43 -- target/tls.sh@31 -- # waitforlisten 2941876 /var/tmp/bdevperf.sock 00:20:04.532 04:31:43 -- common/autotest_common.sh@829 -- # '[' -z 2941876 ']' 00:20:04.532 04:31:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:04.532 04:31:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:04.532 04:31:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:04.532 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:04.532 04:31:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:04.533 04:31:43 -- common/autotest_common.sh@10 -- # set +x 00:20:04.533 [2024-11-26 04:31:43.544207] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:04.533 [2024-11-26 04:31:43.544294] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941876 ] 00:20:04.533 EAL: No free 2048 kB hugepages reported on node 1 00:20:04.533 [2024-11-26 04:31:43.601525] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:04.533 [2024-11-26 04:31:43.684251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:05.467 04:31:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:05.467 04:31:44 -- common/autotest_common.sh@862 -- # return 0 00:20:05.467 04:31:44 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:05.726 [2024-11-26 04:31:44.749394] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:05.726 [2024-11-26 04:31:44.757879] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:05.726 [2024-11-26 04:31:44.757911] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:05.726 [2024-11-26 04:31:44.757963] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:05.726 [2024-11-26 04:31:44.758141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1515840 (107): Transport endpoint is not connected 00:20:05.726 [2024-11-26 04:31:44.759130] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1515840 (9): Bad file descriptor 00:20:05.726 [2024-11-26 04:31:44.760129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:05.726 [2024-11-26 04:31:44.760148] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:05.726 [2024-11-26 04:31:44.760161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:05.726 request: 00:20:05.726 { 00:20:05.726 "name": "TLSTEST", 00:20:05.726 "trtype": "tcp", 00:20:05.726 "traddr": "10.0.0.2", 00:20:05.726 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:05.726 "adrfam": "ipv4", 00:20:05.726 "trsvcid": "4420", 00:20:05.726 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:05.726 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:05.727 "method": "bdev_nvme_attach_controller", 00:20:05.727 "req_id": 1 00:20:05.727 } 00:20:05.727 Got JSON-RPC error response 00:20:05.727 response: 00:20:05.727 { 00:20:05.727 "code": -32602, 00:20:05.727 "message": "Invalid parameters" 00:20:05.727 } 00:20:05.727 04:31:44 -- target/tls.sh@36 -- # killprocess 2941876 00:20:05.727 04:31:44 -- common/autotest_common.sh@936 -- # '[' -z 2941876 ']' 00:20:05.727 04:31:44 -- common/autotest_common.sh@940 -- # kill -0 2941876 00:20:05.727 04:31:44 -- common/autotest_common.sh@941 -- # uname 00:20:05.727 04:31:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:05.727 04:31:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2941876 00:20:05.727 04:31:44 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:05.727 04:31:44 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:05.727 04:31:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2941876' 00:20:05.727 killing process with pid 2941876 00:20:05.727 04:31:44 -- common/autotest_common.sh@955 -- # kill 2941876 00:20:05.727 Received shutdown signal, test time was about 10.000000 seconds 00:20:05.727 00:20:05.727 Latency(us) 00:20:05.727 [2024-11-26T03:31:44.953Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:05.727 [2024-11-26T03:31:44.953Z] =================================================================================================================== 00:20:05.727 [2024-11-26T03:31:44.953Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:05.727 04:31:44 -- common/autotest_common.sh@960 -- # wait 2941876 00:20:05.985 04:31:45 -- target/tls.sh@37 -- # return 1 00:20:05.985 04:31:45 -- common/autotest_common.sh@653 -- # es=1 00:20:05.985 04:31:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:05.985 04:31:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:05.985 04:31:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:05.985 04:31:45 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:05.985 04:31:45 -- common/autotest_common.sh@650 -- # local es=0 00:20:05.985 04:31:45 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:05.985 04:31:45 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:05.985 04:31:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:05.985 04:31:45 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:05.985 04:31:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:05.985 04:31:45 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:05.985 04:31:45 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:05.985 04:31:45 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:05.985 04:31:45 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:05.985 04:31:45 -- target/tls.sh@23 -- # psk= 00:20:05.985 04:31:45 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:05.985 04:31:45 -- target/tls.sh@28 -- # bdevperf_pid=2942035 00:20:05.985 04:31:45 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:05.985 04:31:45 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:05.985 04:31:45 -- target/tls.sh@31 -- # waitforlisten 2942035 /var/tmp/bdevperf.sock 00:20:05.985 04:31:45 -- common/autotest_common.sh@829 -- # '[' -z 2942035 ']' 00:20:05.985 04:31:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:05.985 04:31:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:05.985 04:31:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:05.985 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:05.985 04:31:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:05.985 04:31:45 -- common/autotest_common.sh@10 -- # set +x 00:20:05.985 [2024-11-26 04:31:45.070911] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:05.985 [2024-11-26 04:31:45.070998] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942035 ] 00:20:05.985 EAL: No free 2048 kB hugepages reported on node 1 00:20:05.985 [2024-11-26 04:31:45.128178] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:06.244 [2024-11-26 04:31:45.209785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:07.182 04:31:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:07.182 04:31:46 -- common/autotest_common.sh@862 -- # return 0 00:20:07.182 04:31:46 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:07.182 [2024-11-26 04:31:46.282078] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:07.182 [2024-11-26 04:31:46.283953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x217add0 (9): Bad file descriptor 00:20:07.182 [2024-11-26 04:31:46.284948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:07.183 [2024-11-26 04:31:46.284979] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:07.183 [2024-11-26 04:31:46.285007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:07.183 request: 00:20:07.183 { 00:20:07.183 "name": "TLSTEST", 00:20:07.183 "trtype": "tcp", 00:20:07.183 "traddr": "10.0.0.2", 00:20:07.183 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:07.183 "adrfam": "ipv4", 00:20:07.183 "trsvcid": "4420", 00:20:07.183 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:07.183 "method": "bdev_nvme_attach_controller", 00:20:07.183 "req_id": 1 00:20:07.183 } 00:20:07.183 Got JSON-RPC error response 00:20:07.183 response: 00:20:07.183 { 00:20:07.183 "code": -32602, 00:20:07.183 "message": "Invalid parameters" 00:20:07.183 } 00:20:07.183 04:31:46 -- target/tls.sh@36 -- # killprocess 2942035 00:20:07.183 04:31:46 -- common/autotest_common.sh@936 -- # '[' -z 2942035 ']' 00:20:07.183 04:31:46 -- common/autotest_common.sh@940 -- # kill -0 2942035 00:20:07.183 04:31:46 -- common/autotest_common.sh@941 -- # uname 00:20:07.183 04:31:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:07.183 04:31:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2942035 00:20:07.183 04:31:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:07.183 04:31:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:07.183 04:31:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2942035' 00:20:07.183 killing process with pid 2942035 00:20:07.183 04:31:46 -- common/autotest_common.sh@955 -- # kill 2942035 00:20:07.183 Received shutdown signal, test time was about 10.000000 seconds 00:20:07.183 00:20:07.183 Latency(us) 00:20:07.183 [2024-11-26T03:31:46.409Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:07.183 [2024-11-26T03:31:46.409Z] =================================================================================================================== 00:20:07.183 [2024-11-26T03:31:46.409Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:07.183 04:31:46 -- common/autotest_common.sh@960 -- # wait 2942035 00:20:07.443 04:31:46 -- target/tls.sh@37 -- # return 1 00:20:07.443 04:31:46 -- common/autotest_common.sh@653 -- # es=1 00:20:07.443 04:31:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:07.443 04:31:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:07.443 04:31:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:07.443 04:31:46 -- target/tls.sh@167 -- # killprocess 2938261 00:20:07.443 04:31:46 -- common/autotest_common.sh@936 -- # '[' -z 2938261 ']' 00:20:07.443 04:31:46 -- common/autotest_common.sh@940 -- # kill -0 2938261 00:20:07.443 04:31:46 -- common/autotest_common.sh@941 -- # uname 00:20:07.443 04:31:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:07.443 04:31:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2938261 00:20:07.443 04:31:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:07.443 04:31:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:07.443 04:31:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2938261' 00:20:07.443 killing process with pid 2938261 00:20:07.443 04:31:46 -- common/autotest_common.sh@955 -- # kill 2938261 00:20:07.443 04:31:46 -- common/autotest_common.sh@960 -- # wait 2938261 00:20:07.702 04:31:46 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:07.702 04:31:46 -- target/tls.sh@49 -- # local key hash crc 00:20:07.702 04:31:46 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:07.702 04:31:46 -- target/tls.sh@51 -- # hash=02 00:20:07.702 04:31:46 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:07.702 04:31:46 -- target/tls.sh@52 -- # gzip -1 -c 00:20:07.702 04:31:46 -- target/tls.sh@52 -- # tail -c8 00:20:07.702 04:31:46 -- target/tls.sh@52 -- # head -c 4 00:20:07.702 04:31:46 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:07.702 04:31:46 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:07.702 04:31:46 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:07.702 04:31:46 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:07.702 04:31:46 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:07.702 04:31:46 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:07.702 04:31:46 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:07.702 04:31:46 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:07.702 04:31:46 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:07.702 04:31:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:07.702 04:31:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:07.702 04:31:46 -- common/autotest_common.sh@10 -- # set +x 00:20:07.702 04:31:46 -- nvmf/common.sh@469 -- # nvmfpid=2942325 00:20:07.702 04:31:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:07.702 04:31:46 -- nvmf/common.sh@470 -- # waitforlisten 2942325 00:20:07.703 04:31:46 -- common/autotest_common.sh@829 -- # '[' -z 2942325 ']' 00:20:07.703 04:31:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:07.703 04:31:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:07.703 04:31:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:07.703 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:07.703 04:31:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:07.703 04:31:46 -- common/autotest_common.sh@10 -- # set +x 00:20:07.703 [2024-11-26 04:31:46.915214] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:07.703 [2024-11-26 04:31:46.915298] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:07.961 EAL: No free 2048 kB hugepages reported on node 1 00:20:07.961 [2024-11-26 04:31:46.983723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:07.961 [2024-11-26 04:31:47.073235] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:07.961 [2024-11-26 04:31:47.073367] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:07.961 [2024-11-26 04:31:47.073384] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:07.961 [2024-11-26 04:31:47.073396] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:07.961 [2024-11-26 04:31:47.073421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:08.898 04:31:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:08.898 04:31:47 -- common/autotest_common.sh@862 -- # return 0 00:20:08.898 04:31:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:08.898 04:31:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:08.898 04:31:47 -- common/autotest_common.sh@10 -- # set +x 00:20:08.898 04:31:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:08.898 04:31:47 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:08.898 04:31:47 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:08.898 04:31:47 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:09.156 [2024-11-26 04:31:48.227881] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:09.156 04:31:48 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:09.414 04:31:48 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:09.672 [2024-11-26 04:31:48.741248] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:09.672 [2024-11-26 04:31:48.741522] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:09.672 04:31:48 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:09.931 malloc0 00:20:09.931 04:31:49 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:10.188 04:31:49 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:10.446 04:31:49 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:10.446 04:31:49 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:10.446 04:31:49 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:10.446 04:31:49 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:10.446 04:31:49 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:10.446 04:31:49 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:10.446 04:31:49 -- target/tls.sh@28 -- # bdevperf_pid=2942625 00:20:10.446 04:31:49 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:10.446 04:31:49 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:10.446 04:31:49 -- target/tls.sh@31 -- # waitforlisten 2942625 /var/tmp/bdevperf.sock 00:20:10.446 04:31:49 -- common/autotest_common.sh@829 -- # '[' -z 2942625 ']' 00:20:10.446 04:31:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:10.446 04:31:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:10.446 04:31:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:10.446 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:10.446 04:31:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:10.446 04:31:49 -- common/autotest_common.sh@10 -- # set +x 00:20:10.446 [2024-11-26 04:31:49.565860] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:10.446 [2024-11-26 04:31:49.565945] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942625 ] 00:20:10.446 EAL: No free 2048 kB hugepages reported on node 1 00:20:10.446 [2024-11-26 04:31:49.624295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:10.706 [2024-11-26 04:31:49.705882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:11.643 04:31:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:11.643 04:31:50 -- common/autotest_common.sh@862 -- # return 0 00:20:11.643 04:31:50 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:11.643 [2024-11-26 04:31:50.756949] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:11.643 TLSTESTn1 00:20:11.643 04:31:50 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:11.901 Running I/O for 10 seconds... 00:20:21.889 00:20:21.889 Latency(us) 00:20:21.889 [2024-11-26T03:32:01.115Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:21.889 [2024-11-26T03:32:01.115Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:21.889 Verification LBA range: start 0x0 length 0x2000 00:20:21.889 TLSTESTn1 : 10.02 3796.82 14.83 0.00 0.00 33664.31 6456.51 42137.22 00:20:21.889 [2024-11-26T03:32:01.115Z] =================================================================================================================== 00:20:21.889 [2024-11-26T03:32:01.115Z] Total : 3796.82 14.83 0.00 0.00 33664.31 6456.51 42137.22 00:20:21.889 0 00:20:21.889 04:32:01 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:21.889 04:32:01 -- target/tls.sh@45 -- # killprocess 2942625 00:20:21.889 04:32:01 -- common/autotest_common.sh@936 -- # '[' -z 2942625 ']' 00:20:21.889 04:32:01 -- common/autotest_common.sh@940 -- # kill -0 2942625 00:20:21.889 04:32:01 -- common/autotest_common.sh@941 -- # uname 00:20:21.889 04:32:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:21.889 04:32:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2942625 00:20:21.889 04:32:01 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:21.889 04:32:01 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:21.889 04:32:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2942625' 00:20:21.889 killing process with pid 2942625 00:20:21.889 04:32:01 -- common/autotest_common.sh@955 -- # kill 2942625 00:20:21.889 Received shutdown signal, test time was about 10.000000 seconds 00:20:21.889 00:20:21.889 Latency(us) 00:20:21.889 [2024-11-26T03:32:01.115Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:21.889 [2024-11-26T03:32:01.115Z] =================================================================================================================== 00:20:21.889 [2024-11-26T03:32:01.115Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:21.889 04:32:01 -- common/autotest_common.sh@960 -- # wait 2942625 00:20:22.147 04:32:01 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:22.147 04:32:01 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:22.147 04:32:01 -- common/autotest_common.sh@650 -- # local es=0 00:20:22.147 04:32:01 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:22.147 04:32:01 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:22.147 04:32:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:22.147 04:32:01 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:22.147 04:32:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:22.147 04:32:01 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:22.147 04:32:01 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:22.147 04:32:01 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:22.147 04:32:01 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:22.147 04:32:01 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:22.147 04:32:01 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:22.147 04:32:01 -- target/tls.sh@28 -- # bdevperf_pid=2943997 00:20:22.147 04:32:01 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:22.147 04:32:01 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:22.147 04:32:01 -- target/tls.sh@31 -- # waitforlisten 2943997 /var/tmp/bdevperf.sock 00:20:22.147 04:32:01 -- common/autotest_common.sh@829 -- # '[' -z 2943997 ']' 00:20:22.147 04:32:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:22.147 04:32:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:22.147 04:32:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:22.147 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:22.147 04:32:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:22.147 04:32:01 -- common/autotest_common.sh@10 -- # set +x 00:20:22.147 [2024-11-26 04:32:01.307735] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:22.147 [2024-11-26 04:32:01.307827] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2943997 ] 00:20:22.147 EAL: No free 2048 kB hugepages reported on node 1 00:20:22.405 [2024-11-26 04:32:01.370713] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:22.405 [2024-11-26 04:32:01.455364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:23.342 04:32:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:23.342 04:32:02 -- common/autotest_common.sh@862 -- # return 0 00:20:23.342 04:32:02 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:23.600 [2024-11-26 04:32:02.602867] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:23.600 [2024-11-26 04:32:02.602931] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:23.600 request: 00:20:23.600 { 00:20:23.600 "name": "TLSTEST", 00:20:23.600 "trtype": "tcp", 00:20:23.600 "traddr": "10.0.0.2", 00:20:23.600 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:23.600 "adrfam": "ipv4", 00:20:23.600 "trsvcid": "4420", 00:20:23.600 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:23.600 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:23.600 "method": "bdev_nvme_attach_controller", 00:20:23.600 "req_id": 1 00:20:23.600 } 00:20:23.600 Got JSON-RPC error response 00:20:23.600 response: 00:20:23.600 { 00:20:23.600 "code": -22, 00:20:23.600 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:23.600 } 00:20:23.600 04:32:02 -- target/tls.sh@36 -- # killprocess 2943997 00:20:23.600 04:32:02 -- common/autotest_common.sh@936 -- # '[' -z 2943997 ']' 00:20:23.600 04:32:02 -- common/autotest_common.sh@940 -- # kill -0 2943997 00:20:23.600 04:32:02 -- common/autotest_common.sh@941 -- # uname 00:20:23.600 04:32:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:23.600 04:32:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2943997 00:20:23.600 04:32:02 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:23.600 04:32:02 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:23.600 04:32:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2943997' 00:20:23.600 killing process with pid 2943997 00:20:23.600 04:32:02 -- common/autotest_common.sh@955 -- # kill 2943997 00:20:23.600 Received shutdown signal, test time was about 10.000000 seconds 00:20:23.600 00:20:23.600 Latency(us) 00:20:23.600 [2024-11-26T03:32:02.826Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:23.600 [2024-11-26T03:32:02.826Z] =================================================================================================================== 00:20:23.600 [2024-11-26T03:32:02.826Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:23.600 04:32:02 -- common/autotest_common.sh@960 -- # wait 2943997 00:20:23.858 04:32:02 -- target/tls.sh@37 -- # return 1 00:20:23.858 04:32:02 -- common/autotest_common.sh@653 -- # es=1 00:20:23.858 04:32:02 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:23.858 04:32:02 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:23.858 04:32:02 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:23.858 04:32:02 -- target/tls.sh@183 -- # killprocess 2942325 00:20:23.858 04:32:02 -- common/autotest_common.sh@936 -- # '[' -z 2942325 ']' 00:20:23.858 04:32:02 -- common/autotest_common.sh@940 -- # kill -0 2942325 00:20:23.858 04:32:02 -- common/autotest_common.sh@941 -- # uname 00:20:23.858 04:32:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:23.858 04:32:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2942325 00:20:23.858 04:32:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:23.858 04:32:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:23.858 04:32:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2942325' 00:20:23.858 killing process with pid 2942325 00:20:23.858 04:32:02 -- common/autotest_common.sh@955 -- # kill 2942325 00:20:23.858 04:32:02 -- common/autotest_common.sh@960 -- # wait 2942325 00:20:24.118 04:32:03 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:24.118 04:32:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:24.118 04:32:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:24.118 04:32:03 -- common/autotest_common.sh@10 -- # set +x 00:20:24.118 04:32:03 -- nvmf/common.sh@469 -- # nvmfpid=2944280 00:20:24.118 04:32:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:24.118 04:32:03 -- nvmf/common.sh@470 -- # waitforlisten 2944280 00:20:24.118 04:32:03 -- common/autotest_common.sh@829 -- # '[' -z 2944280 ']' 00:20:24.118 04:32:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:24.118 04:32:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:24.118 04:32:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:24.118 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:24.118 04:32:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:24.118 04:32:03 -- common/autotest_common.sh@10 -- # set +x 00:20:24.118 [2024-11-26 04:32:03.178323] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:24.118 [2024-11-26 04:32:03.178407] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:24.118 EAL: No free 2048 kB hugepages reported on node 1 00:20:24.118 [2024-11-26 04:32:03.240898] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:24.118 [2024-11-26 04:32:03.322832] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:24.118 [2024-11-26 04:32:03.323008] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:24.118 [2024-11-26 04:32:03.323026] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:24.118 [2024-11-26 04:32:03.323038] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:24.118 [2024-11-26 04:32:03.323081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:25.056 04:32:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:25.056 04:32:04 -- common/autotest_common.sh@862 -- # return 0 00:20:25.056 04:32:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:25.056 04:32:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:25.056 04:32:04 -- common/autotest_common.sh@10 -- # set +x 00:20:25.056 04:32:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:25.056 04:32:04 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:25.056 04:32:04 -- common/autotest_common.sh@650 -- # local es=0 00:20:25.056 04:32:04 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:25.056 04:32:04 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:25.056 04:32:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:25.056 04:32:04 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:25.056 04:32:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:25.056 04:32:04 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:25.056 04:32:04 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:25.056 04:32:04 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:25.315 [2024-11-26 04:32:04.413219] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:25.315 04:32:04 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:25.573 04:32:04 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:25.831 [2024-11-26 04:32:04.926601] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:25.831 [2024-11-26 04:32:04.926912] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:25.831 04:32:04 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:26.089 malloc0 00:20:26.089 04:32:05 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:26.347 04:32:05 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:26.605 [2024-11-26 04:32:05.680931] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:26.605 [2024-11-26 04:32:05.680979] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:26.605 [2024-11-26 04:32:05.681012] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:26.605 request: 00:20:26.605 { 00:20:26.605 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:26.605 "host": "nqn.2016-06.io.spdk:host1", 00:20:26.605 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:26.605 "method": "nvmf_subsystem_add_host", 00:20:26.605 "req_id": 1 00:20:26.605 } 00:20:26.605 Got JSON-RPC error response 00:20:26.605 response: 00:20:26.605 { 00:20:26.605 "code": -32603, 00:20:26.605 "message": "Internal error" 00:20:26.605 } 00:20:26.605 04:32:05 -- common/autotest_common.sh@653 -- # es=1 00:20:26.605 04:32:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:26.605 04:32:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:26.605 04:32:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:26.605 04:32:05 -- target/tls.sh@189 -- # killprocess 2944280 00:20:26.605 04:32:05 -- common/autotest_common.sh@936 -- # '[' -z 2944280 ']' 00:20:26.605 04:32:05 -- common/autotest_common.sh@940 -- # kill -0 2944280 00:20:26.605 04:32:05 -- common/autotest_common.sh@941 -- # uname 00:20:26.605 04:32:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:26.605 04:32:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2944280 00:20:26.605 04:32:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:26.605 04:32:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:26.605 04:32:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2944280' 00:20:26.605 killing process with pid 2944280 00:20:26.605 04:32:05 -- common/autotest_common.sh@955 -- # kill 2944280 00:20:26.605 04:32:05 -- common/autotest_common.sh@960 -- # wait 2944280 00:20:26.864 04:32:05 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:26.864 04:32:05 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:26.864 04:32:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:26.864 04:32:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:26.864 04:32:05 -- common/autotest_common.sh@10 -- # set +x 00:20:26.864 04:32:05 -- nvmf/common.sh@469 -- # nvmfpid=2944711 00:20:26.864 04:32:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:26.864 04:32:05 -- nvmf/common.sh@470 -- # waitforlisten 2944711 00:20:26.864 04:32:05 -- common/autotest_common.sh@829 -- # '[' -z 2944711 ']' 00:20:26.864 04:32:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:26.864 04:32:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:26.864 04:32:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:26.864 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:26.864 04:32:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:26.864 04:32:05 -- common/autotest_common.sh@10 -- # set +x 00:20:26.864 [2024-11-26 04:32:06.024703] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:26.864 [2024-11-26 04:32:06.024791] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:26.864 EAL: No free 2048 kB hugepages reported on node 1 00:20:27.122 [2024-11-26 04:32:06.091219] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:27.122 [2024-11-26 04:32:06.170164] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:27.122 [2024-11-26 04:32:06.170323] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:27.122 [2024-11-26 04:32:06.170341] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:27.122 [2024-11-26 04:32:06.170354] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:27.122 [2024-11-26 04:32:06.170379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:28.058 04:32:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:28.058 04:32:07 -- common/autotest_common.sh@862 -- # return 0 00:20:28.058 04:32:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:28.058 04:32:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:28.058 04:32:07 -- common/autotest_common.sh@10 -- # set +x 00:20:28.058 04:32:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:28.058 04:32:07 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:28.058 04:32:07 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:28.058 04:32:07 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:28.058 [2024-11-26 04:32:07.262553] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:28.058 04:32:07 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:28.318 04:32:07 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:28.576 [2024-11-26 04:32:07.763915] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:28.576 [2024-11-26 04:32:07.764215] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:28.576 04:32:07 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:28.835 malloc0 00:20:28.835 04:32:08 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:29.094 04:32:08 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:29.352 04:32:08 -- target/tls.sh@197 -- # bdevperf_pid=2945006 00:20:29.352 04:32:08 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:29.352 04:32:08 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:29.352 04:32:08 -- target/tls.sh@200 -- # waitforlisten 2945006 /var/tmp/bdevperf.sock 00:20:29.352 04:32:08 -- common/autotest_common.sh@829 -- # '[' -z 2945006 ']' 00:20:29.352 04:32:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:29.352 04:32:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:29.352 04:32:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:29.352 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:29.352 04:32:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:29.352 04:32:08 -- common/autotest_common.sh@10 -- # set +x 00:20:29.352 [2024-11-26 04:32:08.572635] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:29.352 [2024-11-26 04:32:08.572732] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2945006 ] 00:20:29.611 EAL: No free 2048 kB hugepages reported on node 1 00:20:29.611 [2024-11-26 04:32:08.629944] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:29.611 [2024-11-26 04:32:08.711577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:29.611 04:32:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:29.611 04:32:08 -- common/autotest_common.sh@862 -- # return 0 00:20:29.611 04:32:08 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:29.869 [2024-11-26 04:32:09.063887] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:30.130 TLSTESTn1 00:20:30.130 04:32:09 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:20:30.424 04:32:09 -- target/tls.sh@205 -- # tgtconf='{ 00:20:30.424 "subsystems": [ 00:20:30.424 { 00:20:30.424 "subsystem": "iobuf", 00:20:30.424 "config": [ 00:20:30.424 { 00:20:30.424 "method": "iobuf_set_options", 00:20:30.424 "params": { 00:20:30.424 "small_pool_count": 8192, 00:20:30.424 "large_pool_count": 1024, 00:20:30.424 "small_bufsize": 8192, 00:20:30.424 "large_bufsize": 135168 00:20:30.424 } 00:20:30.424 } 00:20:30.424 ] 00:20:30.424 }, 00:20:30.424 { 00:20:30.424 "subsystem": "sock", 00:20:30.424 "config": [ 00:20:30.424 { 00:20:30.424 "method": "sock_impl_set_options", 00:20:30.424 "params": { 00:20:30.424 "impl_name": "posix", 00:20:30.424 "recv_buf_size": 2097152, 00:20:30.424 "send_buf_size": 2097152, 00:20:30.424 "enable_recv_pipe": true, 00:20:30.424 "enable_quickack": false, 00:20:30.424 "enable_placement_id": 0, 00:20:30.424 "enable_zerocopy_send_server": true, 00:20:30.424 "enable_zerocopy_send_client": false, 00:20:30.424 "zerocopy_threshold": 0, 00:20:30.424 "tls_version": 0, 00:20:30.424 "enable_ktls": false 00:20:30.424 } 00:20:30.424 }, 00:20:30.424 { 00:20:30.424 "method": "sock_impl_set_options", 00:20:30.424 "params": { 00:20:30.424 "impl_name": "ssl", 00:20:30.424 "recv_buf_size": 4096, 00:20:30.424 "send_buf_size": 4096, 00:20:30.424 "enable_recv_pipe": true, 00:20:30.424 "enable_quickack": false, 00:20:30.424 "enable_placement_id": 0, 00:20:30.424 "enable_zerocopy_send_server": true, 00:20:30.424 "enable_zerocopy_send_client": false, 00:20:30.424 "zerocopy_threshold": 0, 00:20:30.424 "tls_version": 0, 00:20:30.424 "enable_ktls": false 00:20:30.424 } 00:20:30.424 } 00:20:30.424 ] 00:20:30.424 }, 00:20:30.424 { 00:20:30.424 "subsystem": "vmd", 00:20:30.424 "config": [] 00:20:30.424 }, 00:20:30.424 { 00:20:30.424 "subsystem": "accel", 00:20:30.424 "config": [ 00:20:30.424 { 00:20:30.424 "method": "accel_set_options", 00:20:30.424 "params": { 00:20:30.424 "small_cache_size": 128, 00:20:30.424 "large_cache_size": 16, 00:20:30.424 "task_count": 2048, 00:20:30.424 "sequence_count": 2048, 00:20:30.424 "buf_count": 2048 00:20:30.424 } 00:20:30.424 } 00:20:30.424 ] 00:20:30.424 }, 00:20:30.424 { 00:20:30.424 "subsystem": "bdev", 00:20:30.424 "config": [ 00:20:30.424 { 00:20:30.424 "method": "bdev_set_options", 00:20:30.424 "params": { 00:20:30.424 "bdev_io_pool_size": 65535, 00:20:30.424 "bdev_io_cache_size": 256, 00:20:30.424 "bdev_auto_examine": true, 00:20:30.424 "iobuf_small_cache_size": 128, 00:20:30.424 "iobuf_large_cache_size": 16 00:20:30.424 } 00:20:30.424 }, 00:20:30.424 { 00:20:30.424 "method": "bdev_raid_set_options", 00:20:30.424 "params": { 00:20:30.424 "process_window_size_kb": 1024 00:20:30.424 } 00:20:30.424 }, 00:20:30.424 { 00:20:30.424 "method": "bdev_iscsi_set_options", 00:20:30.424 "params": { 00:20:30.424 "timeout_sec": 30 00:20:30.424 } 00:20:30.424 }, 00:20:30.424 { 00:20:30.424 "method": "bdev_nvme_set_options", 00:20:30.424 "params": { 00:20:30.424 "action_on_timeout": "none", 00:20:30.424 "timeout_us": 0, 00:20:30.424 "timeout_admin_us": 0, 00:20:30.424 "keep_alive_timeout_ms": 10000, 00:20:30.424 "transport_retry_count": 4, 00:20:30.424 "arbitration_burst": 0, 00:20:30.424 "low_priority_weight": 0, 00:20:30.424 "medium_priority_weight": 0, 00:20:30.424 "high_priority_weight": 0, 00:20:30.424 "nvme_adminq_poll_period_us": 10000, 00:20:30.424 "nvme_ioq_poll_period_us": 0, 00:20:30.424 "io_queue_requests": 0, 00:20:30.424 "delay_cmd_submit": true, 00:20:30.424 "bdev_retry_count": 3, 00:20:30.424 "transport_ack_timeout": 0, 00:20:30.424 "ctrlr_loss_timeout_sec": 0, 00:20:30.424 "reconnect_delay_sec": 0, 00:20:30.424 "fast_io_fail_timeout_sec": 0, 00:20:30.424 "generate_uuids": false, 00:20:30.424 "transport_tos": 0, 00:20:30.424 "io_path_stat": false, 00:20:30.424 "allow_accel_sequence": false 00:20:30.424 } 00:20:30.424 }, 00:20:30.424 { 00:20:30.424 "method": "bdev_nvme_set_hotplug", 00:20:30.424 "params": { 00:20:30.424 "period_us": 100000, 00:20:30.424 "enable": false 00:20:30.424 } 00:20:30.424 }, 00:20:30.424 { 00:20:30.424 "method": "bdev_malloc_create", 00:20:30.424 "params": { 00:20:30.424 "name": "malloc0", 00:20:30.424 "num_blocks": 8192, 00:20:30.424 "block_size": 4096, 00:20:30.424 "physical_block_size": 4096, 00:20:30.424 "uuid": "4587448c-ea91-4c5a-922e-9ad2881bebea", 00:20:30.424 "optimal_io_boundary": 0 00:20:30.424 } 00:20:30.424 }, 00:20:30.424 { 00:20:30.424 "method": "bdev_wait_for_examine" 00:20:30.424 } 00:20:30.424 ] 00:20:30.424 }, 00:20:30.424 { 00:20:30.424 "subsystem": "nbd", 00:20:30.424 "config": [] 00:20:30.424 }, 00:20:30.425 { 00:20:30.425 "subsystem": "scheduler", 00:20:30.425 "config": [ 00:20:30.425 { 00:20:30.425 "method": "framework_set_scheduler", 00:20:30.425 "params": { 00:20:30.425 "name": "static" 00:20:30.425 } 00:20:30.425 } 00:20:30.425 ] 00:20:30.425 }, 00:20:30.425 { 00:20:30.425 "subsystem": "nvmf", 00:20:30.425 "config": [ 00:20:30.425 { 00:20:30.425 "method": "nvmf_set_config", 00:20:30.425 "params": { 00:20:30.425 "discovery_filter": "match_any", 00:20:30.425 "admin_cmd_passthru": { 00:20:30.425 "identify_ctrlr": false 00:20:30.425 } 00:20:30.425 } 00:20:30.425 }, 00:20:30.425 { 00:20:30.425 "method": "nvmf_set_max_subsystems", 00:20:30.425 "params": { 00:20:30.425 "max_subsystems": 1024 00:20:30.425 } 00:20:30.425 }, 00:20:30.425 { 00:20:30.425 "method": "nvmf_set_crdt", 00:20:30.425 "params": { 00:20:30.425 "crdt1": 0, 00:20:30.425 "crdt2": 0, 00:20:30.425 "crdt3": 0 00:20:30.425 } 00:20:30.425 }, 00:20:30.425 { 00:20:30.425 "method": "nvmf_create_transport", 00:20:30.425 "params": { 00:20:30.425 "trtype": "TCP", 00:20:30.425 "max_queue_depth": 128, 00:20:30.425 "max_io_qpairs_per_ctrlr": 127, 00:20:30.425 "in_capsule_data_size": 4096, 00:20:30.425 "max_io_size": 131072, 00:20:30.425 "io_unit_size": 131072, 00:20:30.425 "max_aq_depth": 128, 00:20:30.425 "num_shared_buffers": 511, 00:20:30.425 "buf_cache_size": 4294967295, 00:20:30.425 "dif_insert_or_strip": false, 00:20:30.425 "zcopy": false, 00:20:30.425 "c2h_success": false, 00:20:30.425 "sock_priority": 0, 00:20:30.425 "abort_timeout_sec": 1 00:20:30.425 } 00:20:30.425 }, 00:20:30.425 { 00:20:30.425 "method": "nvmf_create_subsystem", 00:20:30.425 "params": { 00:20:30.425 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:30.425 "allow_any_host": false, 00:20:30.425 "serial_number": "SPDK00000000000001", 00:20:30.425 "model_number": "SPDK bdev Controller", 00:20:30.425 "max_namespaces": 10, 00:20:30.425 "min_cntlid": 1, 00:20:30.425 "max_cntlid": 65519, 00:20:30.425 "ana_reporting": false 00:20:30.425 } 00:20:30.425 }, 00:20:30.425 { 00:20:30.425 "method": "nvmf_subsystem_add_host", 00:20:30.425 "params": { 00:20:30.425 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:30.425 "host": "nqn.2016-06.io.spdk:host1", 00:20:30.425 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:30.425 } 00:20:30.425 }, 00:20:30.425 { 00:20:30.425 "method": "nvmf_subsystem_add_ns", 00:20:30.425 "params": { 00:20:30.425 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:30.425 "namespace": { 00:20:30.425 "nsid": 1, 00:20:30.425 "bdev_name": "malloc0", 00:20:30.425 "nguid": "4587448CEA914C5A922E9AD2881BEBEA", 00:20:30.425 "uuid": "4587448c-ea91-4c5a-922e-9ad2881bebea" 00:20:30.425 } 00:20:30.425 } 00:20:30.425 }, 00:20:30.425 { 00:20:30.425 "method": "nvmf_subsystem_add_listener", 00:20:30.425 "params": { 00:20:30.425 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:30.425 "listen_address": { 00:20:30.425 "trtype": "TCP", 00:20:30.425 "adrfam": "IPv4", 00:20:30.425 "traddr": "10.0.0.2", 00:20:30.425 "trsvcid": "4420" 00:20:30.425 }, 00:20:30.425 "secure_channel": true 00:20:30.425 } 00:20:30.425 } 00:20:30.425 ] 00:20:30.425 } 00:20:30.425 ] 00:20:30.425 }' 00:20:30.425 04:32:09 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:30.707 04:32:09 -- target/tls.sh@206 -- # bdevperfconf='{ 00:20:30.707 "subsystems": [ 00:20:30.707 { 00:20:30.707 "subsystem": "iobuf", 00:20:30.707 "config": [ 00:20:30.707 { 00:20:30.707 "method": "iobuf_set_options", 00:20:30.707 "params": { 00:20:30.707 "small_pool_count": 8192, 00:20:30.707 "large_pool_count": 1024, 00:20:30.707 "small_bufsize": 8192, 00:20:30.707 "large_bufsize": 135168 00:20:30.707 } 00:20:30.707 } 00:20:30.707 ] 00:20:30.707 }, 00:20:30.707 { 00:20:30.707 "subsystem": "sock", 00:20:30.707 "config": [ 00:20:30.707 { 00:20:30.707 "method": "sock_impl_set_options", 00:20:30.708 "params": { 00:20:30.708 "impl_name": "posix", 00:20:30.708 "recv_buf_size": 2097152, 00:20:30.708 "send_buf_size": 2097152, 00:20:30.708 "enable_recv_pipe": true, 00:20:30.708 "enable_quickack": false, 00:20:30.708 "enable_placement_id": 0, 00:20:30.708 "enable_zerocopy_send_server": true, 00:20:30.708 "enable_zerocopy_send_client": false, 00:20:30.708 "zerocopy_threshold": 0, 00:20:30.708 "tls_version": 0, 00:20:30.708 "enable_ktls": false 00:20:30.708 } 00:20:30.708 }, 00:20:30.708 { 00:20:30.708 "method": "sock_impl_set_options", 00:20:30.708 "params": { 00:20:30.708 "impl_name": "ssl", 00:20:30.708 "recv_buf_size": 4096, 00:20:30.708 "send_buf_size": 4096, 00:20:30.708 "enable_recv_pipe": true, 00:20:30.708 "enable_quickack": false, 00:20:30.708 "enable_placement_id": 0, 00:20:30.708 "enable_zerocopy_send_server": true, 00:20:30.708 "enable_zerocopy_send_client": false, 00:20:30.708 "zerocopy_threshold": 0, 00:20:30.708 "tls_version": 0, 00:20:30.708 "enable_ktls": false 00:20:30.708 } 00:20:30.708 } 00:20:30.708 ] 00:20:30.708 }, 00:20:30.708 { 00:20:30.708 "subsystem": "vmd", 00:20:30.708 "config": [] 00:20:30.708 }, 00:20:30.708 { 00:20:30.708 "subsystem": "accel", 00:20:30.708 "config": [ 00:20:30.708 { 00:20:30.708 "method": "accel_set_options", 00:20:30.708 "params": { 00:20:30.708 "small_cache_size": 128, 00:20:30.708 "large_cache_size": 16, 00:20:30.708 "task_count": 2048, 00:20:30.708 "sequence_count": 2048, 00:20:30.708 "buf_count": 2048 00:20:30.708 } 00:20:30.708 } 00:20:30.708 ] 00:20:30.708 }, 00:20:30.708 { 00:20:30.708 "subsystem": "bdev", 00:20:30.708 "config": [ 00:20:30.708 { 00:20:30.708 "method": "bdev_set_options", 00:20:30.708 "params": { 00:20:30.708 "bdev_io_pool_size": 65535, 00:20:30.708 "bdev_io_cache_size": 256, 00:20:30.708 "bdev_auto_examine": true, 00:20:30.708 "iobuf_small_cache_size": 128, 00:20:30.708 "iobuf_large_cache_size": 16 00:20:30.708 } 00:20:30.708 }, 00:20:30.708 { 00:20:30.708 "method": "bdev_raid_set_options", 00:20:30.708 "params": { 00:20:30.708 "process_window_size_kb": 1024 00:20:30.708 } 00:20:30.708 }, 00:20:30.708 { 00:20:30.708 "method": "bdev_iscsi_set_options", 00:20:30.708 "params": { 00:20:30.708 "timeout_sec": 30 00:20:30.708 } 00:20:30.708 }, 00:20:30.708 { 00:20:30.708 "method": "bdev_nvme_set_options", 00:20:30.708 "params": { 00:20:30.708 "action_on_timeout": "none", 00:20:30.708 "timeout_us": 0, 00:20:30.708 "timeout_admin_us": 0, 00:20:30.708 "keep_alive_timeout_ms": 10000, 00:20:30.708 "transport_retry_count": 4, 00:20:30.708 "arbitration_burst": 0, 00:20:30.708 "low_priority_weight": 0, 00:20:30.708 "medium_priority_weight": 0, 00:20:30.708 "high_priority_weight": 0, 00:20:30.708 "nvme_adminq_poll_period_us": 10000, 00:20:30.708 "nvme_ioq_poll_period_us": 0, 00:20:30.708 "io_queue_requests": 512, 00:20:30.708 "delay_cmd_submit": true, 00:20:30.708 "bdev_retry_count": 3, 00:20:30.708 "transport_ack_timeout": 0, 00:20:30.708 "ctrlr_loss_timeout_sec": 0, 00:20:30.708 "reconnect_delay_sec": 0, 00:20:30.708 "fast_io_fail_timeout_sec": 0, 00:20:30.708 "generate_uuids": false, 00:20:30.708 "transport_tos": 0, 00:20:30.708 "io_path_stat": false, 00:20:30.708 "allow_accel_sequence": false 00:20:30.708 } 00:20:30.708 }, 00:20:30.708 { 00:20:30.708 "method": "bdev_nvme_attach_controller", 00:20:30.708 "params": { 00:20:30.708 "name": "TLSTEST", 00:20:30.708 "trtype": "TCP", 00:20:30.708 "adrfam": "IPv4", 00:20:30.708 "traddr": "10.0.0.2", 00:20:30.708 "trsvcid": "4420", 00:20:30.708 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:30.708 "prchk_reftag": false, 00:20:30.708 "prchk_guard": false, 00:20:30.708 "ctrlr_loss_timeout_sec": 0, 00:20:30.708 "reconnect_delay_sec": 0, 00:20:30.708 "fast_io_fail_timeout_sec": 0, 00:20:30.708 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:30.708 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:30.708 "hdgst": false, 00:20:30.708 "ddgst": false 00:20:30.708 } 00:20:30.708 }, 00:20:30.708 { 00:20:30.708 "method": "bdev_nvme_set_hotplug", 00:20:30.708 "params": { 00:20:30.708 "period_us": 100000, 00:20:30.708 "enable": false 00:20:30.708 } 00:20:30.708 }, 00:20:30.708 { 00:20:30.708 "method": "bdev_wait_for_examine" 00:20:30.708 } 00:20:30.708 ] 00:20:30.708 }, 00:20:30.708 { 00:20:30.708 "subsystem": "nbd", 00:20:30.708 "config": [] 00:20:30.708 } 00:20:30.708 ] 00:20:30.708 }' 00:20:30.708 04:32:09 -- target/tls.sh@208 -- # killprocess 2945006 00:20:30.708 04:32:09 -- common/autotest_common.sh@936 -- # '[' -z 2945006 ']' 00:20:30.708 04:32:09 -- common/autotest_common.sh@940 -- # kill -0 2945006 00:20:30.708 04:32:09 -- common/autotest_common.sh@941 -- # uname 00:20:30.708 04:32:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:30.708 04:32:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2945006 00:20:30.708 04:32:09 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:30.708 04:32:09 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:30.708 04:32:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2945006' 00:20:30.708 killing process with pid 2945006 00:20:30.708 04:32:09 -- common/autotest_common.sh@955 -- # kill 2945006 00:20:30.708 Received shutdown signal, test time was about 10.000000 seconds 00:20:30.708 00:20:30.708 Latency(us) 00:20:30.708 [2024-11-26T03:32:09.934Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:30.708 [2024-11-26T03:32:09.934Z] =================================================================================================================== 00:20:30.708 [2024-11-26T03:32:09.934Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:30.708 04:32:09 -- common/autotest_common.sh@960 -- # wait 2945006 00:20:30.967 04:32:10 -- target/tls.sh@209 -- # killprocess 2944711 00:20:30.967 04:32:10 -- common/autotest_common.sh@936 -- # '[' -z 2944711 ']' 00:20:30.967 04:32:10 -- common/autotest_common.sh@940 -- # kill -0 2944711 00:20:30.967 04:32:10 -- common/autotest_common.sh@941 -- # uname 00:20:30.967 04:32:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:30.967 04:32:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2944711 00:20:30.967 04:32:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:30.967 04:32:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:30.967 04:32:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2944711' 00:20:30.967 killing process with pid 2944711 00:20:30.967 04:32:10 -- common/autotest_common.sh@955 -- # kill 2944711 00:20:30.967 04:32:10 -- common/autotest_common.sh@960 -- # wait 2944711 00:20:31.226 04:32:10 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:20:31.226 04:32:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:31.226 04:32:10 -- target/tls.sh@212 -- # echo '{ 00:20:31.226 "subsystems": [ 00:20:31.226 { 00:20:31.226 "subsystem": "iobuf", 00:20:31.226 "config": [ 00:20:31.226 { 00:20:31.226 "method": "iobuf_set_options", 00:20:31.226 "params": { 00:20:31.226 "small_pool_count": 8192, 00:20:31.226 "large_pool_count": 1024, 00:20:31.226 "small_bufsize": 8192, 00:20:31.226 "large_bufsize": 135168 00:20:31.226 } 00:20:31.226 } 00:20:31.226 ] 00:20:31.226 }, 00:20:31.226 { 00:20:31.226 "subsystem": "sock", 00:20:31.226 "config": [ 00:20:31.226 { 00:20:31.226 "method": "sock_impl_set_options", 00:20:31.226 "params": { 00:20:31.226 "impl_name": "posix", 00:20:31.226 "recv_buf_size": 2097152, 00:20:31.226 "send_buf_size": 2097152, 00:20:31.226 "enable_recv_pipe": true, 00:20:31.226 "enable_quickack": false, 00:20:31.226 "enable_placement_id": 0, 00:20:31.226 "enable_zerocopy_send_server": true, 00:20:31.226 "enable_zerocopy_send_client": false, 00:20:31.226 "zerocopy_threshold": 0, 00:20:31.226 "tls_version": 0, 00:20:31.226 "enable_ktls": false 00:20:31.226 } 00:20:31.226 }, 00:20:31.226 { 00:20:31.226 "method": "sock_impl_set_options", 00:20:31.226 "params": { 00:20:31.226 "impl_name": "ssl", 00:20:31.226 "recv_buf_size": 4096, 00:20:31.226 "send_buf_size": 4096, 00:20:31.226 "enable_recv_pipe": true, 00:20:31.226 "enable_quickack": false, 00:20:31.226 "enable_placement_id": 0, 00:20:31.226 "enable_zerocopy_send_server": true, 00:20:31.226 "enable_zerocopy_send_client": false, 00:20:31.226 "zerocopy_threshold": 0, 00:20:31.226 "tls_version": 0, 00:20:31.226 "enable_ktls": false 00:20:31.226 } 00:20:31.226 } 00:20:31.226 ] 00:20:31.226 }, 00:20:31.226 { 00:20:31.226 "subsystem": "vmd", 00:20:31.226 "config": [] 00:20:31.226 }, 00:20:31.226 { 00:20:31.226 "subsystem": "accel", 00:20:31.226 "config": [ 00:20:31.227 { 00:20:31.227 "method": "accel_set_options", 00:20:31.227 "params": { 00:20:31.227 "small_cache_size": 128, 00:20:31.227 "large_cache_size": 16, 00:20:31.227 "task_count": 2048, 00:20:31.227 "sequence_count": 2048, 00:20:31.227 "buf_count": 2048 00:20:31.227 } 00:20:31.227 } 00:20:31.227 ] 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "subsystem": "bdev", 00:20:31.227 "config": [ 00:20:31.227 { 00:20:31.227 "method": "bdev_set_options", 00:20:31.227 "params": { 00:20:31.227 "bdev_io_pool_size": 65535, 00:20:31.227 "bdev_io_cache_size": 256, 00:20:31.227 "bdev_auto_examine": true, 00:20:31.227 "iobuf_small_cache_size": 128, 00:20:31.227 "iobuf_large_cache_size": 16 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "bdev_raid_set_options", 00:20:31.227 "params": { 00:20:31.227 "process_window_size_kb": 1024 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "bdev_iscsi_set_options", 00:20:31.227 "params": { 00:20:31.227 "timeout_sec": 30 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "bdev_nvme_set_options", 00:20:31.227 "params": { 00:20:31.227 "action_on_timeout": "none", 00:20:31.227 "timeout_us": 0, 00:20:31.227 "timeout_admin_us": 0, 00:20:31.227 "keep_alive_timeout_ms": 10000, 00:20:31.227 "transport_retry_count": 4, 00:20:31.227 "arbitration_burst": 0, 00:20:31.227 "low_priority_weight": 0, 00:20:31.227 "medium_priority_weight": 0, 00:20:31.227 "high_priority_weight": 0, 00:20:31.227 "nvme_adminq_poll_period_us": 10000, 00:20:31.227 "nvme_ioq_poll_period_us": 0, 00:20:31.227 "io_queue_requests": 0, 00:20:31.227 "delay_cmd_submit": true, 00:20:31.227 "bdev_retry_count": 3, 00:20:31.227 "transport_ack_timeout": 0, 00:20:31.227 "ctrlr_loss_timeout_sec": 0, 00:20:31.227 "reconnect_delay_sec": 0, 00:20:31.227 "fast_io_fail_timeout_sec": 0, 00:20:31.227 "generate_uuids": false, 00:20:31.227 "transport_tos": 0, 00:20:31.227 "io_path_stat": false, 00:20:31.227 "allow_accel_sequence": false 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "bdev_nvme_set_hotplug", 00:20:31.227 "params": { 00:20:31.227 "period_us": 100000, 00:20:31.227 "enable": false 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "bdev_malloc_create", 00:20:31.227 "params": { 00:20:31.227 "name": "malloc0", 00:20:31.227 "num_blocks": 8192, 00:20:31.227 "block_size": 4096, 00:20:31.227 "physical_block_size": 4096, 00:20:31.227 "uuid": "4587448c-ea91-4c5a-922e-9ad2881bebea", 00:20:31.227 "optimal_io_boundary": 0 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "bdev_wait_for_examine" 00:20:31.227 } 00:20:31.227 ] 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "subsystem": "nbd", 00:20:31.227 "config": [] 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "subsystem": "scheduler", 00:20:31.227 "config": [ 00:20:31.227 { 00:20:31.227 "method": "framework_set_scheduler", 00:20:31.227 "params": { 00:20:31.227 "name": "static" 00:20:31.227 } 00:20:31.227 } 00:20:31.227 ] 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "subsystem": "nvmf", 00:20:31.227 "config": [ 00:20:31.227 { 00:20:31.227 "method": "nvmf_set_config", 00:20:31.227 "params": { 00:20:31.227 "discovery_filter": "match_any", 00:20:31.227 "admin_cmd_passthru": { 00:20:31.227 "identify_ctrlr": false 00:20:31.227 } 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "nvmf_set_max_subsystems", 00:20:31.227 "params": { 00:20:31.227 "max_subsystems": 1024 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "nvmf_set_crdt", 00:20:31.227 "params": { 00:20:31.227 "crdt1": 0, 00:20:31.227 "crdt2": 0, 00:20:31.227 "crdt3": 0 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "nvmf_create_transport", 00:20:31.227 "params": { 00:20:31.227 "trtype": "TCP", 00:20:31.227 "max_queue_depth": 128, 00:20:31.227 "max_io_qpairs_per_ctrlr": 127, 00:20:31.227 "in_capsule_data_size": 4096, 00:20:31.227 "max_io_size": 131072, 00:20:31.227 "io_unit_size": 131072, 00:20:31.227 "max_aq_depth": 128, 00:20:31.227 "num_shared_buffers": 511, 00:20:31.227 "buf_cache_size": 4294967295, 00:20:31.227 "dif_insert_or_strip": false, 00:20:31.227 "zcopy": false, 00:20:31.227 "c2h_success": false, 00:20:31.227 "sock_priority": 0, 00:20:31.227 "abort_timeout_sec": 1 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "nvmf_create_subsystem", 00:20:31.227 "params": { 00:20:31.227 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:31.227 "allow_any_host": false, 00:20:31.227 "serial_number": "SPDK00000000000001", 00:20:31.227 "model_number": "SPDK bdev Controller", 00:20:31.227 "max_namespaces": 10, 00:20:31.227 "min_cntlid": 1, 00:20:31.227 "max_cntlid": 65519, 00:20:31.227 "ana_reporting": false 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "nvmf_subsystem_add_host", 00:20:31.227 "params": { 00:20:31.227 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:31.227 "host": "nqn.2016-06.io.spdk:host1", 00:20:31.227 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "nvmf_subsystem_add_ns", 00:20:31.227 "params": { 00:20:31.227 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:31.227 "namespace": { 00:20:31.227 "nsid": 1, 00:20:31.227 "bdev_name": "malloc0", 00:20:31.227 "nguid": "4587448CEA914C5A922E9AD2881BEBEA", 00:20:31.227 "uuid": "4587448c-ea91-4c5a-922e-9ad2881bebea" 00:20:31.227 } 00:20:31.227 } 00:20:31.227 }, 00:20:31.227 { 00:20:31.227 "method": "nvmf_subsystem_add_listener", 00:20:31.227 "params": { 00:20:31.227 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:31.227 "listen_address": { 00:20:31.227 "trtype": "TCP", 00:20:31.227 "adrfam": "IPv4", 00:20:31.227 "traddr": "10.0.0.2", 00:20:31.227 "trsvcid": "4420" 00:20:31.227 }, 00:20:31.227 "secure_channel": true 00:20:31.227 } 00:20:31.227 } 00:20:31.227 ] 00:20:31.227 } 00:20:31.227 ] 00:20:31.227 }' 00:20:31.227 04:32:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:31.227 04:32:10 -- common/autotest_common.sh@10 -- # set +x 00:20:31.227 04:32:10 -- nvmf/common.sh@469 -- # nvmfpid=2945267 00:20:31.227 04:32:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:20:31.227 04:32:10 -- nvmf/common.sh@470 -- # waitforlisten 2945267 00:20:31.227 04:32:10 -- common/autotest_common.sh@829 -- # '[' -z 2945267 ']' 00:20:31.227 04:32:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:31.227 04:32:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:31.227 04:32:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:31.227 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:31.227 04:32:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:31.227 04:32:10 -- common/autotest_common.sh@10 -- # set +x 00:20:31.486 [2024-11-26 04:32:10.481537] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:31.486 [2024-11-26 04:32:10.481638] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:31.486 EAL: No free 2048 kB hugepages reported on node 1 00:20:31.486 [2024-11-26 04:32:10.551937] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:31.486 [2024-11-26 04:32:10.640302] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:31.486 [2024-11-26 04:32:10.640477] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:31.486 [2024-11-26 04:32:10.640498] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:31.486 [2024-11-26 04:32:10.640512] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:31.486 [2024-11-26 04:32:10.640545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:31.745 [2024-11-26 04:32:10.860247] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:31.745 [2024-11-26 04:32:10.892265] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:31.745 [2024-11-26 04:32:10.892549] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:32.311 04:32:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:32.311 04:32:11 -- common/autotest_common.sh@862 -- # return 0 00:20:32.311 04:32:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:32.311 04:32:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:32.311 04:32:11 -- common/autotest_common.sh@10 -- # set +x 00:20:32.311 04:32:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:32.311 04:32:11 -- target/tls.sh@216 -- # bdevperf_pid=2945333 00:20:32.311 04:32:11 -- target/tls.sh@217 -- # waitforlisten 2945333 /var/tmp/bdevperf.sock 00:20:32.311 04:32:11 -- common/autotest_common.sh@829 -- # '[' -z 2945333 ']' 00:20:32.311 04:32:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:32.311 04:32:11 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:20:32.311 04:32:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:32.311 04:32:11 -- target/tls.sh@213 -- # echo '{ 00:20:32.311 "subsystems": [ 00:20:32.311 { 00:20:32.311 "subsystem": "iobuf", 00:20:32.311 "config": [ 00:20:32.311 { 00:20:32.311 "method": "iobuf_set_options", 00:20:32.311 "params": { 00:20:32.311 "small_pool_count": 8192, 00:20:32.311 "large_pool_count": 1024, 00:20:32.311 "small_bufsize": 8192, 00:20:32.311 "large_bufsize": 135168 00:20:32.311 } 00:20:32.311 } 00:20:32.311 ] 00:20:32.311 }, 00:20:32.311 { 00:20:32.311 "subsystem": "sock", 00:20:32.311 "config": [ 00:20:32.311 { 00:20:32.311 "method": "sock_impl_set_options", 00:20:32.311 "params": { 00:20:32.311 "impl_name": "posix", 00:20:32.311 "recv_buf_size": 2097152, 00:20:32.311 "send_buf_size": 2097152, 00:20:32.311 "enable_recv_pipe": true, 00:20:32.311 "enable_quickack": false, 00:20:32.311 "enable_placement_id": 0, 00:20:32.311 "enable_zerocopy_send_server": true, 00:20:32.311 "enable_zerocopy_send_client": false, 00:20:32.311 "zerocopy_threshold": 0, 00:20:32.311 "tls_version": 0, 00:20:32.311 "enable_ktls": false 00:20:32.311 } 00:20:32.311 }, 00:20:32.311 { 00:20:32.311 "method": "sock_impl_set_options", 00:20:32.311 "params": { 00:20:32.311 "impl_name": "ssl", 00:20:32.311 "recv_buf_size": 4096, 00:20:32.311 "send_buf_size": 4096, 00:20:32.311 "enable_recv_pipe": true, 00:20:32.311 "enable_quickack": false, 00:20:32.311 "enable_placement_id": 0, 00:20:32.311 "enable_zerocopy_send_server": true, 00:20:32.311 "enable_zerocopy_send_client": false, 00:20:32.311 "zerocopy_threshold": 0, 00:20:32.311 "tls_version": 0, 00:20:32.311 "enable_ktls": false 00:20:32.311 } 00:20:32.311 } 00:20:32.311 ] 00:20:32.311 }, 00:20:32.311 { 00:20:32.311 "subsystem": "vmd", 00:20:32.311 "config": [] 00:20:32.311 }, 00:20:32.311 { 00:20:32.311 "subsystem": "accel", 00:20:32.311 "config": [ 00:20:32.311 { 00:20:32.311 "method": "accel_set_options", 00:20:32.311 "params": { 00:20:32.311 "small_cache_size": 128, 00:20:32.311 "large_cache_size": 16, 00:20:32.311 "task_count": 2048, 00:20:32.311 "sequence_count": 2048, 00:20:32.311 "buf_count": 2048 00:20:32.311 } 00:20:32.311 } 00:20:32.311 ] 00:20:32.311 }, 00:20:32.311 { 00:20:32.311 "subsystem": "bdev", 00:20:32.311 "config": [ 00:20:32.311 { 00:20:32.311 "method": "bdev_set_options", 00:20:32.311 "params": { 00:20:32.311 "bdev_io_pool_size": 65535, 00:20:32.311 "bdev_io_cache_size": 256, 00:20:32.311 "bdev_auto_examine": true, 00:20:32.311 "iobuf_small_cache_size": 128, 00:20:32.311 "iobuf_large_cache_size": 16 00:20:32.311 } 00:20:32.311 }, 00:20:32.311 { 00:20:32.311 "method": "bdev_raid_set_options", 00:20:32.311 "params": { 00:20:32.311 "process_window_size_kb": 1024 00:20:32.311 } 00:20:32.311 }, 00:20:32.311 { 00:20:32.311 "method": "bdev_iscsi_set_options", 00:20:32.311 "params": { 00:20:32.311 "timeout_sec": 30 00:20:32.311 } 00:20:32.311 }, 00:20:32.311 { 00:20:32.311 "method": "bdev_nvme_set_options", 00:20:32.311 "params": { 00:20:32.311 "action_on_timeout": "none", 00:20:32.311 "timeout_us": 0, 00:20:32.311 "timeout_admin_us": 0, 00:20:32.311 "keep_alive_timeout_ms": 10000, 00:20:32.311 "transport_retry_count": 4, 00:20:32.311 "arbitration_burst": 0, 00:20:32.311 "low_priority_weight": 0, 00:20:32.311 "medium_priority_weight": 0, 00:20:32.311 "high_priority_weight": 0, 00:20:32.311 "nvme_adminq_poll_period_us": 10000, 00:20:32.311 "nvme_ioq_poll_period_us": 0, 00:20:32.311 "io_queue_requests": 512, 00:20:32.311 "delay_cmd_submit": true, 00:20:32.311 "bdev_retry_count": 3, 00:20:32.311 "transport_ack_timeout": 0, 00:20:32.311 "ctrlr_loss_timeout_sec": 0, 00:20:32.311 "reconnect_delay_sec": 0, 00:20:32.311 "fast_io_fail_timeout_sec": 0, 00:20:32.311 "generate_uuids": false, 00:20:32.311 "transport_tos": 0, 00:20:32.311 "io_path_stat": false, 00:20:32.311 "allow_accel_sequence": false 00:20:32.311 } 00:20:32.311 }, 00:20:32.311 { 00:20:32.311 "method": "bdev_nvme_attach_controller", 00:20:32.311 "params": { 00:20:32.311 "name": "TLSTEST", 00:20:32.311 "trtype": "TCP", 00:20:32.311 "adrfam": "IPv4", 00:20:32.311 "traddr": "10.0.0.2", 00:20:32.311 "trsvcid": "4420", 00:20:32.312 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:32.312 "prchk_reftag": false, 00:20:32.312 "prchk_guard": false, 00:20:32.312 "ctrlr_loss_timeout_sec": 0, 00:20:32.312 "reconnect_delay_sec": 0, 00:20:32.312 "fast_io_fail_timeout_sec": 0, 00:20:32.312 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:32.312 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:32.312 "hdgst": false, 00:20:32.312 "ddgst": false 00:20:32.312 } 00:20:32.312 }, 00:20:32.312 { 00:20:32.312 "method": "bdev_nvme_set_hotplug", 00:20:32.312 "params": { 00:20:32.312 "period_us": 100000, 00:20:32.312 "enable": false 00:20:32.312 } 00:20:32.312 }, 00:20:32.312 { 00:20:32.312 "method": "bdev_wait_for_examine" 00:20:32.312 } 00:20:32.312 ] 00:20:32.312 }, 00:20:32.312 { 00:20:32.312 "subsystem": "nbd", 00:20:32.312 "config": [] 00:20:32.312 } 00:20:32.312 ] 00:20:32.312 }' 00:20:32.312 04:32:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:32.312 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:32.312 04:32:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:32.312 04:32:11 -- common/autotest_common.sh@10 -- # set +x 00:20:32.312 [2024-11-26 04:32:11.500151] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:32.312 [2024-11-26 04:32:11.500240] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2945333 ] 00:20:32.312 EAL: No free 2048 kB hugepages reported on node 1 00:20:32.570 [2024-11-26 04:32:11.561876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:32.570 [2024-11-26 04:32:11.644804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:32.828 [2024-11-26 04:32:11.803959] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:33.394 04:32:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:33.394 04:32:12 -- common/autotest_common.sh@862 -- # return 0 00:20:33.394 04:32:12 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:33.394 Running I/O for 10 seconds... 00:20:45.605 00:20:45.605 Latency(us) 00:20:45.605 [2024-11-26T03:32:24.831Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:45.605 [2024-11-26T03:32:24.831Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:45.605 Verification LBA range: start 0x0 length 0x2000 00:20:45.605 TLSTESTn1 : 10.02 4364.45 17.05 0.00 0.00 29283.04 7670.14 46215.02 00:20:45.605 [2024-11-26T03:32:24.831Z] =================================================================================================================== 00:20:45.605 [2024-11-26T03:32:24.831Z] Total : 4364.45 17.05 0.00 0.00 29283.04 7670.14 46215.02 00:20:45.605 0 00:20:45.605 04:32:22 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:45.605 04:32:22 -- target/tls.sh@223 -- # killprocess 2945333 00:20:45.605 04:32:22 -- common/autotest_common.sh@936 -- # '[' -z 2945333 ']' 00:20:45.605 04:32:22 -- common/autotest_common.sh@940 -- # kill -0 2945333 00:20:45.605 04:32:22 -- common/autotest_common.sh@941 -- # uname 00:20:45.605 04:32:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:45.605 04:32:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2945333 00:20:45.605 04:32:22 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:45.605 04:32:22 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:45.606 04:32:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2945333' 00:20:45.606 killing process with pid 2945333 00:20:45.606 04:32:22 -- common/autotest_common.sh@955 -- # kill 2945333 00:20:45.606 Received shutdown signal, test time was about 10.000000 seconds 00:20:45.606 00:20:45.606 Latency(us) 00:20:45.606 [2024-11-26T03:32:24.832Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:45.606 [2024-11-26T03:32:24.832Z] =================================================================================================================== 00:20:45.606 [2024-11-26T03:32:24.832Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:45.606 04:32:22 -- common/autotest_common.sh@960 -- # wait 2945333 00:20:45.606 04:32:22 -- target/tls.sh@224 -- # killprocess 2945267 00:20:45.606 04:32:22 -- common/autotest_common.sh@936 -- # '[' -z 2945267 ']' 00:20:45.606 04:32:22 -- common/autotest_common.sh@940 -- # kill -0 2945267 00:20:45.606 04:32:22 -- common/autotest_common.sh@941 -- # uname 00:20:45.606 04:32:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:45.606 04:32:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2945267 00:20:45.606 04:32:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:45.606 04:32:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:45.606 04:32:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2945267' 00:20:45.606 killing process with pid 2945267 00:20:45.606 04:32:22 -- common/autotest_common.sh@955 -- # kill 2945267 00:20:45.606 04:32:22 -- common/autotest_common.sh@960 -- # wait 2945267 00:20:45.606 04:32:23 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:20:45.606 04:32:23 -- target/tls.sh@227 -- # cleanup 00:20:45.606 04:32:23 -- target/tls.sh@15 -- # process_shm --id 0 00:20:45.606 04:32:23 -- common/autotest_common.sh@806 -- # type=--id 00:20:45.606 04:32:23 -- common/autotest_common.sh@807 -- # id=0 00:20:45.606 04:32:23 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:20:45.606 04:32:23 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:20:45.606 04:32:23 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:20:45.606 04:32:23 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:20:45.606 04:32:23 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:20:45.606 04:32:23 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:20:45.606 nvmf_trace.0 00:20:45.606 04:32:23 -- common/autotest_common.sh@821 -- # return 0 00:20:45.606 04:32:23 -- target/tls.sh@16 -- # killprocess 2945333 00:20:45.606 04:32:23 -- common/autotest_common.sh@936 -- # '[' -z 2945333 ']' 00:20:45.606 04:32:23 -- common/autotest_common.sh@940 -- # kill -0 2945333 00:20:45.606 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2945333) - No such process 00:20:45.606 04:32:23 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2945333 is not found' 00:20:45.606 Process with pid 2945333 is not found 00:20:45.606 04:32:23 -- target/tls.sh@17 -- # nvmftestfini 00:20:45.606 04:32:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:45.606 04:32:23 -- nvmf/common.sh@116 -- # sync 00:20:45.606 04:32:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:45.606 04:32:23 -- nvmf/common.sh@119 -- # set +e 00:20:45.606 04:32:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:45.606 04:32:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:45.606 rmmod nvme_tcp 00:20:45.606 rmmod nvme_fabrics 00:20:45.606 rmmod nvme_keyring 00:20:45.606 04:32:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:45.606 04:32:23 -- nvmf/common.sh@123 -- # set -e 00:20:45.606 04:32:23 -- nvmf/common.sh@124 -- # return 0 00:20:45.606 04:32:23 -- nvmf/common.sh@477 -- # '[' -n 2945267 ']' 00:20:45.606 04:32:23 -- nvmf/common.sh@478 -- # killprocess 2945267 00:20:45.606 04:32:23 -- common/autotest_common.sh@936 -- # '[' -z 2945267 ']' 00:20:45.606 04:32:23 -- common/autotest_common.sh@940 -- # kill -0 2945267 00:20:45.606 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2945267) - No such process 00:20:45.606 04:32:23 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2945267 is not found' 00:20:45.606 Process with pid 2945267 is not found 00:20:45.606 04:32:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:45.606 04:32:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:45.606 04:32:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:45.606 04:32:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:45.606 04:32:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:45.606 04:32:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:45.606 04:32:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:45.606 04:32:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:46.173 04:32:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:46.173 04:32:25 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:46.173 00:20:46.173 real 1m13.689s 00:20:46.173 user 1m55.831s 00:20:46.173 sys 0m24.484s 00:20:46.173 04:32:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:46.173 04:32:25 -- common/autotest_common.sh@10 -- # set +x 00:20:46.173 ************************************ 00:20:46.173 END TEST nvmf_tls 00:20:46.173 ************************************ 00:20:46.173 04:32:25 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:46.173 04:32:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:46.173 04:32:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:46.173 04:32:25 -- common/autotest_common.sh@10 -- # set +x 00:20:46.173 ************************************ 00:20:46.173 START TEST nvmf_fips 00:20:46.173 ************************************ 00:20:46.173 04:32:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:46.173 * Looking for test storage... 00:20:46.173 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:20:46.173 04:32:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:46.173 04:32:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:46.173 04:32:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:46.432 04:32:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:46.432 04:32:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:46.432 04:32:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:46.432 04:32:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:46.432 04:32:25 -- scripts/common.sh@335 -- # IFS=.-: 00:20:46.432 04:32:25 -- scripts/common.sh@335 -- # read -ra ver1 00:20:46.432 04:32:25 -- scripts/common.sh@336 -- # IFS=.-: 00:20:46.432 04:32:25 -- scripts/common.sh@336 -- # read -ra ver2 00:20:46.432 04:32:25 -- scripts/common.sh@337 -- # local 'op=<' 00:20:46.432 04:32:25 -- scripts/common.sh@339 -- # ver1_l=2 00:20:46.433 04:32:25 -- scripts/common.sh@340 -- # ver2_l=1 00:20:46.433 04:32:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:46.433 04:32:25 -- scripts/common.sh@343 -- # case "$op" in 00:20:46.433 04:32:25 -- scripts/common.sh@344 -- # : 1 00:20:46.433 04:32:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:46.433 04:32:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:46.433 04:32:25 -- scripts/common.sh@364 -- # decimal 1 00:20:46.433 04:32:25 -- scripts/common.sh@352 -- # local d=1 00:20:46.433 04:32:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:46.433 04:32:25 -- scripts/common.sh@354 -- # echo 1 00:20:46.433 04:32:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:46.433 04:32:25 -- scripts/common.sh@365 -- # decimal 2 00:20:46.433 04:32:25 -- scripts/common.sh@352 -- # local d=2 00:20:46.433 04:32:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:46.433 04:32:25 -- scripts/common.sh@354 -- # echo 2 00:20:46.433 04:32:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:46.433 04:32:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:46.433 04:32:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:46.433 04:32:25 -- scripts/common.sh@367 -- # return 0 00:20:46.433 04:32:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:46.433 04:32:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:46.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:46.433 --rc genhtml_branch_coverage=1 00:20:46.433 --rc genhtml_function_coverage=1 00:20:46.433 --rc genhtml_legend=1 00:20:46.433 --rc geninfo_all_blocks=1 00:20:46.433 --rc geninfo_unexecuted_blocks=1 00:20:46.433 00:20:46.433 ' 00:20:46.433 04:32:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:46.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:46.433 --rc genhtml_branch_coverage=1 00:20:46.433 --rc genhtml_function_coverage=1 00:20:46.433 --rc genhtml_legend=1 00:20:46.433 --rc geninfo_all_blocks=1 00:20:46.433 --rc geninfo_unexecuted_blocks=1 00:20:46.433 00:20:46.433 ' 00:20:46.433 04:32:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:46.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:46.433 --rc genhtml_branch_coverage=1 00:20:46.433 --rc genhtml_function_coverage=1 00:20:46.433 --rc genhtml_legend=1 00:20:46.433 --rc geninfo_all_blocks=1 00:20:46.433 --rc geninfo_unexecuted_blocks=1 00:20:46.433 00:20:46.433 ' 00:20:46.433 04:32:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:46.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:46.433 --rc genhtml_branch_coverage=1 00:20:46.433 --rc genhtml_function_coverage=1 00:20:46.433 --rc genhtml_legend=1 00:20:46.433 --rc geninfo_all_blocks=1 00:20:46.433 --rc geninfo_unexecuted_blocks=1 00:20:46.433 00:20:46.433 ' 00:20:46.433 04:32:25 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:46.433 04:32:25 -- nvmf/common.sh@7 -- # uname -s 00:20:46.433 04:32:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:46.433 04:32:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:46.433 04:32:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:46.433 04:32:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:46.433 04:32:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:46.433 04:32:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:46.433 04:32:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:46.433 04:32:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:46.433 04:32:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:46.433 04:32:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:46.433 04:32:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:46.433 04:32:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:46.433 04:32:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:46.433 04:32:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:46.433 04:32:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:46.433 04:32:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:46.433 04:32:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:46.433 04:32:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:46.433 04:32:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:46.433 04:32:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:46.433 04:32:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:46.433 04:32:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:46.433 04:32:25 -- paths/export.sh@5 -- # export PATH 00:20:46.433 04:32:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:46.433 04:32:25 -- nvmf/common.sh@46 -- # : 0 00:20:46.433 04:32:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:46.433 04:32:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:46.433 04:32:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:46.433 04:32:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:46.433 04:32:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:46.433 04:32:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:46.433 04:32:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:46.433 04:32:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:46.433 04:32:25 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:46.433 04:32:25 -- fips/fips.sh@89 -- # check_openssl_version 00:20:46.433 04:32:25 -- fips/fips.sh@83 -- # local target=3.0.0 00:20:46.433 04:32:25 -- fips/fips.sh@85 -- # openssl version 00:20:46.433 04:32:25 -- fips/fips.sh@85 -- # awk '{print $2}' 00:20:46.433 04:32:25 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:20:46.433 04:32:25 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:20:46.433 04:32:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:46.433 04:32:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:46.433 04:32:25 -- scripts/common.sh@335 -- # IFS=.-: 00:20:46.433 04:32:25 -- scripts/common.sh@335 -- # read -ra ver1 00:20:46.433 04:32:25 -- scripts/common.sh@336 -- # IFS=.-: 00:20:46.433 04:32:25 -- scripts/common.sh@336 -- # read -ra ver2 00:20:46.433 04:32:25 -- scripts/common.sh@337 -- # local 'op=>=' 00:20:46.433 04:32:25 -- scripts/common.sh@339 -- # ver1_l=3 00:20:46.433 04:32:25 -- scripts/common.sh@340 -- # ver2_l=3 00:20:46.434 04:32:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:46.434 04:32:25 -- scripts/common.sh@343 -- # case "$op" in 00:20:46.434 04:32:25 -- scripts/common.sh@347 -- # : 1 00:20:46.434 04:32:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:46.434 04:32:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:46.434 04:32:25 -- scripts/common.sh@364 -- # decimal 3 00:20:46.434 04:32:25 -- scripts/common.sh@352 -- # local d=3 00:20:46.434 04:32:25 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:46.434 04:32:25 -- scripts/common.sh@354 -- # echo 3 00:20:46.434 04:32:25 -- scripts/common.sh@364 -- # ver1[v]=3 00:20:46.434 04:32:25 -- scripts/common.sh@365 -- # decimal 3 00:20:46.434 04:32:25 -- scripts/common.sh@352 -- # local d=3 00:20:46.434 04:32:25 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:46.434 04:32:25 -- scripts/common.sh@354 -- # echo 3 00:20:46.434 04:32:25 -- scripts/common.sh@365 -- # ver2[v]=3 00:20:46.434 04:32:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:46.434 04:32:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:46.434 04:32:25 -- scripts/common.sh@363 -- # (( v++ )) 00:20:46.434 04:32:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:46.434 04:32:25 -- scripts/common.sh@364 -- # decimal 1 00:20:46.434 04:32:25 -- scripts/common.sh@352 -- # local d=1 00:20:46.434 04:32:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:46.434 04:32:25 -- scripts/common.sh@354 -- # echo 1 00:20:46.434 04:32:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:46.434 04:32:25 -- scripts/common.sh@365 -- # decimal 0 00:20:46.434 04:32:25 -- scripts/common.sh@352 -- # local d=0 00:20:46.434 04:32:25 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:46.434 04:32:25 -- scripts/common.sh@354 -- # echo 0 00:20:46.434 04:32:25 -- scripts/common.sh@365 -- # ver2[v]=0 00:20:46.434 04:32:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:46.434 04:32:25 -- scripts/common.sh@366 -- # return 0 00:20:46.434 04:32:25 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:20:46.434 04:32:25 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:20:46.434 04:32:25 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:20:46.434 04:32:25 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:20:46.434 04:32:25 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:20:46.434 04:32:25 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:20:46.434 04:32:25 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:20:46.434 04:32:25 -- fips/fips.sh@113 -- # build_openssl_config 00:20:46.434 04:32:25 -- fips/fips.sh@37 -- # cat 00:20:46.434 04:32:25 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:20:46.434 04:32:25 -- fips/fips.sh@58 -- # cat - 00:20:46.434 04:32:25 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:20:46.434 04:32:25 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:20:46.434 04:32:25 -- fips/fips.sh@116 -- # mapfile -t providers 00:20:46.434 04:32:25 -- fips/fips.sh@116 -- # openssl list -providers 00:20:46.434 04:32:25 -- fips/fips.sh@116 -- # grep name 00:20:46.434 04:32:25 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:20:46.434 04:32:25 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:20:46.434 04:32:25 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:20:46.434 04:32:25 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:20:46.434 04:32:25 -- fips/fips.sh@127 -- # : 00:20:46.434 04:32:25 -- common/autotest_common.sh@650 -- # local es=0 00:20:46.434 04:32:25 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:20:46.434 04:32:25 -- common/autotest_common.sh@638 -- # local arg=openssl 00:20:46.434 04:32:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:46.434 04:32:25 -- common/autotest_common.sh@642 -- # type -t openssl 00:20:46.434 04:32:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:46.434 04:32:25 -- common/autotest_common.sh@644 -- # type -P openssl 00:20:46.434 04:32:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:46.434 04:32:25 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:20:46.434 04:32:25 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:20:46.434 04:32:25 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:20:46.434 Error setting digest 00:20:46.434 40428C115B7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:20:46.434 40428C115B7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:20:46.434 04:32:25 -- common/autotest_common.sh@653 -- # es=1 00:20:46.434 04:32:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:46.434 04:32:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:46.434 04:32:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:46.434 04:32:25 -- fips/fips.sh@130 -- # nvmftestinit 00:20:46.434 04:32:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:46.434 04:32:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:46.434 04:32:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:46.434 04:32:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:46.434 04:32:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:46.434 04:32:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:46.434 04:32:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:46.434 04:32:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:46.434 04:32:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:46.434 04:32:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:46.434 04:32:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:46.434 04:32:25 -- common/autotest_common.sh@10 -- # set +x 00:20:48.970 04:32:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:48.970 04:32:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:48.970 04:32:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:48.970 04:32:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:48.970 04:32:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:48.970 04:32:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:48.970 04:32:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:48.970 04:32:27 -- nvmf/common.sh@294 -- # net_devs=() 00:20:48.970 04:32:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:48.970 04:32:27 -- nvmf/common.sh@295 -- # e810=() 00:20:48.970 04:32:27 -- nvmf/common.sh@295 -- # local -ga e810 00:20:48.970 04:32:27 -- nvmf/common.sh@296 -- # x722=() 00:20:48.970 04:32:27 -- nvmf/common.sh@296 -- # local -ga x722 00:20:48.970 04:32:27 -- nvmf/common.sh@297 -- # mlx=() 00:20:48.970 04:32:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:48.970 04:32:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:48.970 04:32:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:48.970 04:32:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:48.970 04:32:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:48.970 04:32:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:48.970 04:32:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:48.970 04:32:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:48.970 04:32:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:48.970 04:32:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:48.970 04:32:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:48.970 04:32:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:48.970 04:32:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:48.970 04:32:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:48.970 04:32:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:48.970 04:32:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:48.970 04:32:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:48.970 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:48.970 04:32:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:48.970 04:32:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:48.970 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:48.970 04:32:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:48.970 04:32:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:48.970 04:32:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:48.970 04:32:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:48.970 04:32:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:48.970 04:32:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:48.970 04:32:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:48.970 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:48.970 04:32:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:48.970 04:32:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:48.970 04:32:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:48.970 04:32:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:48.970 04:32:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:48.970 04:32:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:48.970 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:48.971 04:32:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:48.971 04:32:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:48.971 04:32:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:48.971 04:32:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:48.971 04:32:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:48.971 04:32:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:48.971 04:32:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:48.971 04:32:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:48.971 04:32:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:48.971 04:32:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:48.971 04:32:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:48.971 04:32:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:48.971 04:32:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:48.971 04:32:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:48.971 04:32:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:48.971 04:32:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:48.971 04:32:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:48.971 04:32:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:48.971 04:32:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:48.971 04:32:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:48.971 04:32:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:48.971 04:32:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:48.971 04:32:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:48.971 04:32:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:48.971 04:32:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:48.971 04:32:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:48.971 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:48.971 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.319 ms 00:20:48.971 00:20:48.971 --- 10.0.0.2 ping statistics --- 00:20:48.971 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:48.971 rtt min/avg/max/mdev = 0.319/0.319/0.319/0.000 ms 00:20:48.971 04:32:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:48.971 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:48.971 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.193 ms 00:20:48.971 00:20:48.971 --- 10.0.0.1 ping statistics --- 00:20:48.971 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:48.971 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:20:48.971 04:32:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:48.971 04:32:27 -- nvmf/common.sh@410 -- # return 0 00:20:48.971 04:32:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:48.971 04:32:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:48.971 04:32:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:48.971 04:32:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:48.971 04:32:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:48.971 04:32:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:48.971 04:32:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:48.971 04:32:27 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:20:48.971 04:32:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:48.971 04:32:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:48.971 04:32:27 -- common/autotest_common.sh@10 -- # set +x 00:20:48.971 04:32:27 -- nvmf/common.sh@469 -- # nvmfpid=2948789 00:20:48.971 04:32:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:48.971 04:32:27 -- nvmf/common.sh@470 -- # waitforlisten 2948789 00:20:48.971 04:32:27 -- common/autotest_common.sh@829 -- # '[' -z 2948789 ']' 00:20:48.971 04:32:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:48.971 04:32:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:48.971 04:32:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:48.971 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:48.971 04:32:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:48.971 04:32:27 -- common/autotest_common.sh@10 -- # set +x 00:20:48.971 [2024-11-26 04:32:27.916341] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:48.971 [2024-11-26 04:32:27.916438] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:48.971 EAL: No free 2048 kB hugepages reported on node 1 00:20:48.971 [2024-11-26 04:32:27.980851] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:48.971 [2024-11-26 04:32:28.066323] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:48.971 [2024-11-26 04:32:28.066477] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:48.971 [2024-11-26 04:32:28.066492] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:48.971 [2024-11-26 04:32:28.066504] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:48.971 [2024-11-26 04:32:28.066537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:49.910 04:32:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:49.910 04:32:28 -- common/autotest_common.sh@862 -- # return 0 00:20:49.910 04:32:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:49.910 04:32:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:49.910 04:32:28 -- common/autotest_common.sh@10 -- # set +x 00:20:49.910 04:32:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:49.910 04:32:28 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:20:49.910 04:32:28 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:20:49.910 04:32:28 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:49.910 04:32:28 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:20:49.910 04:32:28 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:49.910 04:32:28 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:49.910 04:32:28 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:49.910 04:32:28 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:50.167 [2024-11-26 04:32:29.194879] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:50.167 [2024-11-26 04:32:29.210867] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:50.167 [2024-11-26 04:32:29.211143] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:50.167 malloc0 00:20:50.167 04:32:29 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:50.167 04:32:29 -- fips/fips.sh@147 -- # bdevperf_pid=2948953 00:20:50.167 04:32:29 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:50.167 04:32:29 -- fips/fips.sh@148 -- # waitforlisten 2948953 /var/tmp/bdevperf.sock 00:20:50.167 04:32:29 -- common/autotest_common.sh@829 -- # '[' -z 2948953 ']' 00:20:50.167 04:32:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:50.167 04:32:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:50.167 04:32:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:50.167 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:50.167 04:32:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:50.167 04:32:29 -- common/autotest_common.sh@10 -- # set +x 00:20:50.167 [2024-11-26 04:32:29.331516] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:50.167 [2024-11-26 04:32:29.331592] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2948953 ] 00:20:50.167 EAL: No free 2048 kB hugepages reported on node 1 00:20:50.167 [2024-11-26 04:32:29.388874] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:50.425 [2024-11-26 04:32:29.470715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:51.362 04:32:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:51.362 04:32:30 -- common/autotest_common.sh@862 -- # return 0 00:20:51.362 04:32:30 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:51.362 [2024-11-26 04:32:30.549923] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:51.621 TLSTESTn1 00:20:51.621 04:32:30 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:51.621 Running I/O for 10 seconds... 00:21:01.608 00:21:01.608 Latency(us) 00:21:01.608 [2024-11-26T03:32:40.834Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:01.608 [2024-11-26T03:32:40.834Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:01.608 Verification LBA range: start 0x0 length 0x2000 00:21:01.608 TLSTESTn1 : 10.02 4527.43 17.69 0.00 0.00 28233.16 4951.61 46020.84 00:21:01.608 [2024-11-26T03:32:40.834Z] =================================================================================================================== 00:21:01.608 [2024-11-26T03:32:40.834Z] Total : 4527.43 17.69 0.00 0.00 28233.16 4951.61 46020.84 00:21:01.608 0 00:21:01.608 04:32:40 -- fips/fips.sh@1 -- # cleanup 00:21:01.608 04:32:40 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:01.608 04:32:40 -- common/autotest_common.sh@806 -- # type=--id 00:21:01.608 04:32:40 -- common/autotest_common.sh@807 -- # id=0 00:21:01.608 04:32:40 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:01.608 04:32:40 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:01.608 04:32:40 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:01.608 04:32:40 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:01.608 04:32:40 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:01.608 04:32:40 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:01.608 nvmf_trace.0 00:21:01.869 04:32:40 -- common/autotest_common.sh@821 -- # return 0 00:21:01.869 04:32:40 -- fips/fips.sh@16 -- # killprocess 2948953 00:21:01.869 04:32:40 -- common/autotest_common.sh@936 -- # '[' -z 2948953 ']' 00:21:01.869 04:32:40 -- common/autotest_common.sh@940 -- # kill -0 2948953 00:21:01.869 04:32:40 -- common/autotest_common.sh@941 -- # uname 00:21:01.869 04:32:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:01.869 04:32:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2948953 00:21:01.869 04:32:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:01.869 04:32:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:01.869 04:32:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2948953' 00:21:01.869 killing process with pid 2948953 00:21:01.869 04:32:40 -- common/autotest_common.sh@955 -- # kill 2948953 00:21:01.869 Received shutdown signal, test time was about 10.000000 seconds 00:21:01.869 00:21:01.869 Latency(us) 00:21:01.869 [2024-11-26T03:32:41.095Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:01.869 [2024-11-26T03:32:41.095Z] =================================================================================================================== 00:21:01.869 [2024-11-26T03:32:41.095Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:01.869 04:32:40 -- common/autotest_common.sh@960 -- # wait 2948953 00:21:02.129 04:32:41 -- fips/fips.sh@17 -- # nvmftestfini 00:21:02.129 04:32:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:02.129 04:32:41 -- nvmf/common.sh@116 -- # sync 00:21:02.129 04:32:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:02.129 04:32:41 -- nvmf/common.sh@119 -- # set +e 00:21:02.129 04:32:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:02.129 04:32:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:02.129 rmmod nvme_tcp 00:21:02.129 rmmod nvme_fabrics 00:21:02.129 rmmod nvme_keyring 00:21:02.129 04:32:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:02.129 04:32:41 -- nvmf/common.sh@123 -- # set -e 00:21:02.129 04:32:41 -- nvmf/common.sh@124 -- # return 0 00:21:02.129 04:32:41 -- nvmf/common.sh@477 -- # '[' -n 2948789 ']' 00:21:02.129 04:32:41 -- nvmf/common.sh@478 -- # killprocess 2948789 00:21:02.129 04:32:41 -- common/autotest_common.sh@936 -- # '[' -z 2948789 ']' 00:21:02.129 04:32:41 -- common/autotest_common.sh@940 -- # kill -0 2948789 00:21:02.129 04:32:41 -- common/autotest_common.sh@941 -- # uname 00:21:02.129 04:32:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:02.129 04:32:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2948789 00:21:02.129 04:32:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:02.129 04:32:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:02.129 04:32:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2948789' 00:21:02.129 killing process with pid 2948789 00:21:02.129 04:32:41 -- common/autotest_common.sh@955 -- # kill 2948789 00:21:02.129 04:32:41 -- common/autotest_common.sh@960 -- # wait 2948789 00:21:02.389 04:32:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:02.389 04:32:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:02.389 04:32:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:02.389 04:32:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:02.389 04:32:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:02.389 04:32:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:02.389 04:32:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:02.389 04:32:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:04.296 04:32:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:04.297 04:32:43 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:04.556 00:21:04.556 real 0m18.180s 00:21:04.556 user 0m23.937s 00:21:04.556 sys 0m5.843s 00:21:04.556 04:32:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:04.556 04:32:43 -- common/autotest_common.sh@10 -- # set +x 00:21:04.556 ************************************ 00:21:04.556 END TEST nvmf_fips 00:21:04.556 ************************************ 00:21:04.556 04:32:43 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:04.556 04:32:43 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:04.556 04:32:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:04.556 04:32:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:04.556 04:32:43 -- common/autotest_common.sh@10 -- # set +x 00:21:04.556 ************************************ 00:21:04.556 START TEST nvmf_fuzz 00:21:04.556 ************************************ 00:21:04.556 04:32:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:04.556 * Looking for test storage... 00:21:04.556 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:04.556 04:32:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:04.556 04:32:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:04.556 04:32:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:04.556 04:32:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:04.556 04:32:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:04.556 04:32:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:04.556 04:32:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:04.556 04:32:43 -- scripts/common.sh@335 -- # IFS=.-: 00:21:04.556 04:32:43 -- scripts/common.sh@335 -- # read -ra ver1 00:21:04.556 04:32:43 -- scripts/common.sh@336 -- # IFS=.-: 00:21:04.556 04:32:43 -- scripts/common.sh@336 -- # read -ra ver2 00:21:04.556 04:32:43 -- scripts/common.sh@337 -- # local 'op=<' 00:21:04.556 04:32:43 -- scripts/common.sh@339 -- # ver1_l=2 00:21:04.556 04:32:43 -- scripts/common.sh@340 -- # ver2_l=1 00:21:04.556 04:32:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:04.556 04:32:43 -- scripts/common.sh@343 -- # case "$op" in 00:21:04.556 04:32:43 -- scripts/common.sh@344 -- # : 1 00:21:04.556 04:32:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:04.556 04:32:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:04.556 04:32:43 -- scripts/common.sh@364 -- # decimal 1 00:21:04.556 04:32:43 -- scripts/common.sh@352 -- # local d=1 00:21:04.556 04:32:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:04.556 04:32:43 -- scripts/common.sh@354 -- # echo 1 00:21:04.556 04:32:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:04.556 04:32:43 -- scripts/common.sh@365 -- # decimal 2 00:21:04.556 04:32:43 -- scripts/common.sh@352 -- # local d=2 00:21:04.556 04:32:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:04.556 04:32:43 -- scripts/common.sh@354 -- # echo 2 00:21:04.556 04:32:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:04.556 04:32:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:04.556 04:32:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:04.556 04:32:43 -- scripts/common.sh@367 -- # return 0 00:21:04.556 04:32:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:04.556 04:32:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:04.556 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:04.556 --rc genhtml_branch_coverage=1 00:21:04.556 --rc genhtml_function_coverage=1 00:21:04.556 --rc genhtml_legend=1 00:21:04.556 --rc geninfo_all_blocks=1 00:21:04.556 --rc geninfo_unexecuted_blocks=1 00:21:04.556 00:21:04.556 ' 00:21:04.556 04:32:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:04.556 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:04.556 --rc genhtml_branch_coverage=1 00:21:04.557 --rc genhtml_function_coverage=1 00:21:04.557 --rc genhtml_legend=1 00:21:04.557 --rc geninfo_all_blocks=1 00:21:04.557 --rc geninfo_unexecuted_blocks=1 00:21:04.557 00:21:04.557 ' 00:21:04.557 04:32:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:04.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:04.557 --rc genhtml_branch_coverage=1 00:21:04.557 --rc genhtml_function_coverage=1 00:21:04.557 --rc genhtml_legend=1 00:21:04.557 --rc geninfo_all_blocks=1 00:21:04.557 --rc geninfo_unexecuted_blocks=1 00:21:04.557 00:21:04.557 ' 00:21:04.557 04:32:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:04.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:04.557 --rc genhtml_branch_coverage=1 00:21:04.557 --rc genhtml_function_coverage=1 00:21:04.557 --rc genhtml_legend=1 00:21:04.557 --rc geninfo_all_blocks=1 00:21:04.557 --rc geninfo_unexecuted_blocks=1 00:21:04.557 00:21:04.557 ' 00:21:04.557 04:32:43 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:04.557 04:32:43 -- nvmf/common.sh@7 -- # uname -s 00:21:04.557 04:32:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:04.557 04:32:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:04.557 04:32:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:04.557 04:32:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:04.557 04:32:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:04.557 04:32:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:04.557 04:32:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:04.557 04:32:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:04.557 04:32:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:04.557 04:32:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:04.557 04:32:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:04.557 04:32:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:04.557 04:32:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:04.557 04:32:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:04.557 04:32:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:04.557 04:32:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:04.557 04:32:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:04.557 04:32:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:04.557 04:32:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:04.557 04:32:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.557 04:32:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.557 04:32:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.557 04:32:43 -- paths/export.sh@5 -- # export PATH 00:21:04.557 04:32:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.557 04:32:43 -- nvmf/common.sh@46 -- # : 0 00:21:04.557 04:32:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:04.557 04:32:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:04.557 04:32:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:04.557 04:32:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:04.557 04:32:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:04.557 04:32:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:04.557 04:32:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:04.557 04:32:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:04.557 04:32:43 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:04.557 04:32:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:04.557 04:32:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:04.557 04:32:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:04.557 04:32:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:04.557 04:32:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:04.557 04:32:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:04.557 04:32:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:04.557 04:32:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:04.557 04:32:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:04.557 04:32:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:04.557 04:32:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:04.557 04:32:43 -- common/autotest_common.sh@10 -- # set +x 00:21:06.462 04:32:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:06.462 04:32:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:06.462 04:32:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:06.462 04:32:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:06.462 04:32:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:06.462 04:32:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:06.462 04:32:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:06.462 04:32:45 -- nvmf/common.sh@294 -- # net_devs=() 00:21:06.462 04:32:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:06.462 04:32:45 -- nvmf/common.sh@295 -- # e810=() 00:21:06.462 04:32:45 -- nvmf/common.sh@295 -- # local -ga e810 00:21:06.462 04:32:45 -- nvmf/common.sh@296 -- # x722=() 00:21:06.462 04:32:45 -- nvmf/common.sh@296 -- # local -ga x722 00:21:06.462 04:32:45 -- nvmf/common.sh@297 -- # mlx=() 00:21:06.463 04:32:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:06.463 04:32:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:06.463 04:32:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:06.463 04:32:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:06.463 04:32:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:06.463 04:32:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:06.463 04:32:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:06.463 04:32:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:06.463 04:32:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:06.463 04:32:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:06.463 04:32:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:06.463 04:32:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:06.463 04:32:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:06.463 04:32:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:06.463 04:32:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:06.463 04:32:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:06.463 04:32:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:06.463 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:06.463 04:32:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:06.463 04:32:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:06.463 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:06.463 04:32:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:06.463 04:32:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:06.463 04:32:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:06.463 04:32:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:06.463 04:32:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:06.463 04:32:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:06.463 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:06.463 04:32:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:06.463 04:32:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:06.463 04:32:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:06.463 04:32:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:06.463 04:32:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:06.463 04:32:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:06.463 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:06.463 04:32:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:06.463 04:32:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:06.463 04:32:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:06.463 04:32:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:06.463 04:32:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:06.463 04:32:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:06.463 04:32:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:06.463 04:32:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:06.463 04:32:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:06.463 04:32:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:06.463 04:32:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:06.463 04:32:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:06.463 04:32:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:06.463 04:32:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:06.463 04:32:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:06.722 04:32:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:06.722 04:32:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:06.722 04:32:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:06.722 04:32:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:06.722 04:32:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:06.722 04:32:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:06.722 04:32:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:06.722 04:32:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:06.722 04:32:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:06.722 04:32:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:06.722 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:06.722 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:21:06.722 00:21:06.722 --- 10.0.0.2 ping statistics --- 00:21:06.722 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:06.722 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:21:06.722 04:32:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:06.722 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:06.722 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:21:06.722 00:21:06.722 --- 10.0.0.1 ping statistics --- 00:21:06.722 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:06.722 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:21:06.722 04:32:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:06.722 04:32:45 -- nvmf/common.sh@410 -- # return 0 00:21:06.722 04:32:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:06.722 04:32:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:06.722 04:32:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:06.722 04:32:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:06.722 04:32:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:06.722 04:32:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:06.722 04:32:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:06.722 04:32:45 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=2952394 00:21:06.722 04:32:45 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:06.722 04:32:45 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:06.722 04:32:45 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 2952394 00:21:06.722 04:32:45 -- common/autotest_common.sh@829 -- # '[' -z 2952394 ']' 00:21:06.722 04:32:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:06.722 04:32:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:06.722 04:32:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:06.722 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:06.722 04:32:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:06.722 04:32:45 -- common/autotest_common.sh@10 -- # set +x 00:21:07.662 04:32:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:07.662 04:32:46 -- common/autotest_common.sh@862 -- # return 0 00:21:07.662 04:32:46 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:07.662 04:32:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:07.662 04:32:46 -- common/autotest_common.sh@10 -- # set +x 00:21:07.662 04:32:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:07.662 04:32:46 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:07.662 04:32:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:07.662 04:32:46 -- common/autotest_common.sh@10 -- # set +x 00:21:07.920 Malloc0 00:21:07.920 04:32:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:07.920 04:32:46 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:07.920 04:32:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:07.920 04:32:46 -- common/autotest_common.sh@10 -- # set +x 00:21:07.920 04:32:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:07.920 04:32:46 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:07.920 04:32:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:07.920 04:32:46 -- common/autotest_common.sh@10 -- # set +x 00:21:07.920 04:32:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:07.920 04:32:46 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:07.920 04:32:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:07.920 04:32:46 -- common/autotest_common.sh@10 -- # set +x 00:21:07.920 04:32:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:07.920 04:32:46 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:07.920 04:32:46 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:21:40.035 Fuzzing completed. Shutting down the fuzz application 00:21:40.035 00:21:40.035 Dumping successful admin opcodes: 00:21:40.035 8, 9, 10, 24, 00:21:40.035 Dumping successful io opcodes: 00:21:40.035 0, 9, 00:21:40.035 NS: 0x200003aeff00 I/O qp, Total commands completed: 472682, total successful commands: 2730, random_seed: 4092573888 00:21:40.035 NS: 0x200003aeff00 admin qp, Total commands completed: 58160, total successful commands: 463, random_seed: 691745280 00:21:40.035 04:33:17 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:21:40.035 Fuzzing completed. Shutting down the fuzz application 00:21:40.035 00:21:40.035 Dumping successful admin opcodes: 00:21:40.035 24, 00:21:40.035 Dumping successful io opcodes: 00:21:40.035 00:21:40.035 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 2071305053 00:21:40.035 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 2071450829 00:21:40.035 04:33:18 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:40.035 04:33:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.035 04:33:18 -- common/autotest_common.sh@10 -- # set +x 00:21:40.035 04:33:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.035 04:33:18 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:21:40.035 04:33:18 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:21:40.035 04:33:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:40.035 04:33:18 -- nvmf/common.sh@116 -- # sync 00:21:40.035 04:33:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:40.035 04:33:18 -- nvmf/common.sh@119 -- # set +e 00:21:40.035 04:33:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:40.035 04:33:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:40.035 rmmod nvme_tcp 00:21:40.035 rmmod nvme_fabrics 00:21:40.035 rmmod nvme_keyring 00:21:40.035 04:33:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:40.035 04:33:18 -- nvmf/common.sh@123 -- # set -e 00:21:40.035 04:33:18 -- nvmf/common.sh@124 -- # return 0 00:21:40.035 04:33:18 -- nvmf/common.sh@477 -- # '[' -n 2952394 ']' 00:21:40.035 04:33:18 -- nvmf/common.sh@478 -- # killprocess 2952394 00:21:40.035 04:33:18 -- common/autotest_common.sh@936 -- # '[' -z 2952394 ']' 00:21:40.035 04:33:18 -- common/autotest_common.sh@940 -- # kill -0 2952394 00:21:40.035 04:33:18 -- common/autotest_common.sh@941 -- # uname 00:21:40.035 04:33:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:40.035 04:33:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2952394 00:21:40.035 04:33:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:40.035 04:33:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:40.035 04:33:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2952394' 00:21:40.035 killing process with pid 2952394 00:21:40.035 04:33:18 -- common/autotest_common.sh@955 -- # kill 2952394 00:21:40.035 04:33:18 -- common/autotest_common.sh@960 -- # wait 2952394 00:21:40.035 04:33:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:40.035 04:33:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:40.035 04:33:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:40.035 04:33:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:40.036 04:33:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:40.036 04:33:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:40.036 04:33:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:40.036 04:33:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:41.944 04:33:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:41.944 04:33:21 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:21:41.944 00:21:41.944 real 0m37.576s 00:21:41.944 user 0m51.919s 00:21:41.944 sys 0m15.107s 00:21:41.944 04:33:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:41.944 04:33:21 -- common/autotest_common.sh@10 -- # set +x 00:21:41.944 ************************************ 00:21:41.944 END TEST nvmf_fuzz 00:21:41.944 ************************************ 00:21:41.944 04:33:21 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:41.944 04:33:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:41.944 04:33:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:41.944 04:33:21 -- common/autotest_common.sh@10 -- # set +x 00:21:41.944 ************************************ 00:21:41.944 START TEST nvmf_multiconnection 00:21:41.944 ************************************ 00:21:41.944 04:33:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:42.204 * Looking for test storage... 00:21:42.204 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:42.204 04:33:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:42.204 04:33:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:42.204 04:33:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:42.204 04:33:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:42.204 04:33:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:42.204 04:33:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:42.204 04:33:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:42.204 04:33:21 -- scripts/common.sh@335 -- # IFS=.-: 00:21:42.204 04:33:21 -- scripts/common.sh@335 -- # read -ra ver1 00:21:42.204 04:33:21 -- scripts/common.sh@336 -- # IFS=.-: 00:21:42.204 04:33:21 -- scripts/common.sh@336 -- # read -ra ver2 00:21:42.204 04:33:21 -- scripts/common.sh@337 -- # local 'op=<' 00:21:42.204 04:33:21 -- scripts/common.sh@339 -- # ver1_l=2 00:21:42.204 04:33:21 -- scripts/common.sh@340 -- # ver2_l=1 00:21:42.204 04:33:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:42.204 04:33:21 -- scripts/common.sh@343 -- # case "$op" in 00:21:42.204 04:33:21 -- scripts/common.sh@344 -- # : 1 00:21:42.204 04:33:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:42.204 04:33:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:42.204 04:33:21 -- scripts/common.sh@364 -- # decimal 1 00:21:42.204 04:33:21 -- scripts/common.sh@352 -- # local d=1 00:21:42.204 04:33:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:42.204 04:33:21 -- scripts/common.sh@354 -- # echo 1 00:21:42.204 04:33:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:42.204 04:33:21 -- scripts/common.sh@365 -- # decimal 2 00:21:42.204 04:33:21 -- scripts/common.sh@352 -- # local d=2 00:21:42.204 04:33:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:42.204 04:33:21 -- scripts/common.sh@354 -- # echo 2 00:21:42.204 04:33:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:42.204 04:33:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:42.204 04:33:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:42.204 04:33:21 -- scripts/common.sh@367 -- # return 0 00:21:42.204 04:33:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:42.204 04:33:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:42.204 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:42.204 --rc genhtml_branch_coverage=1 00:21:42.204 --rc genhtml_function_coverage=1 00:21:42.204 --rc genhtml_legend=1 00:21:42.204 --rc geninfo_all_blocks=1 00:21:42.204 --rc geninfo_unexecuted_blocks=1 00:21:42.204 00:21:42.204 ' 00:21:42.204 04:33:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:42.204 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:42.204 --rc genhtml_branch_coverage=1 00:21:42.204 --rc genhtml_function_coverage=1 00:21:42.204 --rc genhtml_legend=1 00:21:42.204 --rc geninfo_all_blocks=1 00:21:42.204 --rc geninfo_unexecuted_blocks=1 00:21:42.204 00:21:42.204 ' 00:21:42.204 04:33:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:42.204 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:42.204 --rc genhtml_branch_coverage=1 00:21:42.204 --rc genhtml_function_coverage=1 00:21:42.204 --rc genhtml_legend=1 00:21:42.204 --rc geninfo_all_blocks=1 00:21:42.204 --rc geninfo_unexecuted_blocks=1 00:21:42.204 00:21:42.204 ' 00:21:42.204 04:33:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:42.204 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:42.204 --rc genhtml_branch_coverage=1 00:21:42.204 --rc genhtml_function_coverage=1 00:21:42.204 --rc genhtml_legend=1 00:21:42.204 --rc geninfo_all_blocks=1 00:21:42.204 --rc geninfo_unexecuted_blocks=1 00:21:42.204 00:21:42.204 ' 00:21:42.204 04:33:21 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:42.204 04:33:21 -- nvmf/common.sh@7 -- # uname -s 00:21:42.204 04:33:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:42.204 04:33:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:42.204 04:33:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:42.204 04:33:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:42.204 04:33:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:42.204 04:33:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:42.204 04:33:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:42.204 04:33:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:42.204 04:33:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:42.204 04:33:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:42.204 04:33:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:42.204 04:33:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:42.204 04:33:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:42.204 04:33:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:42.204 04:33:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:42.204 04:33:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:42.204 04:33:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:42.204 04:33:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:42.204 04:33:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:42.204 04:33:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:42.204 04:33:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:42.204 04:33:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:42.204 04:33:21 -- paths/export.sh@5 -- # export PATH 00:21:42.204 04:33:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:42.204 04:33:21 -- nvmf/common.sh@46 -- # : 0 00:21:42.204 04:33:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:42.204 04:33:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:42.204 04:33:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:42.204 04:33:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:42.204 04:33:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:42.204 04:33:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:42.204 04:33:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:42.204 04:33:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:42.204 04:33:21 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:42.204 04:33:21 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:42.204 04:33:21 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:21:42.204 04:33:21 -- target/multiconnection.sh@16 -- # nvmftestinit 00:21:42.204 04:33:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:42.204 04:33:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:42.204 04:33:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:42.204 04:33:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:42.204 04:33:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:42.204 04:33:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:42.204 04:33:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:42.204 04:33:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:42.205 04:33:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:42.205 04:33:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:42.205 04:33:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:42.205 04:33:21 -- common/autotest_common.sh@10 -- # set +x 00:21:44.743 04:33:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:44.743 04:33:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:44.743 04:33:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:44.743 04:33:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:44.743 04:33:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:44.743 04:33:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:44.743 04:33:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:44.743 04:33:23 -- nvmf/common.sh@294 -- # net_devs=() 00:21:44.743 04:33:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:44.743 04:33:23 -- nvmf/common.sh@295 -- # e810=() 00:21:44.743 04:33:23 -- nvmf/common.sh@295 -- # local -ga e810 00:21:44.743 04:33:23 -- nvmf/common.sh@296 -- # x722=() 00:21:44.743 04:33:23 -- nvmf/common.sh@296 -- # local -ga x722 00:21:44.743 04:33:23 -- nvmf/common.sh@297 -- # mlx=() 00:21:44.743 04:33:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:44.743 04:33:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:44.743 04:33:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:44.743 04:33:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:44.743 04:33:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:44.743 04:33:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:44.743 04:33:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:44.743 04:33:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:44.743 04:33:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:44.743 04:33:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:44.743 04:33:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:44.743 04:33:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:44.743 04:33:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:44.743 04:33:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:44.743 04:33:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:44.743 04:33:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:44.743 04:33:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:44.743 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:44.743 04:33:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:44.743 04:33:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:44.743 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:44.743 04:33:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:44.743 04:33:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:44.743 04:33:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:44.743 04:33:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:44.743 04:33:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:44.743 04:33:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:44.743 04:33:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:44.743 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:44.743 04:33:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:44.743 04:33:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:44.743 04:33:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:44.743 04:33:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:44.743 04:33:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:44.744 04:33:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:44.744 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:44.744 04:33:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:44.744 04:33:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:44.744 04:33:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:44.744 04:33:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:44.744 04:33:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:44.744 04:33:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:44.744 04:33:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:44.744 04:33:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:44.744 04:33:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:44.744 04:33:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:44.744 04:33:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:44.744 04:33:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:44.744 04:33:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:44.744 04:33:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:44.744 04:33:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:44.744 04:33:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:44.744 04:33:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:44.744 04:33:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:44.744 04:33:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:44.744 04:33:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:44.744 04:33:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:44.744 04:33:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:44.744 04:33:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:44.744 04:33:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:44.744 04:33:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:44.744 04:33:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:44.744 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:44.744 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.308 ms 00:21:44.744 00:21:44.744 --- 10.0.0.2 ping statistics --- 00:21:44.744 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:44.744 rtt min/avg/max/mdev = 0.308/0.308/0.308/0.000 ms 00:21:44.744 04:33:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:44.744 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:44.744 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:21:44.744 00:21:44.744 --- 10.0.0.1 ping statistics --- 00:21:44.744 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:44.744 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:21:44.744 04:33:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:44.744 04:33:23 -- nvmf/common.sh@410 -- # return 0 00:21:44.744 04:33:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:44.744 04:33:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:44.744 04:33:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:44.744 04:33:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:44.744 04:33:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:44.744 04:33:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:44.744 04:33:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:44.744 04:33:23 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:21:44.744 04:33:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:44.744 04:33:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:44.744 04:33:23 -- common/autotest_common.sh@10 -- # set +x 00:21:44.744 04:33:23 -- nvmf/common.sh@469 -- # nvmfpid=2958899 00:21:44.744 04:33:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:44.744 04:33:23 -- nvmf/common.sh@470 -- # waitforlisten 2958899 00:21:44.744 04:33:23 -- common/autotest_common.sh@829 -- # '[' -z 2958899 ']' 00:21:44.744 04:33:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:44.744 04:33:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:44.744 04:33:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:44.744 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:44.744 04:33:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:44.744 04:33:23 -- common/autotest_common.sh@10 -- # set +x 00:21:44.744 [2024-11-26 04:33:23.590392] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:44.744 [2024-11-26 04:33:23.590480] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:44.744 EAL: No free 2048 kB hugepages reported on node 1 00:21:44.744 [2024-11-26 04:33:23.653602] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:44.744 [2024-11-26 04:33:23.738269] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:44.744 [2024-11-26 04:33:23.738436] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:44.744 [2024-11-26 04:33:23.738453] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:44.744 [2024-11-26 04:33:23.738466] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:44.744 [2024-11-26 04:33:23.738594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:44.744 [2024-11-26 04:33:23.738660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:44.744 [2024-11-26 04:33:23.738680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:44.744 [2024-11-26 04:33:23.738683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:45.680 04:33:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:45.680 04:33:24 -- common/autotest_common.sh@862 -- # return 0 00:21:45.680 04:33:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:45.680 04:33:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 04:33:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:45.680 04:33:24 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 [2024-11-26 04:33:24.639635] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@21 -- # seq 1 11 00:21:45.680 04:33:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:45.680 04:33:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 Malloc1 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 [2024-11-26 04:33:24.696995] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:45.680 04:33:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 Malloc2 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:45.680 04:33:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 Malloc3 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:45.680 04:33:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 Malloc4 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:45.680 04:33:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.680 Malloc5 00:21:45.680 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.680 04:33:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:21:45.680 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.680 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.681 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.681 04:33:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:21:45.681 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.681 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.681 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.681 04:33:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:21:45.681 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.681 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.681 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.681 04:33:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:45.681 04:33:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:21:45.681 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.681 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 Malloc6 00:21:45.940 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:21:45.940 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:21:45.940 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:21:45.940 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:45.940 04:33:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:21:45.940 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 Malloc7 00:21:45.940 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:24 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:21:45.940 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:24 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:21:45.940 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:24 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:21:45.940 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:24 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:45.940 04:33:24 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:21:45.940 04:33:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:24 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 Malloc8 00:21:45.940 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:21:45.940 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:21:45.940 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:21:45.940 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:45.940 04:33:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:21:45.940 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 Malloc9 00:21:45.940 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:21:45.940 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:21:45.940 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:21:45.940 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:45.940 04:33:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:21:45.940 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 Malloc10 00:21:45.940 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:21:45.940 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:21:45.940 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:21:45.940 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:45.940 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:45.940 04:33:25 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:45.940 04:33:25 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:21:45.940 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:45.940 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:46.199 Malloc11 00:21:46.199 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.199 04:33:25 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:21:46.199 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.199 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:46.199 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.199 04:33:25 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:21:46.199 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.199 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:46.199 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.199 04:33:25 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:21:46.199 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.199 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:21:46.199 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.199 04:33:25 -- target/multiconnection.sh@28 -- # seq 1 11 00:21:46.199 04:33:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:46.199 04:33:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:21:46.766 04:33:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:21:46.766 04:33:25 -- common/autotest_common.sh@1187 -- # local i=0 00:21:46.766 04:33:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:46.766 04:33:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:46.766 04:33:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:48.671 04:33:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:48.671 04:33:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:48.671 04:33:27 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:21:48.932 04:33:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:48.932 04:33:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:48.932 04:33:27 -- common/autotest_common.sh@1197 -- # return 0 00:21:48.932 04:33:27 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:48.932 04:33:27 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:21:49.499 04:33:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:21:49.499 04:33:28 -- common/autotest_common.sh@1187 -- # local i=0 00:21:49.499 04:33:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:49.499 04:33:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:49.499 04:33:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:51.406 04:33:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:51.406 04:33:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:51.406 04:33:30 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:21:51.406 04:33:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:51.406 04:33:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:51.406 04:33:30 -- common/autotest_common.sh@1197 -- # return 0 00:21:51.406 04:33:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.406 04:33:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:21:51.975 04:33:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:21:51.975 04:33:31 -- common/autotest_common.sh@1187 -- # local i=0 00:21:51.975 04:33:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:51.975 04:33:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:51.975 04:33:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:54.513 04:33:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:54.513 04:33:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:54.513 04:33:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:21:54.513 04:33:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:54.513 04:33:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:54.513 04:33:33 -- common/autotest_common.sh@1197 -- # return 0 00:21:54.513 04:33:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:54.513 04:33:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:21:55.081 04:33:34 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:21:55.082 04:33:34 -- common/autotest_common.sh@1187 -- # local i=0 00:21:55.082 04:33:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:55.082 04:33:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:55.082 04:33:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:56.988 04:33:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:56.988 04:33:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:56.988 04:33:36 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:21:56.988 04:33:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:56.988 04:33:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:56.988 04:33:36 -- common/autotest_common.sh@1197 -- # return 0 00:21:56.988 04:33:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:56.988 04:33:36 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:21:57.927 04:33:36 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:21:57.927 04:33:36 -- common/autotest_common.sh@1187 -- # local i=0 00:21:57.927 04:33:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:57.927 04:33:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:57.927 04:33:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:59.835 04:33:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:59.835 04:33:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:59.835 04:33:38 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:21:59.835 04:33:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:59.835 04:33:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:59.835 04:33:38 -- common/autotest_common.sh@1197 -- # return 0 00:21:59.835 04:33:38 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.835 04:33:38 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:00.774 04:33:39 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:00.774 04:33:39 -- common/autotest_common.sh@1187 -- # local i=0 00:22:00.774 04:33:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:00.774 04:33:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:00.774 04:33:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:02.681 04:33:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:02.681 04:33:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:02.681 04:33:41 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:02.681 04:33:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:02.681 04:33:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:02.681 04:33:41 -- common/autotest_common.sh@1197 -- # return 0 00:22:02.681 04:33:41 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:02.681 04:33:41 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:03.619 04:33:42 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:03.619 04:33:42 -- common/autotest_common.sh@1187 -- # local i=0 00:22:03.619 04:33:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:03.619 04:33:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:03.619 04:33:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:05.522 04:33:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:05.522 04:33:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:05.522 04:33:44 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:05.522 04:33:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:05.522 04:33:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:05.522 04:33:44 -- common/autotest_common.sh@1197 -- # return 0 00:22:05.522 04:33:44 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:05.522 04:33:44 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:06.090 04:33:45 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:06.090 04:33:45 -- common/autotest_common.sh@1187 -- # local i=0 00:22:06.090 04:33:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:06.090 04:33:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:06.090 04:33:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:08.646 04:33:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:08.646 04:33:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:08.646 04:33:47 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:08.646 04:33:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:08.646 04:33:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:08.646 04:33:47 -- common/autotest_common.sh@1197 -- # return 0 00:22:08.646 04:33:47 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:08.646 04:33:47 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:09.219 04:33:48 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:09.219 04:33:48 -- common/autotest_common.sh@1187 -- # local i=0 00:22:09.219 04:33:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:09.219 04:33:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:09.219 04:33:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:11.121 04:33:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:11.121 04:33:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:11.121 04:33:50 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:11.121 04:33:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:11.121 04:33:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:11.121 04:33:50 -- common/autotest_common.sh@1197 -- # return 0 00:22:11.121 04:33:50 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:11.121 04:33:50 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:12.061 04:33:50 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:12.061 04:33:50 -- common/autotest_common.sh@1187 -- # local i=0 00:22:12.061 04:33:50 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:12.061 04:33:50 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:12.061 04:33:50 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:13.963 04:33:52 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:13.963 04:33:52 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:13.963 04:33:52 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:13.963 04:33:52 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:13.963 04:33:52 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:13.963 04:33:52 -- common/autotest_common.sh@1197 -- # return 0 00:22:13.963 04:33:52 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.964 04:33:52 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:14.897 04:33:54 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:14.897 04:33:54 -- common/autotest_common.sh@1187 -- # local i=0 00:22:14.897 04:33:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:14.897 04:33:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:14.897 04:33:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:17.429 04:33:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:17.429 04:33:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:17.429 04:33:56 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:22:17.429 04:33:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:17.429 04:33:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:17.429 04:33:56 -- common/autotest_common.sh@1197 -- # return 0 00:22:17.429 04:33:56 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:17.429 [global] 00:22:17.429 thread=1 00:22:17.429 invalidate=1 00:22:17.429 rw=read 00:22:17.429 time_based=1 00:22:17.429 runtime=10 00:22:17.429 ioengine=libaio 00:22:17.429 direct=1 00:22:17.429 bs=262144 00:22:17.429 iodepth=64 00:22:17.429 norandommap=1 00:22:17.429 numjobs=1 00:22:17.430 00:22:17.430 [job0] 00:22:17.430 filename=/dev/nvme0n1 00:22:17.430 [job1] 00:22:17.430 filename=/dev/nvme10n1 00:22:17.430 [job2] 00:22:17.430 filename=/dev/nvme1n1 00:22:17.430 [job3] 00:22:17.430 filename=/dev/nvme2n1 00:22:17.430 [job4] 00:22:17.430 filename=/dev/nvme3n1 00:22:17.430 [job5] 00:22:17.430 filename=/dev/nvme4n1 00:22:17.430 [job6] 00:22:17.430 filename=/dev/nvme5n1 00:22:17.430 [job7] 00:22:17.430 filename=/dev/nvme6n1 00:22:17.430 [job8] 00:22:17.430 filename=/dev/nvme7n1 00:22:17.430 [job9] 00:22:17.430 filename=/dev/nvme8n1 00:22:17.430 [job10] 00:22:17.430 filename=/dev/nvme9n1 00:22:17.430 Could not set queue depth (nvme0n1) 00:22:17.430 Could not set queue depth (nvme10n1) 00:22:17.430 Could not set queue depth (nvme1n1) 00:22:17.430 Could not set queue depth (nvme2n1) 00:22:17.430 Could not set queue depth (nvme3n1) 00:22:17.430 Could not set queue depth (nvme4n1) 00:22:17.430 Could not set queue depth (nvme5n1) 00:22:17.430 Could not set queue depth (nvme6n1) 00:22:17.430 Could not set queue depth (nvme7n1) 00:22:17.430 Could not set queue depth (nvme8n1) 00:22:17.430 Could not set queue depth (nvme9n1) 00:22:17.430 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:17.430 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:17.430 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:17.430 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:17.430 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:17.430 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:17.430 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:17.430 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:17.430 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:17.430 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:17.430 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:17.430 fio-3.35 00:22:17.430 Starting 11 threads 00:22:29.635 00:22:29.635 job0: (groupid=0, jobs=1): err= 0: pid=2963418: Tue Nov 26 04:34:06 2024 00:22:29.635 read: IOPS=983, BW=246MiB/s (258MB/s)(2487MiB/10118msec) 00:22:29.635 slat (usec): min=11, max=128337, avg=914.30, stdev=3294.63 00:22:29.635 clat (usec): min=1579, max=277639, avg=64124.37, stdev=38699.60 00:22:29.635 lat (usec): min=1606, max=277691, avg=65038.67, stdev=39243.94 00:22:29.635 clat percentiles (msec): 00:22:29.635 | 1.00th=[ 12], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 30], 00:22:29.635 | 30.00th=[ 34], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 66], 00:22:29.635 | 70.00th=[ 81], 80.00th=[ 95], 90.00th=[ 113], 95.00th=[ 144], 00:22:29.635 | 99.00th=[ 174], 99.50th=[ 226], 99.90th=[ 275], 99.95th=[ 275], 00:22:29.635 | 99.99th=[ 279] 00:22:29.635 bw ( KiB/s): min=96256, max=560128, per=12.49%, avg=253030.40, stdev=128143.34, samples=20 00:22:29.635 iops : min= 376, max= 2188, avg=988.40, stdev=500.56, samples=20 00:22:29.635 lat (msec) : 2=0.01%, 4=0.23%, 10=0.47%, 20=1.88%, 50=40.62% 00:22:29.635 lat (msec) : 100=40.19%, 250=16.46%, 500=0.14% 00:22:29.635 cpu : usr=0.50%, sys=2.91%, ctx=1796, majf=0, minf=4097 00:22:29.635 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:22:29.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:29.635 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:29.635 issued rwts: total=9948,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:29.635 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:29.635 job1: (groupid=0, jobs=1): err= 0: pid=2963419: Tue Nov 26 04:34:06 2024 00:22:29.635 read: IOPS=799, BW=200MiB/s (210MB/s)(2013MiB/10067msec) 00:22:29.635 slat (usec): min=9, max=58676, avg=1015.00, stdev=3171.87 00:22:29.635 clat (msec): min=2, max=193, avg=78.94, stdev=37.94 00:22:29.635 lat (msec): min=2, max=200, avg=79.96, stdev=38.34 00:22:29.635 clat percentiles (msec): 00:22:29.635 | 1.00th=[ 7], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 46], 00:22:29.635 | 30.00th=[ 56], 40.00th=[ 64], 50.00th=[ 72], 60.00th=[ 83], 00:22:29.635 | 70.00th=[ 97], 80.00th=[ 113], 90.00th=[ 136], 95.00th=[ 155], 00:22:29.635 | 99.00th=[ 171], 99.50th=[ 176], 99.90th=[ 182], 99.95th=[ 186], 00:22:29.635 | 99.99th=[ 194] 00:22:29.635 bw ( KiB/s): min=115200, max=419328, per=10.10%, avg=204566.20, stdev=78724.17, samples=20 00:22:29.635 iops : min= 450, max= 1638, avg=799.05, stdev=307.51, samples=20 00:22:29.635 lat (msec) : 4=0.29%, 10=1.44%, 20=1.07%, 50=20.44%, 100=48.43% 00:22:29.635 lat (msec) : 250=28.34% 00:22:29.635 cpu : usr=0.59%, sys=2.37%, ctx=1660, majf=0, minf=4097 00:22:29.635 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:29.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:29.635 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:29.635 issued rwts: total=8053,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:29.635 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:29.635 job2: (groupid=0, jobs=1): err= 0: pid=2963420: Tue Nov 26 04:34:06 2024 00:22:29.635 read: IOPS=632, BW=158MiB/s (166MB/s)(1602MiB/10125msec) 00:22:29.635 slat (usec): min=9, max=70203, avg=844.21, stdev=3689.35 00:22:29.635 clat (msec): min=3, max=305, avg=100.20, stdev=44.62 00:22:29.635 lat (msec): min=3, max=310, avg=101.05, stdev=45.34 00:22:29.635 clat percentiles (msec): 00:22:29.635 | 1.00th=[ 17], 5.00th=[ 28], 10.00th=[ 43], 20.00th=[ 62], 00:22:29.635 | 30.00th=[ 81], 40.00th=[ 90], 50.00th=[ 99], 60.00th=[ 106], 00:22:29.635 | 70.00th=[ 118], 80.00th=[ 136], 90.00th=[ 159], 95.00th=[ 186], 00:22:29.635 | 99.00th=[ 209], 99.50th=[ 228], 99.90th=[ 296], 99.95th=[ 296], 00:22:29.635 | 99.99th=[ 305] 00:22:29.635 bw ( KiB/s): min=83456, max=269312, per=8.02%, avg=162432.00, stdev=49068.24, samples=20 00:22:29.636 iops : min= 326, max= 1052, avg=634.50, stdev=191.67, samples=20 00:22:29.636 lat (msec) : 4=0.02%, 10=0.09%, 20=1.90%, 50=12.17%, 100=39.81% 00:22:29.636 lat (msec) : 250=45.57%, 500=0.44% 00:22:29.636 cpu : usr=0.37%, sys=1.75%, ctx=1627, majf=0, minf=4098 00:22:29.636 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:22:29.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:29.636 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:29.636 issued rwts: total=6408,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:29.636 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:29.636 job3: (groupid=0, jobs=1): err= 0: pid=2963421: Tue Nov 26 04:34:06 2024 00:22:29.636 read: IOPS=721, BW=180MiB/s (189MB/s)(1816MiB/10065msec) 00:22:29.636 slat (usec): min=9, max=99795, avg=1026.78, stdev=4070.00 00:22:29.636 clat (msec): min=2, max=265, avg=87.59, stdev=35.14 00:22:29.636 lat (msec): min=2, max=265, avg=88.61, stdev=35.68 00:22:29.636 clat percentiles (msec): 00:22:29.636 | 1.00th=[ 12], 5.00th=[ 34], 10.00th=[ 45], 20.00th=[ 55], 00:22:29.636 | 30.00th=[ 65], 40.00th=[ 79], 50.00th=[ 91], 60.00th=[ 100], 00:22:29.636 | 70.00th=[ 107], 80.00th=[ 115], 90.00th=[ 127], 95.00th=[ 153], 00:22:29.636 | 99.00th=[ 171], 99.50th=[ 176], 99.90th=[ 203], 99.95th=[ 228], 00:22:29.636 | 99.99th=[ 266] 00:22:29.636 bw ( KiB/s): min=102400, max=340992, per=9.10%, avg=184345.60, stdev=54193.76, samples=20 00:22:29.636 iops : min= 400, max= 1332, avg=720.10, stdev=211.69, samples=20 00:22:29.636 lat (msec) : 4=0.04%, 10=0.74%, 20=1.62%, 50=12.65%, 100=45.91% 00:22:29.636 lat (msec) : 250=39.00%, 500=0.03% 00:22:29.636 cpu : usr=0.43%, sys=2.15%, ctx=1641, majf=0, minf=4097 00:22:29.636 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:22:29.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:29.636 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:29.636 issued rwts: total=7264,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:29.636 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:29.636 job4: (groupid=0, jobs=1): err= 0: pid=2963422: Tue Nov 26 04:34:06 2024 00:22:29.636 read: IOPS=542, BW=136MiB/s (142MB/s)(1373MiB/10121msec) 00:22:29.636 slat (usec): min=9, max=83213, avg=1425.85, stdev=5169.43 00:22:29.636 clat (msec): min=37, max=302, avg=116.45, stdev=38.00 00:22:29.636 lat (msec): min=37, max=302, avg=117.88, stdev=38.79 00:22:29.636 clat percentiles (msec): 00:22:29.636 | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 88], 00:22:29.636 | 30.00th=[ 95], 40.00th=[ 102], 50.00th=[ 110], 60.00th=[ 118], 00:22:29.636 | 70.00th=[ 130], 80.00th=[ 148], 90.00th=[ 171], 95.00th=[ 188], 00:22:29.636 | 99.00th=[ 220], 99.50th=[ 247], 99.90th=[ 284], 99.95th=[ 288], 00:22:29.636 | 99.99th=[ 305] 00:22:29.636 bw ( KiB/s): min=87552, max=246272, per=6.86%, avg=138966.30, stdev=38987.02, samples=20 00:22:29.636 iops : min= 342, max= 962, avg=542.80, stdev=152.34, samples=20 00:22:29.636 lat (msec) : 50=1.35%, 100=36.97%, 250=61.23%, 500=0.46% 00:22:29.636 cpu : usr=0.28%, sys=1.82%, ctx=1260, majf=0, minf=4097 00:22:29.636 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:29.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:29.636 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:29.636 issued rwts: total=5491,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:29.636 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:29.636 job5: (groupid=0, jobs=1): err= 0: pid=2963423: Tue Nov 26 04:34:06 2024 00:22:29.636 read: IOPS=711, BW=178MiB/s (187MB/s)(1782MiB/10012msec) 00:22:29.636 slat (usec): min=14, max=92473, avg=1376.00, stdev=5032.16 00:22:29.636 clat (msec): min=10, max=251, avg=88.47, stdev=41.28 00:22:29.636 lat (msec): min=13, max=268, avg=89.85, stdev=42.09 00:22:29.636 clat percentiles (msec): 00:22:29.636 | 1.00th=[ 23], 5.00th=[ 40], 10.00th=[ 45], 20.00th=[ 55], 00:22:29.636 | 30.00th=[ 63], 40.00th=[ 69], 50.00th=[ 75], 60.00th=[ 84], 00:22:29.636 | 70.00th=[ 105], 80.00th=[ 131], 90.00th=[ 150], 95.00th=[ 176], 00:22:29.636 | 99.00th=[ 188], 99.50th=[ 190], 99.90th=[ 236], 99.95th=[ 249], 00:22:29.636 | 99.99th=[ 251] 00:22:29.636 bw ( KiB/s): min=72704, max=375296, per=8.93%, avg=180838.40, stdev=77517.15, samples=20 00:22:29.636 iops : min= 284, max= 1466, avg=706.40, stdev=302.80, samples=20 00:22:29.636 lat (msec) : 20=0.43%, 50=14.94%, 100=53.21%, 250=31.39%, 500=0.03% 00:22:29.636 cpu : usr=0.37%, sys=2.38%, ctx=1064, majf=0, minf=4097 00:22:29.636 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:22:29.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:29.636 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:29.636 issued rwts: total=7127,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:29.636 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:29.636 job6: (groupid=0, jobs=1): err= 0: pid=2963424: Tue Nov 26 04:34:06 2024 00:22:29.636 read: IOPS=716, BW=179MiB/s (188MB/s)(1804MiB/10065msec) 00:22:29.636 slat (usec): min=9, max=114559, avg=1117.20, stdev=4430.58 00:22:29.636 clat (msec): min=3, max=303, avg=88.08, stdev=41.02 00:22:29.636 lat (msec): min=3, max=303, avg=89.20, stdev=41.55 00:22:29.636 clat percentiles (msec): 00:22:29.636 | 1.00th=[ 12], 5.00th=[ 25], 10.00th=[ 35], 20.00th=[ 59], 00:22:29.636 | 30.00th=[ 68], 40.00th=[ 74], 50.00th=[ 83], 60.00th=[ 92], 00:22:29.636 | 70.00th=[ 105], 80.00th=[ 117], 90.00th=[ 140], 95.00th=[ 178], 00:22:29.636 | 99.00th=[ 194], 99.50th=[ 199], 99.90th=[ 257], 99.95th=[ 284], 00:22:29.636 | 99.99th=[ 305] 00:22:29.636 bw ( KiB/s): min=98304, max=282112, per=9.04%, avg=183101.55, stdev=50486.30, samples=20 00:22:29.636 iops : min= 384, max= 1102, avg=715.20, stdev=197.24, samples=20 00:22:29.636 lat (msec) : 4=0.10%, 10=0.55%, 20=2.76%, 50=11.03%, 100=52.19% 00:22:29.636 lat (msec) : 250=33.26%, 500=0.11% 00:22:29.636 cpu : usr=0.53%, sys=2.22%, ctx=1495, majf=0, minf=4097 00:22:29.636 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:22:29.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:29.636 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:29.636 issued rwts: total=7216,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:29.636 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:29.636 job7: (groupid=0, jobs=1): err= 0: pid=2963425: Tue Nov 26 04:34:06 2024 00:22:29.636 read: IOPS=601, BW=150MiB/s (158MB/s)(1523MiB/10130msec) 00:22:29.636 slat (usec): min=10, max=80636, avg=1403.43, stdev=4538.11 00:22:29.636 clat (msec): min=2, max=317, avg=104.92, stdev=44.95 00:22:29.636 lat (msec): min=2, max=317, avg=106.32, stdev=45.68 00:22:29.636 clat percentiles (msec): 00:22:29.636 | 1.00th=[ 24], 5.00th=[ 33], 10.00th=[ 39], 20.00th=[ 64], 00:22:29.636 | 30.00th=[ 83], 40.00th=[ 97], 50.00th=[ 110], 60.00th=[ 118], 00:22:29.636 | 70.00th=[ 128], 80.00th=[ 138], 90.00th=[ 165], 95.00th=[ 184], 00:22:29.636 | 99.00th=[ 203], 99.50th=[ 222], 99.90th=[ 288], 99.95th=[ 300], 00:22:29.636 | 99.99th=[ 317] 00:22:29.636 bw ( KiB/s): min=90624, max=389632, per=7.62%, avg=154330.90, stdev=68583.65, samples=20 00:22:29.636 iops : min= 354, max= 1522, avg=602.95, stdev=267.92, samples=20 00:22:29.636 lat (msec) : 4=0.49%, 10=0.18%, 20=0.21%, 50=13.95%, 100=27.85% 00:22:29.636 lat (msec) : 250=57.10%, 500=0.21% 00:22:29.636 cpu : usr=0.31%, sys=2.08%, ctx=1238, majf=0, minf=3721 00:22:29.636 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:29.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:29.636 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:29.636 issued rwts: total=6093,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:29.636 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:29.636 job8: (groupid=0, jobs=1): err= 0: pid=2963426: Tue Nov 26 04:34:06 2024 00:22:29.636 read: IOPS=598, BW=150MiB/s (157MB/s)(1516MiB/10128msec) 00:22:29.636 slat (usec): min=9, max=85410, avg=1307.73, stdev=4492.45 00:22:29.636 clat (msec): min=13, max=315, avg=105.49, stdev=36.91 00:22:29.636 lat (msec): min=13, max=315, avg=106.80, stdev=37.46 00:22:29.636 clat percentiles (msec): 00:22:29.636 | 1.00th=[ 30], 5.00th=[ 48], 10.00th=[ 52], 20.00th=[ 74], 00:22:29.636 | 30.00th=[ 93], 40.00th=[ 103], 50.00th=[ 110], 60.00th=[ 115], 00:22:29.636 | 70.00th=[ 122], 80.00th=[ 129], 90.00th=[ 153], 95.00th=[ 165], 00:22:29.636 | 99.00th=[ 194], 99.50th=[ 234], 99.90th=[ 288], 99.95th=[ 300], 00:22:29.636 | 99.99th=[ 317] 00:22:29.636 bw ( KiB/s): min=98816, max=278016, per=7.59%, avg=153639.15, stdev=42713.02, samples=20 00:22:29.636 iops : min= 386, max= 1086, avg=600.15, stdev=166.85, samples=20 00:22:29.636 lat (msec) : 20=0.51%, 50=7.35%, 100=30.49%, 250=61.38%, 500=0.26% 00:22:29.636 cpu : usr=0.44%, sys=1.80%, ctx=1367, majf=0, minf=4098 00:22:29.636 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:29.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:29.636 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:29.636 issued rwts: total=6065,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:29.636 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:29.636 job9: (groupid=0, jobs=1): err= 0: pid=2963428: Tue Nov 26 04:34:06 2024 00:22:29.636 read: IOPS=911, BW=228MiB/s (239MB/s)(2295MiB/10065msec) 00:22:29.636 slat (usec): min=13, max=37554, avg=1051.93, stdev=3150.18 00:22:29.636 clat (msec): min=3, max=173, avg=69.09, stdev=33.18 00:22:29.636 lat (msec): min=3, max=173, avg=70.14, stdev=33.64 00:22:29.636 clat percentiles (msec): 00:22:29.636 | 1.00th=[ 25], 5.00th=[ 28], 10.00th=[ 29], 20.00th=[ 32], 00:22:29.636 | 30.00th=[ 44], 40.00th=[ 56], 50.00th=[ 67], 60.00th=[ 79], 00:22:29.636 | 70.00th=[ 90], 80.00th=[ 103], 90.00th=[ 115], 95.00th=[ 124], 00:22:29.636 | 99.00th=[ 142], 99.50th=[ 150], 99.90th=[ 161], 99.95th=[ 161], 00:22:29.636 | 99.99th=[ 174] 00:22:29.636 bw ( KiB/s): min=125952, max=525312, per=11.52%, avg=233344.00, stdev=117119.71, samples=20 00:22:29.636 iops : min= 492, max= 2052, avg=911.50, stdev=457.50, samples=20 00:22:29.636 lat (msec) : 4=0.01%, 10=0.38%, 20=0.05%, 50=33.66%, 100=44.16% 00:22:29.636 lat (msec) : 250=21.74% 00:22:29.636 cpu : usr=0.51%, sys=2.92%, ctx=1677, majf=0, minf=4097 00:22:29.636 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:22:29.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:29.636 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:29.636 issued rwts: total=9178,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:29.637 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:29.637 job10: (groupid=0, jobs=1): err= 0: pid=2963432: Tue Nov 26 04:34:06 2024 00:22:29.637 read: IOPS=720, BW=180MiB/s (189MB/s)(1825MiB/10126msec) 00:22:29.637 slat (usec): min=13, max=105745, avg=1215.47, stdev=4336.55 00:22:29.637 clat (msec): min=6, max=314, avg=87.51, stdev=40.70 00:22:29.637 lat (msec): min=6, max=314, avg=88.73, stdev=41.28 00:22:29.637 clat percentiles (msec): 00:22:29.637 | 1.00th=[ 20], 5.00th=[ 37], 10.00th=[ 49], 20.00th=[ 58], 00:22:29.637 | 30.00th=[ 64], 40.00th=[ 69], 50.00th=[ 78], 60.00th=[ 89], 00:22:29.637 | 70.00th=[ 101], 80.00th=[ 113], 90.00th=[ 142], 95.00th=[ 180], 00:22:29.637 | 99.00th=[ 201], 99.50th=[ 255], 99.90th=[ 300], 99.95th=[ 300], 00:22:29.637 | 99.99th=[ 313] 00:22:29.637 bw ( KiB/s): min=91136, max=305664, per=9.14%, avg=185190.40, stdev=60966.85, samples=20 00:22:29.637 iops : min= 356, max= 1194, avg=723.40, stdev=238.15, samples=20 00:22:29.637 lat (msec) : 10=0.12%, 20=0.89%, 50=9.78%, 100=58.77%, 250=29.91% 00:22:29.637 lat (msec) : 500=0.52% 00:22:29.637 cpu : usr=0.38%, sys=2.41%, ctx=1416, majf=0, minf=4097 00:22:29.637 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:22:29.637 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:29.637 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:29.637 issued rwts: total=7298,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:29.637 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:29.637 00:22:29.637 Run status group 0 (all jobs): 00:22:29.637 READ: bw=1978MiB/s (2074MB/s), 136MiB/s-246MiB/s (142MB/s-258MB/s), io=19.6GiB (21.0GB), run=10012-10130msec 00:22:29.637 00:22:29.637 Disk stats (read/write): 00:22:29.637 nvme0n1: ios=19769/0, merge=0/0, ticks=1231437/0, in_queue=1231437, util=97.37% 00:22:29.637 nvme10n1: ios=15888/0, merge=0/0, ticks=1238236/0, in_queue=1238236, util=97.57% 00:22:29.637 nvme1n1: ios=12656/0, merge=0/0, ticks=1238723/0, in_queue=1238723, util=97.84% 00:22:29.637 nvme2n1: ios=14332/0, merge=0/0, ticks=1243162/0, in_queue=1243162, util=97.96% 00:22:29.637 nvme3n1: ios=10800/0, merge=0/0, ticks=1227804/0, in_queue=1227804, util=98.03% 00:22:29.637 nvme4n1: ios=13981/0, merge=0/0, ticks=1240135/0, in_queue=1240135, util=98.34% 00:22:29.637 nvme5n1: ios=14230/0, merge=0/0, ticks=1237352/0, in_queue=1237352, util=98.49% 00:22:29.637 nvme6n1: ios=12030/0, merge=0/0, ticks=1232705/0, in_queue=1232705, util=98.57% 00:22:29.637 nvme7n1: ios=11985/0, merge=0/0, ticks=1233271/0, in_queue=1233271, util=98.94% 00:22:29.637 nvme8n1: ios=18159/0, merge=0/0, ticks=1233648/0, in_queue=1233648, util=99.10% 00:22:29.637 nvme9n1: ios=14455/0, merge=0/0, ticks=1232106/0, in_queue=1232106, util=99.23% 00:22:29.637 04:34:06 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:22:29.637 [global] 00:22:29.637 thread=1 00:22:29.637 invalidate=1 00:22:29.637 rw=randwrite 00:22:29.637 time_based=1 00:22:29.637 runtime=10 00:22:29.637 ioengine=libaio 00:22:29.637 direct=1 00:22:29.637 bs=262144 00:22:29.637 iodepth=64 00:22:29.637 norandommap=1 00:22:29.637 numjobs=1 00:22:29.637 00:22:29.637 [job0] 00:22:29.637 filename=/dev/nvme0n1 00:22:29.637 [job1] 00:22:29.637 filename=/dev/nvme10n1 00:22:29.637 [job2] 00:22:29.637 filename=/dev/nvme1n1 00:22:29.637 [job3] 00:22:29.637 filename=/dev/nvme2n1 00:22:29.637 [job4] 00:22:29.637 filename=/dev/nvme3n1 00:22:29.637 [job5] 00:22:29.637 filename=/dev/nvme4n1 00:22:29.637 [job6] 00:22:29.637 filename=/dev/nvme5n1 00:22:29.637 [job7] 00:22:29.637 filename=/dev/nvme6n1 00:22:29.637 [job8] 00:22:29.637 filename=/dev/nvme7n1 00:22:29.637 [job9] 00:22:29.637 filename=/dev/nvme8n1 00:22:29.637 [job10] 00:22:29.637 filename=/dev/nvme9n1 00:22:29.637 Could not set queue depth (nvme0n1) 00:22:29.637 Could not set queue depth (nvme10n1) 00:22:29.637 Could not set queue depth (nvme1n1) 00:22:29.637 Could not set queue depth (nvme2n1) 00:22:29.637 Could not set queue depth (nvme3n1) 00:22:29.637 Could not set queue depth (nvme4n1) 00:22:29.637 Could not set queue depth (nvme5n1) 00:22:29.637 Could not set queue depth (nvme6n1) 00:22:29.637 Could not set queue depth (nvme7n1) 00:22:29.637 Could not set queue depth (nvme8n1) 00:22:29.637 Could not set queue depth (nvme9n1) 00:22:29.637 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:29.637 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:29.637 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:29.637 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:29.637 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:29.637 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:29.637 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:29.637 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:29.637 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:29.637 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:29.637 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:29.637 fio-3.35 00:22:29.637 Starting 11 threads 00:22:39.615 00:22:39.615 job0: (groupid=0, jobs=1): err= 0: pid=2964472: Tue Nov 26 04:34:17 2024 00:22:39.615 write: IOPS=519, BW=130MiB/s (136MB/s)(1326MiB/10200msec); 0 zone resets 00:22:39.615 slat (usec): min=17, max=46731, avg=1134.36, stdev=3246.08 00:22:39.615 clat (usec): min=1453, max=320615, avg=121915.91, stdev=66358.34 00:22:39.615 lat (usec): min=1603, max=322060, avg=123050.27, stdev=67103.00 00:22:39.615 clat percentiles (msec): 00:22:39.615 | 1.00th=[ 6], 5.00th=[ 14], 10.00th=[ 24], 20.00th=[ 62], 00:22:39.615 | 30.00th=[ 89], 40.00th=[ 107], 50.00th=[ 125], 60.00th=[ 142], 00:22:39.615 | 70.00th=[ 157], 80.00th=[ 174], 90.00th=[ 207], 95.00th=[ 232], 00:22:39.615 | 99.00th=[ 288], 99.50th=[ 300], 99.90th=[ 313], 99.95th=[ 313], 00:22:39.615 | 99.99th=[ 321] 00:22:39.616 bw ( KiB/s): min=57344, max=201216, per=9.61%, avg=134104.15, stdev=39281.59, samples=20 00:22:39.616 iops : min= 224, max= 786, avg=523.80, stdev=153.47, samples=20 00:22:39.616 lat (msec) : 2=0.04%, 4=0.41%, 10=2.98%, 20=5.28%, 50=9.13% 00:22:39.616 lat (msec) : 100=19.12%, 250=59.60%, 500=3.43% 00:22:39.616 cpu : usr=1.60%, sys=1.68%, ctx=3047, majf=0, minf=1 00:22:39.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:39.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:39.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:39.616 issued rwts: total=0,5302,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:39.616 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:39.616 job1: (groupid=0, jobs=1): err= 0: pid=2964486: Tue Nov 26 04:34:17 2024 00:22:39.616 write: IOPS=457, BW=114MiB/s (120MB/s)(1155MiB/10104msec); 0 zone resets 00:22:39.616 slat (usec): min=24, max=51279, avg=1989.99, stdev=4195.84 00:22:39.616 clat (usec): min=1651, max=309495, avg=137951.60, stdev=61267.24 00:22:39.616 lat (usec): min=1723, max=309528, avg=139941.59, stdev=62099.48 00:22:39.616 clat percentiles (msec): 00:22:39.616 | 1.00th=[ 16], 5.00th=[ 47], 10.00th=[ 65], 20.00th=[ 88], 00:22:39.616 | 30.00th=[ 103], 40.00th=[ 116], 50.00th=[ 133], 60.00th=[ 155], 00:22:39.616 | 70.00th=[ 167], 80.00th=[ 184], 90.00th=[ 211], 95.00th=[ 259], 00:22:39.616 | 99.00th=[ 300], 99.50th=[ 305], 99.90th=[ 309], 99.95th=[ 309], 00:22:39.616 | 99.99th=[ 309] 00:22:39.616 bw ( KiB/s): min=57344, max=203776, per=8.35%, avg=116636.05, stdev=40605.89, samples=20 00:22:39.616 iops : min= 224, max= 796, avg=455.55, stdev=158.63, samples=20 00:22:39.616 lat (msec) : 2=0.02%, 4=0.17%, 10=0.22%, 20=1.34%, 50=5.26% 00:22:39.616 lat (msec) : 100=22.08%, 250=64.88%, 500=6.02% 00:22:39.616 cpu : usr=1.54%, sys=1.49%, ctx=1584, majf=0, minf=1 00:22:39.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:22:39.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:39.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:39.616 issued rwts: total=0,4619,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:39.616 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:39.616 job2: (groupid=0, jobs=1): err= 0: pid=2964487: Tue Nov 26 04:34:17 2024 00:22:39.616 write: IOPS=492, BW=123MiB/s (129MB/s)(1257MiB/10199msec); 0 zone resets 00:22:39.616 slat (usec): min=18, max=100228, avg=1647.36, stdev=4030.40 00:22:39.616 clat (usec): min=1658, max=404794, avg=128119.85, stdev=70183.52 00:22:39.616 lat (usec): min=1708, max=404887, avg=129767.21, stdev=71038.50 00:22:39.616 clat percentiles (msec): 00:22:39.616 | 1.00th=[ 6], 5.00th=[ 21], 10.00th=[ 37], 20.00th=[ 64], 00:22:39.616 | 30.00th=[ 103], 40.00th=[ 115], 50.00th=[ 122], 60.00th=[ 130], 00:22:39.616 | 70.00th=[ 148], 80.00th=[ 180], 90.00th=[ 226], 95.00th=[ 264], 00:22:39.616 | 99.00th=[ 321], 99.50th=[ 347], 99.90th=[ 393], 99.95th=[ 393], 00:22:39.616 | 99.99th=[ 405] 00:22:39.616 bw ( KiB/s): min=59392, max=362496, per=9.10%, avg=127090.75, stdev=63172.59, samples=20 00:22:39.616 iops : min= 232, max= 1416, avg=496.40, stdev=246.77, samples=20 00:22:39.616 lat (msec) : 2=0.04%, 4=0.54%, 10=1.79%, 20=2.45%, 50=12.21% 00:22:39.616 lat (msec) : 100=12.04%, 250=64.97%, 500=5.97% 00:22:39.616 cpu : usr=1.60%, sys=1.60%, ctx=2167, majf=0, minf=1 00:22:39.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:22:39.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:39.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:39.616 issued rwts: total=0,5027,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:39.616 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:39.616 job3: (groupid=0, jobs=1): err= 0: pid=2964488: Tue Nov 26 04:34:17 2024 00:22:39.616 write: IOPS=451, BW=113MiB/s (118MB/s)(1152MiB/10199msec); 0 zone resets 00:22:39.616 slat (usec): min=24, max=122933, avg=1444.20, stdev=4423.73 00:22:39.616 clat (usec): min=1919, max=404912, avg=140047.62, stdev=73271.70 00:22:39.616 lat (msec): min=2, max=404, avg=141.49, stdev=74.34 00:22:39.616 clat percentiles (msec): 00:22:39.616 | 1.00th=[ 7], 5.00th=[ 31], 10.00th=[ 52], 20.00th=[ 81], 00:22:39.616 | 30.00th=[ 104], 40.00th=[ 117], 50.00th=[ 128], 60.00th=[ 144], 00:22:39.616 | 70.00th=[ 161], 80.00th=[ 192], 90.00th=[ 259], 95.00th=[ 288], 00:22:39.616 | 99.00th=[ 321], 99.50th=[ 334], 99.90th=[ 393], 99.95th=[ 393], 00:22:39.616 | 99.99th=[ 405] 00:22:39.616 bw ( KiB/s): min=61440, max=190976, per=8.34%, avg=116388.80, stdev=36523.17, samples=20 00:22:39.616 iops : min= 240, max= 746, avg=454.60, stdev=142.67, samples=20 00:22:39.616 lat (msec) : 2=0.02%, 4=0.13%, 10=1.80%, 20=1.17%, 50=6.44% 00:22:39.616 lat (msec) : 100=18.59%, 250=60.97%, 500=10.87% 00:22:39.616 cpu : usr=1.55%, sys=1.77%, ctx=2639, majf=0, minf=1 00:22:39.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:22:39.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:39.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:39.616 issued rwts: total=0,4609,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:39.616 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:39.616 job4: (groupid=0, jobs=1): err= 0: pid=2964489: Tue Nov 26 04:34:17 2024 00:22:39.616 write: IOPS=680, BW=170MiB/s (178MB/s)(1735MiB/10198msec); 0 zone resets 00:22:39.616 slat (usec): min=18, max=42759, avg=1288.65, stdev=2857.44 00:22:39.616 clat (usec): min=1186, max=406878, avg=92665.20, stdev=52874.67 00:22:39.616 lat (usec): min=1251, max=406932, avg=93953.85, stdev=53516.58 00:22:39.616 clat percentiles (msec): 00:22:39.616 | 1.00th=[ 11], 5.00th=[ 36], 10.00th=[ 46], 20.00th=[ 49], 00:22:39.616 | 30.00th=[ 55], 40.00th=[ 74], 50.00th=[ 86], 60.00th=[ 93], 00:22:39.616 | 70.00th=[ 100], 80.00th=[ 127], 90.00th=[ 171], 95.00th=[ 199], 00:22:39.616 | 99.00th=[ 247], 99.50th=[ 300], 99.90th=[ 384], 99.95th=[ 397], 00:22:39.616 | 99.99th=[ 409] 00:22:39.616 bw ( KiB/s): min=81408, max=342528, per=12.61%, avg=176009.00, stdev=70542.25, samples=20 00:22:39.616 iops : min= 318, max= 1338, avg=687.50, stdev=275.60, samples=20 00:22:39.616 lat (msec) : 2=0.06%, 4=0.09%, 10=0.79%, 20=1.38%, 50=21.75% 00:22:39.616 lat (msec) : 100=46.76%, 250=28.26%, 500=0.91% 00:22:39.616 cpu : usr=2.16%, sys=2.32%, ctx=2395, majf=0, minf=1 00:22:39.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:39.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:39.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:39.616 issued rwts: total=0,6938,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:39.616 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:39.616 job5: (groupid=0, jobs=1): err= 0: pid=2964492: Tue Nov 26 04:34:17 2024 00:22:39.616 write: IOPS=510, BW=128MiB/s (134MB/s)(1287MiB/10088msec); 0 zone resets 00:22:39.616 slat (usec): min=15, max=107336, avg=1250.32, stdev=3910.79 00:22:39.616 clat (usec): min=1155, max=362816, avg=124109.47, stdev=73399.84 00:22:39.616 lat (usec): min=1206, max=380785, avg=125359.79, stdev=74247.51 00:22:39.616 clat percentiles (msec): 00:22:39.616 | 1.00th=[ 5], 5.00th=[ 11], 10.00th=[ 24], 20.00th=[ 60], 00:22:39.616 | 30.00th=[ 80], 40.00th=[ 90], 50.00th=[ 113], 60.00th=[ 148], 00:22:39.616 | 70.00th=[ 167], 80.00th=[ 194], 90.00th=[ 224], 95.00th=[ 245], 00:22:39.616 | 99.00th=[ 305], 99.50th=[ 338], 99.90th=[ 355], 99.95th=[ 355], 00:22:39.616 | 99.99th=[ 363] 00:22:39.616 bw ( KiB/s): min=65024, max=235520, per=9.32%, avg=130176.00, stdev=48696.24, samples=20 00:22:39.616 iops : min= 254, max= 920, avg=508.50, stdev=190.22, samples=20 00:22:39.616 lat (msec) : 2=0.14%, 4=0.70%, 10=4.10%, 20=4.31%, 50=7.30% 00:22:39.616 lat (msec) : 100=29.27%, 250=50.43%, 500=3.75% 00:22:39.616 cpu : usr=1.64%, sys=1.84%, ctx=3137, majf=0, minf=1 00:22:39.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:39.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:39.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:39.616 issued rwts: total=0,5148,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:39.616 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:39.616 job6: (groupid=0, jobs=1): err= 0: pid=2964493: Tue Nov 26 04:34:17 2024 00:22:39.616 write: IOPS=407, BW=102MiB/s (107MB/s)(1029MiB/10111msec); 0 zone resets 00:22:39.616 slat (usec): min=19, max=44980, avg=2014.11, stdev=4481.42 00:22:39.616 clat (msec): min=3, max=367, avg=155.08, stdev=64.82 00:22:39.616 lat (msec): min=3, max=367, avg=157.09, stdev=65.66 00:22:39.616 clat percentiles (msec): 00:22:39.616 | 1.00th=[ 11], 5.00th=[ 40], 10.00th=[ 69], 20.00th=[ 109], 00:22:39.616 | 30.00th=[ 126], 40.00th=[ 142], 50.00th=[ 157], 60.00th=[ 171], 00:22:39.616 | 70.00th=[ 182], 80.00th=[ 199], 90.00th=[ 234], 95.00th=[ 279], 00:22:39.616 | 99.00th=[ 321], 99.50th=[ 342], 99.90th=[ 368], 99.95th=[ 368], 00:22:39.616 | 99.99th=[ 368] 00:22:39.616 bw ( KiB/s): min=55296, max=152064, per=7.43%, avg=103793.05, stdev=28619.21, samples=20 00:22:39.616 iops : min= 216, max= 594, avg=405.40, stdev=111.79, samples=20 00:22:39.616 lat (msec) : 4=0.19%, 10=0.70%, 20=1.36%, 50=4.37%, 100=10.78% 00:22:39.616 lat (msec) : 250=74.98%, 500=7.60% 00:22:39.616 cpu : usr=1.34%, sys=1.37%, ctx=1765, majf=0, minf=2 00:22:39.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:22:39.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:39.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:39.616 issued rwts: total=0,4117,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:39.616 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:39.616 job7: (groupid=0, jobs=1): err= 0: pid=2964494: Tue Nov 26 04:34:17 2024 00:22:39.616 write: IOPS=552, BW=138MiB/s (145MB/s)(1408MiB/10197msec); 0 zone resets 00:22:39.616 slat (usec): min=15, max=77727, avg=1357.15, stdev=3388.18 00:22:39.616 clat (msec): min=2, max=406, avg=114.45, stdev=59.25 00:22:39.616 lat (msec): min=2, max=406, avg=115.81, stdev=59.93 00:22:39.616 clat percentiles (msec): 00:22:39.616 | 1.00th=[ 9], 5.00th=[ 29], 10.00th=[ 52], 20.00th=[ 69], 00:22:39.616 | 30.00th=[ 85], 40.00th=[ 96], 50.00th=[ 105], 60.00th=[ 117], 00:22:39.616 | 70.00th=[ 132], 80.00th=[ 155], 90.00th=[ 192], 95.00th=[ 228], 00:22:39.616 | 99.00th=[ 300], 99.50th=[ 326], 99.90th=[ 397], 99.95th=[ 397], 00:22:39.616 | 99.99th=[ 405] 00:22:39.616 bw ( KiB/s): min=80384, max=212480, per=10.21%, avg=142566.40, stdev=40441.17, samples=20 00:22:39.616 iops : min= 314, max= 830, avg=556.90, stdev=157.97, samples=20 00:22:39.616 lat (msec) : 4=0.14%, 10=1.28%, 20=2.15%, 50=5.77%, 100=36.49% 00:22:39.616 lat (msec) : 250=50.67%, 500=3.50% 00:22:39.617 cpu : usr=1.69%, sys=2.13%, ctx=2596, majf=0, minf=1 00:22:39.617 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:39.617 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:39.617 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:39.617 issued rwts: total=0,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:39.617 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:39.617 job8: (groupid=0, jobs=1): err= 0: pid=2964505: Tue Nov 26 04:34:17 2024 00:22:39.617 write: IOPS=421, BW=105MiB/s (111MB/s)(1070MiB/10147msec); 0 zone resets 00:22:39.617 slat (usec): min=21, max=44671, avg=1661.02, stdev=3905.48 00:22:39.617 clat (usec): min=1861, max=314108, avg=150027.94, stdev=64119.97 00:22:39.617 lat (usec): min=1910, max=314156, avg=151688.97, stdev=64532.11 00:22:39.617 clat percentiles (msec): 00:22:39.617 | 1.00th=[ 8], 5.00th=[ 27], 10.00th=[ 72], 20.00th=[ 113], 00:22:39.617 | 30.00th=[ 122], 40.00th=[ 132], 50.00th=[ 148], 60.00th=[ 161], 00:22:39.617 | 70.00th=[ 174], 80.00th=[ 205], 90.00th=[ 243], 95.00th=[ 259], 00:22:39.617 | 99.00th=[ 296], 99.50th=[ 305], 99.90th=[ 313], 99.95th=[ 313], 00:22:39.617 | 99.99th=[ 313] 00:22:39.617 bw ( KiB/s): min=67584, max=163328, per=7.73%, avg=107942.10, stdev=26255.02, samples=20 00:22:39.617 iops : min= 264, max= 638, avg=421.60, stdev=102.53, samples=20 00:22:39.617 lat (msec) : 2=0.02%, 4=0.30%, 10=1.33%, 20=2.59%, 50=3.90% 00:22:39.617 lat (msec) : 100=8.30%, 250=76.12%, 500=7.43% 00:22:39.617 cpu : usr=1.34%, sys=1.58%, ctx=2011, majf=0, minf=1 00:22:39.617 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:22:39.617 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:39.617 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:39.617 issued rwts: total=0,4279,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:39.617 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:39.617 job9: (groupid=0, jobs=1): err= 0: pid=2964516: Tue Nov 26 04:34:17 2024 00:22:39.617 write: IOPS=562, BW=141MiB/s (147MB/s)(1417MiB/10076msec); 0 zone resets 00:22:39.617 slat (usec): min=17, max=74053, avg=1057.48, stdev=3392.41 00:22:39.617 clat (usec): min=1099, max=343254, avg=112612.27, stdev=69948.63 00:22:39.617 lat (usec): min=1167, max=349132, avg=113669.75, stdev=70777.96 00:22:39.617 clat percentiles (msec): 00:22:39.617 | 1.00th=[ 6], 5.00th=[ 13], 10.00th=[ 23], 20.00th=[ 48], 00:22:39.617 | 30.00th=[ 69], 40.00th=[ 86], 50.00th=[ 106], 60.00th=[ 126], 00:22:39.617 | 70.00th=[ 148], 80.00th=[ 169], 90.00th=[ 207], 95.00th=[ 243], 00:22:39.617 | 99.00th=[ 296], 99.50th=[ 321], 99.90th=[ 342], 99.95th=[ 342], 00:22:39.617 | 99.99th=[ 342] 00:22:39.617 bw ( KiB/s): min=69632, max=249344, per=10.28%, avg=143477.85, stdev=49410.39, samples=20 00:22:39.617 iops : min= 272, max= 974, avg=560.45, stdev=193.01, samples=20 00:22:39.617 lat (msec) : 2=0.11%, 4=0.37%, 10=2.93%, 20=5.33%, 50=12.60% 00:22:39.617 lat (msec) : 100=26.93%, 250=47.54%, 500=4.20% 00:22:39.617 cpu : usr=1.89%, sys=2.16%, ctx=3624, majf=0, minf=1 00:22:39.617 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:39.617 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:39.617 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:39.617 issued rwts: total=0,5667,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:39.617 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:39.617 job10: (groupid=0, jobs=1): err= 0: pid=2964522: Tue Nov 26 04:34:17 2024 00:22:39.617 write: IOPS=423, BW=106MiB/s (111MB/s)(1072MiB/10133msec); 0 zone resets 00:22:39.617 slat (usec): min=21, max=123075, avg=2009.33, stdev=4963.62 00:22:39.617 clat (msec): min=3, max=387, avg=149.20, stdev=76.75 00:22:39.617 lat (msec): min=4, max=387, avg=151.21, stdev=77.64 00:22:39.617 clat percentiles (msec): 00:22:39.617 | 1.00th=[ 10], 5.00th=[ 38], 10.00th=[ 51], 20.00th=[ 78], 00:22:39.617 | 30.00th=[ 107], 40.00th=[ 131], 50.00th=[ 146], 60.00th=[ 159], 00:22:39.617 | 70.00th=[ 178], 80.00th=[ 211], 90.00th=[ 262], 95.00th=[ 288], 00:22:39.617 | 99.00th=[ 347], 99.50th=[ 359], 99.90th=[ 376], 99.95th=[ 384], 00:22:39.617 | 99.99th=[ 388] 00:22:39.617 bw ( KiB/s): min=61440, max=259072, per=7.74%, avg=108126.05, stdev=47586.40, samples=20 00:22:39.617 iops : min= 240, max= 1012, avg=422.35, stdev=185.89, samples=20 00:22:39.617 lat (msec) : 4=0.02%, 10=1.05%, 20=2.10%, 50=6.79%, 100=18.12% 00:22:39.617 lat (msec) : 250=59.53%, 500=12.39% 00:22:39.617 cpu : usr=1.45%, sys=1.54%, ctx=1667, majf=0, minf=1 00:22:39.617 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:22:39.617 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:39.617 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:39.617 issued rwts: total=0,4287,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:39.617 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:39.617 00:22:39.617 Run status group 0 (all jobs): 00:22:39.617 WRITE: bw=1363MiB/s (1430MB/s), 102MiB/s-170MiB/s (107MB/s-178MB/s), io=13.6GiB (14.6GB), run=10076-10200msec 00:22:39.617 00:22:39.617 Disk stats (read/write): 00:22:39.617 nvme0n1: ios=49/10576, merge=0/0, ticks=33/1250221, in_queue=1250254, util=97.33% 00:22:39.617 nvme10n1: ios=41/9043, merge=0/0, ticks=34/1209252, in_queue=1209286, util=97.35% 00:22:39.617 nvme1n1: ios=46/10030, merge=0/0, ticks=82/1238564, in_queue=1238646, util=97.87% 00:22:39.617 nvme2n1: ios=45/9194, merge=0/0, ticks=1968/1239837, in_queue=1241805, util=100.00% 00:22:39.617 nvme3n1: ios=41/13853, merge=0/0, ticks=1292/1234652, in_queue=1235944, util=99.99% 00:22:39.617 nvme4n1: ios=45/10072, merge=0/0, ticks=204/1219652, in_queue=1219856, util=99.83% 00:22:39.617 nvme5n1: ios=0/8039, merge=0/0, ticks=0/1214199, in_queue=1214199, util=98.29% 00:22:39.617 nvme6n1: ios=0/11243, merge=0/0, ticks=0/1242462, in_queue=1242462, util=98.45% 00:22:39.617 nvme7n1: ios=0/8295, merge=0/0, ticks=0/1216863, in_queue=1216863, util=98.80% 00:22:39.617 nvme8n1: ios=40/11072, merge=0/0, ticks=515/1220383, in_queue=1220898, util=100.00% 00:22:39.617 nvme9n1: ios=0/8388, merge=0/0, ticks=0/1208687, in_queue=1208687, util=99.08% 00:22:39.617 04:34:17 -- target/multiconnection.sh@36 -- # sync 00:22:39.617 04:34:17 -- target/multiconnection.sh@37 -- # seq 1 11 00:22:39.617 04:34:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:39.617 04:34:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:22:39.617 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:22:39.617 04:34:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:22:39.617 04:34:18 -- common/autotest_common.sh@1208 -- # local i=0 00:22:39.617 04:34:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:39.617 04:34:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:22:39.617 04:34:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:39.617 04:34:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:22:39.617 04:34:18 -- common/autotest_common.sh@1220 -- # return 0 00:22:39.617 04:34:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:39.617 04:34:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.617 04:34:18 -- common/autotest_common.sh@10 -- # set +x 00:22:39.617 04:34:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.617 04:34:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:39.617 04:34:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:22:39.617 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:22:39.617 04:34:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:22:39.617 04:34:18 -- common/autotest_common.sh@1208 -- # local i=0 00:22:39.617 04:34:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:39.617 04:34:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:22:39.617 04:34:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:39.617 04:34:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:22:39.617 04:34:18 -- common/autotest_common.sh@1220 -- # return 0 00:22:39.617 04:34:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:39.617 04:34:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.617 04:34:18 -- common/autotest_common.sh@10 -- # set +x 00:22:39.617 04:34:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.617 04:34:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:39.617 04:34:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:22:39.617 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:22:39.617 04:34:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:22:39.617 04:34:18 -- common/autotest_common.sh@1208 -- # local i=0 00:22:39.617 04:34:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:39.617 04:34:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:22:39.617 04:34:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:39.617 04:34:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:22:39.617 04:34:18 -- common/autotest_common.sh@1220 -- # return 0 00:22:39.617 04:34:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:22:39.617 04:34:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.617 04:34:18 -- common/autotest_common.sh@10 -- # set +x 00:22:39.617 04:34:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.617 04:34:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:39.617 04:34:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:22:39.877 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:22:39.877 04:34:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:22:39.877 04:34:19 -- common/autotest_common.sh@1208 -- # local i=0 00:22:39.877 04:34:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:39.877 04:34:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:22:39.877 04:34:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:39.877 04:34:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:22:39.877 04:34:19 -- common/autotest_common.sh@1220 -- # return 0 00:22:39.877 04:34:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:22:39.877 04:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.877 04:34:19 -- common/autotest_common.sh@10 -- # set +x 00:22:39.877 04:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.877 04:34:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:39.877 04:34:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:22:40.446 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:22:40.446 04:34:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:22:40.446 04:34:19 -- common/autotest_common.sh@1208 -- # local i=0 00:22:40.446 04:34:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:40.446 04:34:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:22:40.446 04:34:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:40.446 04:34:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:22:40.446 04:34:19 -- common/autotest_common.sh@1220 -- # return 0 00:22:40.446 04:34:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:22:40.446 04:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.446 04:34:19 -- common/autotest_common.sh@10 -- # set +x 00:22:40.446 04:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.446 04:34:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.446 04:34:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:22:40.704 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:22:40.704 04:34:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:22:40.704 04:34:19 -- common/autotest_common.sh@1208 -- # local i=0 00:22:40.704 04:34:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:40.704 04:34:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:22:40.704 04:34:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:40.704 04:34:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:22:40.704 04:34:19 -- common/autotest_common.sh@1220 -- # return 0 00:22:40.704 04:34:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:22:40.704 04:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.704 04:34:19 -- common/autotest_common.sh@10 -- # set +x 00:22:40.704 04:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.704 04:34:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.704 04:34:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:22:40.963 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:22:40.963 04:34:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:22:40.963 04:34:19 -- common/autotest_common.sh@1208 -- # local i=0 00:22:40.963 04:34:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:40.963 04:34:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:22:40.963 04:34:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:40.963 04:34:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:22:40.963 04:34:19 -- common/autotest_common.sh@1220 -- # return 0 00:22:40.963 04:34:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:22:40.963 04:34:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.963 04:34:19 -- common/autotest_common.sh@10 -- # set +x 00:22:40.963 04:34:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.963 04:34:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.963 04:34:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:22:40.963 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:22:40.963 04:34:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:22:40.963 04:34:20 -- common/autotest_common.sh@1208 -- # local i=0 00:22:40.963 04:34:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:40.963 04:34:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:22:40.963 04:34:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:40.963 04:34:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:22:40.963 04:34:20 -- common/autotest_common.sh@1220 -- # return 0 00:22:40.963 04:34:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:22:40.963 04:34:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.963 04:34:20 -- common/autotest_common.sh@10 -- # set +x 00:22:40.963 04:34:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.963 04:34:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.963 04:34:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:22:41.223 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:22:41.223 04:34:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:22:41.223 04:34:20 -- common/autotest_common.sh@1208 -- # local i=0 00:22:41.223 04:34:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:41.223 04:34:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:22:41.223 04:34:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:41.224 04:34:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:22:41.224 04:34:20 -- common/autotest_common.sh@1220 -- # return 0 00:22:41.224 04:34:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:22:41.224 04:34:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:41.224 04:34:20 -- common/autotest_common.sh@10 -- # set +x 00:22:41.224 04:34:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:41.224 04:34:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:41.224 04:34:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:22:41.224 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:22:41.224 04:34:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:22:41.224 04:34:20 -- common/autotest_common.sh@1208 -- # local i=0 00:22:41.224 04:34:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:41.224 04:34:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:22:41.224 04:34:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:41.224 04:34:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:22:41.224 04:34:20 -- common/autotest_common.sh@1220 -- # return 0 00:22:41.224 04:34:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:22:41.224 04:34:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:41.224 04:34:20 -- common/autotest_common.sh@10 -- # set +x 00:22:41.224 04:34:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:41.224 04:34:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:41.224 04:34:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:22:41.485 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:22:41.485 04:34:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:22:41.485 04:34:20 -- common/autotest_common.sh@1208 -- # local i=0 00:22:41.485 04:34:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:41.485 04:34:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:22:41.485 04:34:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:41.485 04:34:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:22:41.485 04:34:20 -- common/autotest_common.sh@1220 -- # return 0 00:22:41.485 04:34:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:22:41.485 04:34:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:41.485 04:34:20 -- common/autotest_common.sh@10 -- # set +x 00:22:41.485 04:34:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:41.485 04:34:20 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:22:41.485 04:34:20 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:22:41.485 04:34:20 -- target/multiconnection.sh@47 -- # nvmftestfini 00:22:41.485 04:34:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:41.485 04:34:20 -- nvmf/common.sh@116 -- # sync 00:22:41.485 04:34:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:41.485 04:34:20 -- nvmf/common.sh@119 -- # set +e 00:22:41.485 04:34:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:41.485 04:34:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:41.485 rmmod nvme_tcp 00:22:41.485 rmmod nvme_fabrics 00:22:41.485 rmmod nvme_keyring 00:22:41.485 04:34:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:41.485 04:34:20 -- nvmf/common.sh@123 -- # set -e 00:22:41.485 04:34:20 -- nvmf/common.sh@124 -- # return 0 00:22:41.485 04:34:20 -- nvmf/common.sh@477 -- # '[' -n 2958899 ']' 00:22:41.485 04:34:20 -- nvmf/common.sh@478 -- # killprocess 2958899 00:22:41.485 04:34:20 -- common/autotest_common.sh@936 -- # '[' -z 2958899 ']' 00:22:41.485 04:34:20 -- common/autotest_common.sh@940 -- # kill -0 2958899 00:22:41.485 04:34:20 -- common/autotest_common.sh@941 -- # uname 00:22:41.485 04:34:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:41.485 04:34:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2958899 00:22:41.485 04:34:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:41.485 04:34:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:41.485 04:34:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2958899' 00:22:41.485 killing process with pid 2958899 00:22:41.485 04:34:20 -- common/autotest_common.sh@955 -- # kill 2958899 00:22:41.485 04:34:20 -- common/autotest_common.sh@960 -- # wait 2958899 00:22:42.052 04:34:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:42.052 04:34:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:42.052 04:34:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:42.052 04:34:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:42.052 04:34:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:42.052 04:34:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:42.052 04:34:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:42.052 04:34:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:44.590 04:34:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:44.590 00:22:44.590 real 1m2.058s 00:22:44.590 user 3m25.499s 00:22:44.590 sys 0m26.499s 00:22:44.590 04:34:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:44.590 04:34:23 -- common/autotest_common.sh@10 -- # set +x 00:22:44.590 ************************************ 00:22:44.590 END TEST nvmf_multiconnection 00:22:44.590 ************************************ 00:22:44.590 04:34:23 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:44.590 04:34:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:44.590 04:34:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:44.590 04:34:23 -- common/autotest_common.sh@10 -- # set +x 00:22:44.590 ************************************ 00:22:44.590 START TEST nvmf_initiator_timeout 00:22:44.590 ************************************ 00:22:44.590 04:34:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:44.590 * Looking for test storage... 00:22:44.590 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:44.590 04:34:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:44.590 04:34:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:44.590 04:34:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:44.590 04:34:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:44.590 04:34:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:44.590 04:34:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:44.590 04:34:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:44.590 04:34:23 -- scripts/common.sh@335 -- # IFS=.-: 00:22:44.590 04:34:23 -- scripts/common.sh@335 -- # read -ra ver1 00:22:44.590 04:34:23 -- scripts/common.sh@336 -- # IFS=.-: 00:22:44.590 04:34:23 -- scripts/common.sh@336 -- # read -ra ver2 00:22:44.590 04:34:23 -- scripts/common.sh@337 -- # local 'op=<' 00:22:44.590 04:34:23 -- scripts/common.sh@339 -- # ver1_l=2 00:22:44.590 04:34:23 -- scripts/common.sh@340 -- # ver2_l=1 00:22:44.590 04:34:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:44.590 04:34:23 -- scripts/common.sh@343 -- # case "$op" in 00:22:44.590 04:34:23 -- scripts/common.sh@344 -- # : 1 00:22:44.590 04:34:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:44.590 04:34:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:44.590 04:34:23 -- scripts/common.sh@364 -- # decimal 1 00:22:44.590 04:34:23 -- scripts/common.sh@352 -- # local d=1 00:22:44.590 04:34:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:44.590 04:34:23 -- scripts/common.sh@354 -- # echo 1 00:22:44.590 04:34:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:44.590 04:34:23 -- scripts/common.sh@365 -- # decimal 2 00:22:44.590 04:34:23 -- scripts/common.sh@352 -- # local d=2 00:22:44.590 04:34:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:44.590 04:34:23 -- scripts/common.sh@354 -- # echo 2 00:22:44.590 04:34:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:44.590 04:34:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:44.590 04:34:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:44.590 04:34:23 -- scripts/common.sh@367 -- # return 0 00:22:44.590 04:34:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:44.590 04:34:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:44.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:44.590 --rc genhtml_branch_coverage=1 00:22:44.590 --rc genhtml_function_coverage=1 00:22:44.590 --rc genhtml_legend=1 00:22:44.590 --rc geninfo_all_blocks=1 00:22:44.590 --rc geninfo_unexecuted_blocks=1 00:22:44.590 00:22:44.590 ' 00:22:44.590 04:34:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:44.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:44.590 --rc genhtml_branch_coverage=1 00:22:44.590 --rc genhtml_function_coverage=1 00:22:44.590 --rc genhtml_legend=1 00:22:44.590 --rc geninfo_all_blocks=1 00:22:44.590 --rc geninfo_unexecuted_blocks=1 00:22:44.590 00:22:44.590 ' 00:22:44.590 04:34:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:44.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:44.590 --rc genhtml_branch_coverage=1 00:22:44.590 --rc genhtml_function_coverage=1 00:22:44.590 --rc genhtml_legend=1 00:22:44.590 --rc geninfo_all_blocks=1 00:22:44.590 --rc geninfo_unexecuted_blocks=1 00:22:44.590 00:22:44.590 ' 00:22:44.590 04:34:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:44.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:44.590 --rc genhtml_branch_coverage=1 00:22:44.590 --rc genhtml_function_coverage=1 00:22:44.590 --rc genhtml_legend=1 00:22:44.590 --rc geninfo_all_blocks=1 00:22:44.590 --rc geninfo_unexecuted_blocks=1 00:22:44.590 00:22:44.590 ' 00:22:44.590 04:34:23 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:44.590 04:34:23 -- nvmf/common.sh@7 -- # uname -s 00:22:44.590 04:34:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:44.590 04:34:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:44.590 04:34:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:44.590 04:34:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:44.590 04:34:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:44.590 04:34:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:44.590 04:34:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:44.590 04:34:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:44.590 04:34:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:44.590 04:34:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:44.590 04:34:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:44.590 04:34:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:44.590 04:34:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:44.590 04:34:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:44.590 04:34:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:44.590 04:34:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:44.590 04:34:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:44.590 04:34:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:44.590 04:34:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:44.591 04:34:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.591 04:34:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.591 04:34:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.591 04:34:23 -- paths/export.sh@5 -- # export PATH 00:22:44.591 04:34:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.591 04:34:23 -- nvmf/common.sh@46 -- # : 0 00:22:44.591 04:34:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:44.591 04:34:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:44.591 04:34:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:44.591 04:34:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:44.591 04:34:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:44.591 04:34:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:44.591 04:34:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:44.591 04:34:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:44.591 04:34:23 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:44.591 04:34:23 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:44.591 04:34:23 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:22:44.591 04:34:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:44.591 04:34:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:44.591 04:34:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:44.591 04:34:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:44.591 04:34:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:44.591 04:34:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:44.591 04:34:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:44.591 04:34:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:44.591 04:34:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:44.591 04:34:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:44.591 04:34:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:44.591 04:34:23 -- common/autotest_common.sh@10 -- # set +x 00:22:46.499 04:34:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:46.499 04:34:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:46.499 04:34:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:46.499 04:34:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:46.499 04:34:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:46.499 04:34:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:46.499 04:34:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:46.499 04:34:25 -- nvmf/common.sh@294 -- # net_devs=() 00:22:46.499 04:34:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:46.499 04:34:25 -- nvmf/common.sh@295 -- # e810=() 00:22:46.499 04:34:25 -- nvmf/common.sh@295 -- # local -ga e810 00:22:46.499 04:34:25 -- nvmf/common.sh@296 -- # x722=() 00:22:46.499 04:34:25 -- nvmf/common.sh@296 -- # local -ga x722 00:22:46.499 04:34:25 -- nvmf/common.sh@297 -- # mlx=() 00:22:46.499 04:34:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:46.499 04:34:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:46.499 04:34:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:46.499 04:34:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:46.499 04:34:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:46.499 04:34:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:46.499 04:34:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:46.499 04:34:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:46.499 04:34:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:46.499 04:34:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:46.499 04:34:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:46.499 04:34:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:46.499 04:34:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:46.499 04:34:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:46.499 04:34:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:46.499 04:34:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:46.499 04:34:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:46.499 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:46.499 04:34:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:46.499 04:34:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:46.499 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:46.499 04:34:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:46.499 04:34:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:46.499 04:34:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:46.499 04:34:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:46.499 04:34:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:46.499 04:34:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:46.499 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:46.499 04:34:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:46.499 04:34:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:46.499 04:34:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:46.499 04:34:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:46.499 04:34:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:46.499 04:34:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:46.499 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:46.499 04:34:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:46.499 04:34:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:46.499 04:34:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:46.499 04:34:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:46.499 04:34:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:46.499 04:34:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:46.499 04:34:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:46.499 04:34:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:46.499 04:34:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:46.499 04:34:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:46.499 04:34:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:46.499 04:34:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:46.499 04:34:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:46.499 04:34:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:46.499 04:34:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:46.499 04:34:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:46.499 04:34:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:46.499 04:34:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:46.499 04:34:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:46.499 04:34:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:46.499 04:34:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:46.499 04:34:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:46.499 04:34:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:46.499 04:34:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:46.499 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:46.499 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.263 ms 00:22:46.499 00:22:46.499 --- 10.0.0.2 ping statistics --- 00:22:46.499 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:46.499 rtt min/avg/max/mdev = 0.263/0.263/0.263/0.000 ms 00:22:46.499 04:34:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:46.499 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:46.499 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:22:46.499 00:22:46.499 --- 10.0.0.1 ping statistics --- 00:22:46.499 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:46.499 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:22:46.499 04:34:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:46.499 04:34:25 -- nvmf/common.sh@410 -- # return 0 00:22:46.499 04:34:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:46.499 04:34:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:46.499 04:34:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:46.499 04:34:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:46.499 04:34:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:46.499 04:34:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:46.499 04:34:25 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:22:46.499 04:34:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:46.499 04:34:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:46.499 04:34:25 -- common/autotest_common.sh@10 -- # set +x 00:22:46.499 04:34:25 -- nvmf/common.sh@469 -- # nvmfpid=2968034 00:22:46.499 04:34:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:46.499 04:34:25 -- nvmf/common.sh@470 -- # waitforlisten 2968034 00:22:46.499 04:34:25 -- common/autotest_common.sh@829 -- # '[' -z 2968034 ']' 00:22:46.499 04:34:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:46.499 04:34:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:46.499 04:34:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:46.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:46.499 04:34:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:46.499 04:34:25 -- common/autotest_common.sh@10 -- # set +x 00:22:46.499 [2024-11-26 04:34:25.653854] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:22:46.499 [2024-11-26 04:34:25.653929] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:46.499 EAL: No free 2048 kB hugepages reported on node 1 00:22:46.760 [2024-11-26 04:34:25.722713] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:46.760 [2024-11-26 04:34:25.818013] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:46.760 [2024-11-26 04:34:25.818186] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:46.760 [2024-11-26 04:34:25.818210] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:46.760 [2024-11-26 04:34:25.818224] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:46.760 [2024-11-26 04:34:25.818299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:46.760 [2024-11-26 04:34:25.818351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:46.760 [2024-11-26 04:34:25.818403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:46.760 [2024-11-26 04:34:25.818406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:47.695 04:34:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:47.695 04:34:26 -- common/autotest_common.sh@862 -- # return 0 00:22:47.695 04:34:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:47.695 04:34:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:47.695 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:22:47.695 04:34:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:47.695 04:34:26 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:22:47.695 04:34:26 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:47.695 04:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:47.695 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:22:47.695 Malloc0 00:22:47.695 04:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.695 04:34:26 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:22:47.695 04:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:47.695 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:22:47.695 Delay0 00:22:47.695 04:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.695 04:34:26 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:47.695 04:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:47.695 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:22:47.695 [2024-11-26 04:34:26.674011] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:47.695 04:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.695 04:34:26 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:22:47.695 04:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:47.695 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:22:47.695 04:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.695 04:34:26 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:22:47.695 04:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:47.695 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:22:47.695 04:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.695 04:34:26 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:47.695 04:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:47.695 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:22:47.695 [2024-11-26 04:34:26.702304] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:47.695 04:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.695 04:34:26 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:48.265 04:34:27 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:22:48.265 04:34:27 -- common/autotest_common.sh@1187 -- # local i=0 00:22:48.265 04:34:27 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:48.265 04:34:27 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:48.265 04:34:27 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:50.172 04:34:29 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:50.430 04:34:29 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:50.430 04:34:29 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:22:50.430 04:34:29 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:50.430 04:34:29 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:50.430 04:34:29 -- common/autotest_common.sh@1197 -- # return 0 00:22:50.430 04:34:29 -- target/initiator_timeout.sh@35 -- # fio_pid=2968607 00:22:50.430 04:34:29 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:22:50.430 04:34:29 -- target/initiator_timeout.sh@37 -- # sleep 3 00:22:50.430 [global] 00:22:50.430 thread=1 00:22:50.430 invalidate=1 00:22:50.430 rw=write 00:22:50.430 time_based=1 00:22:50.430 runtime=60 00:22:50.430 ioengine=libaio 00:22:50.430 direct=1 00:22:50.430 bs=4096 00:22:50.430 iodepth=1 00:22:50.430 norandommap=0 00:22:50.430 numjobs=1 00:22:50.430 00:22:50.430 verify_dump=1 00:22:50.430 verify_backlog=512 00:22:50.430 verify_state_save=0 00:22:50.430 do_verify=1 00:22:50.430 verify=crc32c-intel 00:22:50.430 [job0] 00:22:50.430 filename=/dev/nvme0n1 00:22:50.430 Could not set queue depth (nvme0n1) 00:22:50.430 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:22:50.430 fio-3.35 00:22:50.430 Starting 1 thread 00:22:53.805 04:34:32 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:22:53.805 04:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.805 04:34:32 -- common/autotest_common.sh@10 -- # set +x 00:22:53.805 true 00:22:53.805 04:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.805 04:34:32 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:22:53.805 04:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.805 04:34:32 -- common/autotest_common.sh@10 -- # set +x 00:22:53.805 true 00:22:53.805 04:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.805 04:34:32 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:22:53.805 04:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.805 04:34:32 -- common/autotest_common.sh@10 -- # set +x 00:22:53.805 true 00:22:53.805 04:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.805 04:34:32 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:22:53.805 04:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.805 04:34:32 -- common/autotest_common.sh@10 -- # set +x 00:22:53.805 true 00:22:53.805 04:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.805 04:34:32 -- target/initiator_timeout.sh@45 -- # sleep 3 00:22:56.350 04:34:35 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:22:56.350 04:34:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:56.350 04:34:35 -- common/autotest_common.sh@10 -- # set +x 00:22:56.350 true 00:22:56.350 04:34:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:56.350 04:34:35 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:22:56.350 04:34:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:56.350 04:34:35 -- common/autotest_common.sh@10 -- # set +x 00:22:56.350 true 00:22:56.350 04:34:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:56.350 04:34:35 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:22:56.350 04:34:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:56.350 04:34:35 -- common/autotest_common.sh@10 -- # set +x 00:22:56.350 true 00:22:56.350 04:34:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:56.350 04:34:35 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:22:56.350 04:34:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:56.350 04:34:35 -- common/autotest_common.sh@10 -- # set +x 00:22:56.350 true 00:22:56.350 04:34:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:56.350 04:34:35 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:22:56.350 04:34:35 -- target/initiator_timeout.sh@54 -- # wait 2968607 00:23:52.579 00:23:52.579 job0: (groupid=0, jobs=1): err= 0: pid=2968680: Tue Nov 26 04:35:29 2024 00:23:52.579 read: IOPS=95, BW=382KiB/s (392kB/s)(22.4MiB/60015msec) 00:23:52.579 slat (usec): min=4, max=15640, avg=15.91, stdev=217.41 00:23:52.580 clat (usec): min=227, max=41064k, avg=10192.12, stdev=542154.47 00:23:52.580 lat (usec): min=232, max=41064k, avg=10208.03, stdev=542155.03 00:23:52.580 clat percentiles (usec): 00:23:52.580 | 1.00th=[ 239], 5.00th=[ 247], 10.00th=[ 253], 00:23:52.580 | 20.00th=[ 265], 30.00th=[ 273], 40.00th=[ 281], 00:23:52.580 | 50.00th=[ 285], 60.00th=[ 297], 70.00th=[ 314], 00:23:52.580 | 80.00th=[ 334], 90.00th=[ 445], 95.00th=[ 41157], 00:23:52.580 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42206], 00:23:52.580 | 99.95th=[ 42206], 99.99th=[17112761] 00:23:52.580 write: IOPS=102, BW=409KiB/s (419kB/s)(24.0MiB/60015msec); 0 zone resets 00:23:52.580 slat (usec): min=6, max=30686, avg=15.98, stdev=391.40 00:23:52.580 clat (usec): min=171, max=644, avg=211.97, stdev=26.08 00:23:52.580 lat (usec): min=179, max=30968, avg=227.95, stdev=393.33 00:23:52.580 clat percentiles (usec): 00:23:52.580 | 1.00th=[ 182], 5.00th=[ 186], 10.00th=[ 190], 20.00th=[ 194], 00:23:52.580 | 30.00th=[ 200], 40.00th=[ 204], 50.00th=[ 208], 60.00th=[ 212], 00:23:52.580 | 70.00th=[ 217], 80.00th=[ 225], 90.00th=[ 237], 95.00th=[ 253], 00:23:52.580 | 99.00th=[ 330], 99.50th=[ 359], 99.90th=[ 424], 99.95th=[ 433], 00:23:52.580 | 99.99th=[ 644] 00:23:52.580 bw ( KiB/s): min= 1712, max= 8192, per=100.00%, avg=4468.36, stdev=2061.72, samples=11 00:23:52.580 iops : min= 428, max= 2048, avg=1117.09, stdev=515.43, samples=11 00:23:52.580 lat (usec) : 250=52.36%, 500=43.70%, 750=0.71%, 1000=0.01% 00:23:52.580 lat (msec) : 4=0.01%, 50=3.20%, >=2000=0.01% 00:23:52.580 cpu : usr=0.16%, sys=0.25%, ctx=11887, majf=0, minf=1 00:23:52.580 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:52.580 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:52.580 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:52.580 issued rwts: total=5738,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:52.580 latency : target=0, window=0, percentile=100.00%, depth=1 00:23:52.580 00:23:52.580 Run status group 0 (all jobs): 00:23:52.580 READ: bw=382KiB/s (392kB/s), 382KiB/s-382KiB/s (392kB/s-392kB/s), io=22.4MiB (23.5MB), run=60015-60015msec 00:23:52.580 WRITE: bw=409KiB/s (419kB/s), 409KiB/s-409KiB/s (419kB/s-419kB/s), io=24.0MiB (25.2MB), run=60015-60015msec 00:23:52.580 00:23:52.580 Disk stats (read/write): 00:23:52.580 nvme0n1: ios=5787/6144, merge=0/0, ticks=18044/1238, in_queue=19282, util=99.82% 00:23:52.580 04:35:29 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:52.580 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:52.580 04:35:29 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:23:52.580 04:35:29 -- common/autotest_common.sh@1208 -- # local i=0 00:23:52.580 04:35:29 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:52.580 04:35:29 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:52.580 04:35:29 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:52.580 04:35:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:52.580 04:35:29 -- common/autotest_common.sh@1220 -- # return 0 00:23:52.580 04:35:29 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:23:52.580 04:35:29 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:23:52.580 nvmf hotplug test: fio successful as expected 00:23:52.580 04:35:29 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:52.580 04:35:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:52.580 04:35:29 -- common/autotest_common.sh@10 -- # set +x 00:23:52.580 04:35:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:52.580 04:35:29 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:23:52.580 04:35:29 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:23:52.580 04:35:29 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:23:52.580 04:35:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:52.580 04:35:29 -- nvmf/common.sh@116 -- # sync 00:23:52.580 04:35:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:52.580 04:35:29 -- nvmf/common.sh@119 -- # set +e 00:23:52.580 04:35:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:52.580 04:35:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:52.580 rmmod nvme_tcp 00:23:52.580 rmmod nvme_fabrics 00:23:52.580 rmmod nvme_keyring 00:23:52.580 04:35:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:52.580 04:35:29 -- nvmf/common.sh@123 -- # set -e 00:23:52.580 04:35:29 -- nvmf/common.sh@124 -- # return 0 00:23:52.580 04:35:29 -- nvmf/common.sh@477 -- # '[' -n 2968034 ']' 00:23:52.580 04:35:29 -- nvmf/common.sh@478 -- # killprocess 2968034 00:23:52.580 04:35:29 -- common/autotest_common.sh@936 -- # '[' -z 2968034 ']' 00:23:52.580 04:35:29 -- common/autotest_common.sh@940 -- # kill -0 2968034 00:23:52.580 04:35:29 -- common/autotest_common.sh@941 -- # uname 00:23:52.580 04:35:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:52.580 04:35:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2968034 00:23:52.580 04:35:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:52.580 04:35:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:52.580 04:35:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2968034' 00:23:52.580 killing process with pid 2968034 00:23:52.580 04:35:29 -- common/autotest_common.sh@955 -- # kill 2968034 00:23:52.580 04:35:29 -- common/autotest_common.sh@960 -- # wait 2968034 00:23:52.580 04:35:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:52.580 04:35:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:52.580 04:35:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:52.580 04:35:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:52.580 04:35:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:52.580 04:35:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:52.580 04:35:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:52.580 04:35:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:53.149 04:35:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:53.149 00:23:53.149 real 1m9.017s 00:23:53.149 user 4m13.689s 00:23:53.149 sys 0m6.846s 00:23:53.149 04:35:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:53.149 04:35:32 -- common/autotest_common.sh@10 -- # set +x 00:23:53.149 ************************************ 00:23:53.149 END TEST nvmf_initiator_timeout 00:23:53.149 ************************************ 00:23:53.149 04:35:32 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:23:53.149 04:35:32 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:23:53.149 04:35:32 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:23:53.149 04:35:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:53.149 04:35:32 -- common/autotest_common.sh@10 -- # set +x 00:23:55.686 04:35:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:55.686 04:35:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:55.686 04:35:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:55.686 04:35:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:55.686 04:35:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:55.686 04:35:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:55.686 04:35:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:55.686 04:35:34 -- nvmf/common.sh@294 -- # net_devs=() 00:23:55.686 04:35:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:55.686 04:35:34 -- nvmf/common.sh@295 -- # e810=() 00:23:55.686 04:35:34 -- nvmf/common.sh@295 -- # local -ga e810 00:23:55.686 04:35:34 -- nvmf/common.sh@296 -- # x722=() 00:23:55.686 04:35:34 -- nvmf/common.sh@296 -- # local -ga x722 00:23:55.686 04:35:34 -- nvmf/common.sh@297 -- # mlx=() 00:23:55.686 04:35:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:55.686 04:35:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:55.686 04:35:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:55.686 04:35:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:55.686 04:35:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:55.686 04:35:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:55.686 04:35:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:55.686 04:35:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:55.686 04:35:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:55.686 04:35:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:55.686 04:35:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:55.686 04:35:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:55.686 04:35:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:55.686 04:35:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:55.686 04:35:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:55.686 04:35:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:55.686 04:35:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:55.686 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:55.686 04:35:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:55.686 04:35:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:55.686 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:55.686 04:35:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:55.686 04:35:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:55.686 04:35:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:55.686 04:35:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:55.686 04:35:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:55.686 04:35:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:55.686 04:35:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:55.686 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:55.686 04:35:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:55.686 04:35:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:55.686 04:35:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:55.686 04:35:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:55.686 04:35:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:55.686 04:35:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:55.686 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:55.686 04:35:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:55.687 04:35:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:55.687 04:35:34 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:55.687 04:35:34 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:23:55.687 04:35:34 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:23:55.687 04:35:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:55.687 04:35:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:55.687 04:35:34 -- common/autotest_common.sh@10 -- # set +x 00:23:55.687 ************************************ 00:23:55.687 START TEST nvmf_perf_adq 00:23:55.687 ************************************ 00:23:55.687 04:35:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:23:55.687 * Looking for test storage... 00:23:55.687 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:55.687 04:35:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:55.687 04:35:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:55.687 04:35:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:55.687 04:35:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:55.687 04:35:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:55.687 04:35:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:55.687 04:35:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:55.687 04:35:34 -- scripts/common.sh@335 -- # IFS=.-: 00:23:55.687 04:35:34 -- scripts/common.sh@335 -- # read -ra ver1 00:23:55.687 04:35:34 -- scripts/common.sh@336 -- # IFS=.-: 00:23:55.687 04:35:34 -- scripts/common.sh@336 -- # read -ra ver2 00:23:55.687 04:35:34 -- scripts/common.sh@337 -- # local 'op=<' 00:23:55.687 04:35:34 -- scripts/common.sh@339 -- # ver1_l=2 00:23:55.687 04:35:34 -- scripts/common.sh@340 -- # ver2_l=1 00:23:55.687 04:35:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:55.687 04:35:34 -- scripts/common.sh@343 -- # case "$op" in 00:23:55.687 04:35:34 -- scripts/common.sh@344 -- # : 1 00:23:55.687 04:35:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:55.687 04:35:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:55.687 04:35:34 -- scripts/common.sh@364 -- # decimal 1 00:23:55.687 04:35:34 -- scripts/common.sh@352 -- # local d=1 00:23:55.687 04:35:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:55.687 04:35:34 -- scripts/common.sh@354 -- # echo 1 00:23:55.687 04:35:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:55.687 04:35:34 -- scripts/common.sh@365 -- # decimal 2 00:23:55.687 04:35:34 -- scripts/common.sh@352 -- # local d=2 00:23:55.687 04:35:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:55.687 04:35:34 -- scripts/common.sh@354 -- # echo 2 00:23:55.687 04:35:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:55.687 04:35:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:55.687 04:35:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:55.687 04:35:34 -- scripts/common.sh@367 -- # return 0 00:23:55.687 04:35:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:55.687 04:35:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:55.687 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:55.687 --rc genhtml_branch_coverage=1 00:23:55.687 --rc genhtml_function_coverage=1 00:23:55.687 --rc genhtml_legend=1 00:23:55.687 --rc geninfo_all_blocks=1 00:23:55.687 --rc geninfo_unexecuted_blocks=1 00:23:55.687 00:23:55.687 ' 00:23:55.687 04:35:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:55.687 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:55.687 --rc genhtml_branch_coverage=1 00:23:55.687 --rc genhtml_function_coverage=1 00:23:55.687 --rc genhtml_legend=1 00:23:55.687 --rc geninfo_all_blocks=1 00:23:55.687 --rc geninfo_unexecuted_blocks=1 00:23:55.687 00:23:55.687 ' 00:23:55.687 04:35:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:55.687 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:55.687 --rc genhtml_branch_coverage=1 00:23:55.687 --rc genhtml_function_coverage=1 00:23:55.687 --rc genhtml_legend=1 00:23:55.687 --rc geninfo_all_blocks=1 00:23:55.687 --rc geninfo_unexecuted_blocks=1 00:23:55.687 00:23:55.687 ' 00:23:55.687 04:35:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:55.687 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:55.687 --rc genhtml_branch_coverage=1 00:23:55.687 --rc genhtml_function_coverage=1 00:23:55.687 --rc genhtml_legend=1 00:23:55.687 --rc geninfo_all_blocks=1 00:23:55.687 --rc geninfo_unexecuted_blocks=1 00:23:55.687 00:23:55.687 ' 00:23:55.687 04:35:34 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:55.687 04:35:34 -- nvmf/common.sh@7 -- # uname -s 00:23:55.687 04:35:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:55.687 04:35:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:55.687 04:35:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:55.687 04:35:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:55.687 04:35:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:55.687 04:35:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:55.687 04:35:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:55.687 04:35:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:55.687 04:35:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:55.687 04:35:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:55.687 04:35:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:55.687 04:35:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:55.687 04:35:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:55.687 04:35:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:55.687 04:35:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:55.687 04:35:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:55.687 04:35:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:55.687 04:35:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:55.687 04:35:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:55.687 04:35:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:55.687 04:35:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:55.687 04:35:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:55.687 04:35:34 -- paths/export.sh@5 -- # export PATH 00:23:55.687 04:35:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:55.687 04:35:34 -- nvmf/common.sh@46 -- # : 0 00:23:55.687 04:35:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:55.687 04:35:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:55.687 04:35:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:55.687 04:35:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:55.687 04:35:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:55.687 04:35:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:55.687 04:35:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:55.687 04:35:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:55.687 04:35:34 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:23:55.687 04:35:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:55.687 04:35:34 -- common/autotest_common.sh@10 -- # set +x 00:23:57.595 04:35:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:57.595 04:35:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:57.595 04:35:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:57.595 04:35:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:57.595 04:35:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:57.595 04:35:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:57.595 04:35:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:57.595 04:35:36 -- nvmf/common.sh@294 -- # net_devs=() 00:23:57.595 04:35:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:57.595 04:35:36 -- nvmf/common.sh@295 -- # e810=() 00:23:57.595 04:35:36 -- nvmf/common.sh@295 -- # local -ga e810 00:23:57.595 04:35:36 -- nvmf/common.sh@296 -- # x722=() 00:23:57.595 04:35:36 -- nvmf/common.sh@296 -- # local -ga x722 00:23:57.595 04:35:36 -- nvmf/common.sh@297 -- # mlx=() 00:23:57.595 04:35:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:57.595 04:35:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:57.595 04:35:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:57.595 04:35:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:57.595 04:35:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:57.595 04:35:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:57.595 04:35:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:57.595 04:35:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:57.595 04:35:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:57.595 04:35:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:57.595 04:35:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:57.595 04:35:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:57.595 04:35:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:57.595 04:35:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:57.595 04:35:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:57.595 04:35:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:57.595 04:35:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:57.595 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:57.595 04:35:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:57.595 04:35:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:57.595 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:57.595 04:35:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:57.595 04:35:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:57.595 04:35:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:57.595 04:35:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:57.595 04:35:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:57.595 04:35:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:57.595 04:35:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:57.595 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:57.595 04:35:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:57.595 04:35:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:57.595 04:35:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:57.595 04:35:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:57.595 04:35:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:57.595 04:35:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:57.595 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:57.595 04:35:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:57.595 04:35:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:57.595 04:35:36 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:57.595 04:35:36 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:23:57.595 04:35:36 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:23:57.595 04:35:36 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:23:57.595 04:35:36 -- target/perf_adq.sh@52 -- # rmmod ice 00:23:58.164 04:35:37 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:00.704 04:35:39 -- target/perf_adq.sh@54 -- # sleep 5 00:24:05.989 04:35:44 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:05.989 04:35:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:05.989 04:35:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:05.989 04:35:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:05.989 04:35:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:05.989 04:35:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:05.989 04:35:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:05.989 04:35:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:05.989 04:35:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:05.989 04:35:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:05.989 04:35:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:05.989 04:35:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:05.989 04:35:44 -- common/autotest_common.sh@10 -- # set +x 00:24:05.989 04:35:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:05.989 04:35:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:05.989 04:35:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:05.989 04:35:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:05.989 04:35:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:05.989 04:35:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:05.989 04:35:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:05.989 04:35:44 -- nvmf/common.sh@294 -- # net_devs=() 00:24:05.989 04:35:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:05.989 04:35:44 -- nvmf/common.sh@295 -- # e810=() 00:24:05.989 04:35:44 -- nvmf/common.sh@295 -- # local -ga e810 00:24:05.989 04:35:44 -- nvmf/common.sh@296 -- # x722=() 00:24:05.989 04:35:44 -- nvmf/common.sh@296 -- # local -ga x722 00:24:05.989 04:35:44 -- nvmf/common.sh@297 -- # mlx=() 00:24:05.989 04:35:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:05.989 04:35:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:05.989 04:35:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:05.989 04:35:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:05.989 04:35:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:05.989 04:35:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:05.990 04:35:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:05.990 04:35:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:05.990 04:35:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:05.990 04:35:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:05.990 04:35:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:05.990 04:35:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:05.990 04:35:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:05.990 04:35:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:05.990 04:35:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:05.990 04:35:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:05.990 04:35:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:05.990 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:05.990 04:35:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:05.990 04:35:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:05.990 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:05.990 04:35:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:05.990 04:35:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:05.990 04:35:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:05.990 04:35:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:05.990 04:35:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:05.990 04:35:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:05.990 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:05.990 04:35:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:05.990 04:35:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:05.990 04:35:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:05.990 04:35:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:05.990 04:35:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:05.990 04:35:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:05.990 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:05.990 04:35:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:05.990 04:35:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:05.990 04:35:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:05.990 04:35:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:05.990 04:35:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:05.990 04:35:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:05.990 04:35:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:05.990 04:35:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:05.990 04:35:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:05.990 04:35:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:05.990 04:35:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:05.990 04:35:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:05.990 04:35:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:05.990 04:35:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:05.990 04:35:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:05.990 04:35:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:05.990 04:35:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:05.990 04:35:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:05.990 04:35:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:05.990 04:35:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:05.990 04:35:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:05.990 04:35:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:05.990 04:35:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:05.990 04:35:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:05.990 04:35:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:05.990 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:05.990 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.359 ms 00:24:05.990 00:24:05.990 --- 10.0.0.2 ping statistics --- 00:24:05.990 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:05.990 rtt min/avg/max/mdev = 0.359/0.359/0.359/0.000 ms 00:24:05.990 04:35:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:05.990 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:05.990 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:24:05.990 00:24:05.990 --- 10.0.0.1 ping statistics --- 00:24:05.990 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:05.990 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:24:05.990 04:35:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:05.990 04:35:45 -- nvmf/common.sh@410 -- # return 0 00:24:05.990 04:35:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:05.990 04:35:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:05.990 04:35:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:05.990 04:35:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:05.990 04:35:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:05.990 04:35:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:05.990 04:35:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:05.990 04:35:45 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:05.990 04:35:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:05.990 04:35:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:05.990 04:35:45 -- common/autotest_common.sh@10 -- # set +x 00:24:05.990 04:35:45 -- nvmf/common.sh@469 -- # nvmfpid=2980611 00:24:05.990 04:35:45 -- nvmf/common.sh@470 -- # waitforlisten 2980611 00:24:05.990 04:35:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:05.990 04:35:45 -- common/autotest_common.sh@829 -- # '[' -z 2980611 ']' 00:24:05.990 04:35:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:05.990 04:35:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:05.990 04:35:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:05.990 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:05.990 04:35:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:05.990 04:35:45 -- common/autotest_common.sh@10 -- # set +x 00:24:06.250 [2024-11-26 04:35:45.218049] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:06.250 [2024-11-26 04:35:45.218158] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:06.250 EAL: No free 2048 kB hugepages reported on node 1 00:24:06.250 [2024-11-26 04:35:45.293275] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:06.250 [2024-11-26 04:35:45.390105] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:06.250 [2024-11-26 04:35:45.390277] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:06.250 [2024-11-26 04:35:45.390295] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:06.250 [2024-11-26 04:35:45.390309] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:06.250 [2024-11-26 04:35:45.390376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:06.250 [2024-11-26 04:35:45.390434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:06.250 [2024-11-26 04:35:45.390488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:06.250 [2024-11-26 04:35:45.390491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:06.508 04:35:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:06.508 04:35:45 -- common/autotest_common.sh@862 -- # return 0 00:24:06.508 04:35:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:06.508 04:35:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:06.508 04:35:45 -- common/autotest_common.sh@10 -- # set +x 00:24:06.508 04:35:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:06.508 04:35:45 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:06.508 04:35:45 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:06.508 04:35:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:06.508 04:35:45 -- common/autotest_common.sh@10 -- # set +x 00:24:06.508 04:35:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:06.508 04:35:45 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:06.508 04:35:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:06.508 04:35:45 -- common/autotest_common.sh@10 -- # set +x 00:24:06.508 04:35:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:06.508 04:35:45 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:06.508 04:35:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:06.508 04:35:45 -- common/autotest_common.sh@10 -- # set +x 00:24:06.508 [2024-11-26 04:35:45.629431] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:06.508 04:35:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:06.508 04:35:45 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:06.508 04:35:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:06.508 04:35:45 -- common/autotest_common.sh@10 -- # set +x 00:24:06.508 Malloc1 00:24:06.508 04:35:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:06.508 04:35:45 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:06.508 04:35:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:06.508 04:35:45 -- common/autotest_common.sh@10 -- # set +x 00:24:06.508 04:35:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:06.508 04:35:45 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:06.508 04:35:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:06.508 04:35:45 -- common/autotest_common.sh@10 -- # set +x 00:24:06.508 04:35:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:06.508 04:35:45 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:06.508 04:35:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:06.508 04:35:45 -- common/autotest_common.sh@10 -- # set +x 00:24:06.508 [2024-11-26 04:35:45.681462] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:06.508 04:35:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:06.508 04:35:45 -- target/perf_adq.sh@73 -- # perfpid=2980694 00:24:06.508 04:35:45 -- target/perf_adq.sh@74 -- # sleep 2 00:24:06.508 04:35:45 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:06.508 EAL: No free 2048 kB hugepages reported on node 1 00:24:09.044 04:35:47 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:09.044 04:35:47 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:09.044 04:35:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:09.044 04:35:47 -- target/perf_adq.sh@76 -- # wc -l 00:24:09.044 04:35:47 -- common/autotest_common.sh@10 -- # set +x 00:24:09.044 04:35:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:09.044 04:35:47 -- target/perf_adq.sh@76 -- # count=4 00:24:09.044 04:35:47 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:09.044 04:35:47 -- target/perf_adq.sh@81 -- # wait 2980694 00:24:17.162 Initializing NVMe Controllers 00:24:17.162 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:17.162 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:17.162 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:17.162 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:17.162 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:17.162 Initialization complete. Launching workers. 00:24:17.162 ======================================================== 00:24:17.162 Latency(us) 00:24:17.162 Device Information : IOPS MiB/s Average min max 00:24:17.162 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11267.19 44.01 5681.95 1406.33 10094.66 00:24:17.162 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10881.11 42.50 5881.74 1270.42 10142.82 00:24:17.162 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 10999.10 42.97 5820.60 1562.87 9198.35 00:24:17.162 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10787.21 42.14 5934.00 1600.57 9937.85 00:24:17.162 ======================================================== 00:24:17.162 Total : 43934.61 171.62 5828.03 1270.42 10142.82 00:24:17.162 00:24:17.162 04:35:55 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:17.162 04:35:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:17.162 04:35:55 -- nvmf/common.sh@116 -- # sync 00:24:17.162 04:35:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:17.162 04:35:55 -- nvmf/common.sh@119 -- # set +e 00:24:17.162 04:35:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:17.162 04:35:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:17.162 rmmod nvme_tcp 00:24:17.162 rmmod nvme_fabrics 00:24:17.162 rmmod nvme_keyring 00:24:17.162 04:35:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:17.162 04:35:55 -- nvmf/common.sh@123 -- # set -e 00:24:17.162 04:35:55 -- nvmf/common.sh@124 -- # return 0 00:24:17.162 04:35:55 -- nvmf/common.sh@477 -- # '[' -n 2980611 ']' 00:24:17.162 04:35:55 -- nvmf/common.sh@478 -- # killprocess 2980611 00:24:17.162 04:35:55 -- common/autotest_common.sh@936 -- # '[' -z 2980611 ']' 00:24:17.162 04:35:55 -- common/autotest_common.sh@940 -- # kill -0 2980611 00:24:17.162 04:35:55 -- common/autotest_common.sh@941 -- # uname 00:24:17.162 04:35:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:17.162 04:35:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2980611 00:24:17.162 04:35:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:17.162 04:35:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:17.162 04:35:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2980611' 00:24:17.162 killing process with pid 2980611 00:24:17.162 04:35:55 -- common/autotest_common.sh@955 -- # kill 2980611 00:24:17.162 04:35:55 -- common/autotest_common.sh@960 -- # wait 2980611 00:24:17.162 04:35:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:17.162 04:35:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:17.162 04:35:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:17.162 04:35:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:17.162 04:35:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:17.162 04:35:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:17.162 04:35:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:17.162 04:35:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:19.064 04:35:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:19.064 04:35:58 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:19.064 04:35:58 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:19.632 04:35:58 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:22.185 04:36:01 -- target/perf_adq.sh@54 -- # sleep 5 00:24:27.550 04:36:06 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:27.550 04:36:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:27.550 04:36:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:27.550 04:36:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:27.550 04:36:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:27.550 04:36:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:27.550 04:36:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:27.550 04:36:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:27.550 04:36:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:27.550 04:36:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:27.550 04:36:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:27.550 04:36:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:27.550 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:24:27.550 04:36:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:27.550 04:36:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:27.550 04:36:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:27.550 04:36:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:27.550 04:36:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:27.550 04:36:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:27.550 04:36:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:27.550 04:36:06 -- nvmf/common.sh@294 -- # net_devs=() 00:24:27.550 04:36:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:27.550 04:36:06 -- nvmf/common.sh@295 -- # e810=() 00:24:27.550 04:36:06 -- nvmf/common.sh@295 -- # local -ga e810 00:24:27.550 04:36:06 -- nvmf/common.sh@296 -- # x722=() 00:24:27.550 04:36:06 -- nvmf/common.sh@296 -- # local -ga x722 00:24:27.550 04:36:06 -- nvmf/common.sh@297 -- # mlx=() 00:24:27.551 04:36:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:27.551 04:36:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:27.551 04:36:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:27.551 04:36:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:27.551 04:36:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:27.551 04:36:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:27.551 04:36:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:27.551 04:36:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:27.551 04:36:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:27.551 04:36:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:27.551 04:36:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:27.551 04:36:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:27.551 04:36:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:27.551 04:36:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:27.551 04:36:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:27.551 04:36:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:27.551 04:36:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:27.551 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:27.551 04:36:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:27.551 04:36:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:27.551 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:27.551 04:36:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:27.551 04:36:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:27.551 04:36:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:27.551 04:36:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:27.551 04:36:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:27.551 04:36:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:27.551 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:27.551 04:36:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:27.551 04:36:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:27.551 04:36:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:27.551 04:36:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:27.551 04:36:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:27.551 04:36:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:27.551 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:27.551 04:36:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:27.551 04:36:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:27.551 04:36:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:27.551 04:36:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:27.551 04:36:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:27.551 04:36:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:27.551 04:36:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:27.551 04:36:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:27.551 04:36:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:27.551 04:36:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:27.551 04:36:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:27.551 04:36:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:27.551 04:36:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:27.551 04:36:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:27.551 04:36:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:27.551 04:36:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:27.551 04:36:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:27.551 04:36:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:27.551 04:36:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:27.551 04:36:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:27.551 04:36:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:27.551 04:36:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:27.551 04:36:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:27.551 04:36:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:27.551 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:27.551 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:24:27.551 00:24:27.551 --- 10.0.0.2 ping statistics --- 00:24:27.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:27.551 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:24:27.551 04:36:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:27.551 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:27.551 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:24:27.551 00:24:27.551 --- 10.0.0.1 ping statistics --- 00:24:27.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:27.551 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:24:27.551 04:36:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:27.551 04:36:06 -- nvmf/common.sh@410 -- # return 0 00:24:27.551 04:36:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:27.551 04:36:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:27.551 04:36:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:27.551 04:36:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:27.551 04:36:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:27.551 04:36:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:27.551 04:36:06 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:27.551 04:36:06 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:27.551 04:36:06 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:27.551 04:36:06 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:27.551 net.core.busy_poll = 1 00:24:27.551 04:36:06 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:27.551 net.core.busy_read = 1 00:24:27.551 04:36:06 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:27.551 04:36:06 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:27.551 04:36:06 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:27.551 04:36:06 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:27.551 04:36:06 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:27.551 04:36:06 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:27.551 04:36:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:27.551 04:36:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:27.551 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:24:27.551 04:36:06 -- nvmf/common.sh@469 -- # nvmfpid=2983569 00:24:27.551 04:36:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:27.551 04:36:06 -- nvmf/common.sh@470 -- # waitforlisten 2983569 00:24:27.551 04:36:06 -- common/autotest_common.sh@829 -- # '[' -z 2983569 ']' 00:24:27.551 04:36:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:27.551 04:36:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:27.551 04:36:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:27.551 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:27.551 04:36:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:27.551 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:24:27.551 [2024-11-26 04:36:06.608835] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:27.551 [2024-11-26 04:36:06.608935] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:27.551 EAL: No free 2048 kB hugepages reported on node 1 00:24:27.551 [2024-11-26 04:36:06.672213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:27.551 [2024-11-26 04:36:06.755962] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:27.551 [2024-11-26 04:36:06.756127] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:27.551 [2024-11-26 04:36:06.756146] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:27.551 [2024-11-26 04:36:06.756158] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:27.551 [2024-11-26 04:36:06.756208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:27.551 [2024-11-26 04:36:06.756268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:27.551 [2024-11-26 04:36:06.756333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:27.551 [2024-11-26 04:36:06.756336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:27.810 04:36:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:27.810 04:36:06 -- common/autotest_common.sh@862 -- # return 0 00:24:27.810 04:36:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:27.810 04:36:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:27.810 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:24:27.810 04:36:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:27.810 04:36:06 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:27.810 04:36:06 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:27.810 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:27.810 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:24:27.810 04:36:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:27.810 04:36:06 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:27.810 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:27.810 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:24:27.810 04:36:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:27.810 04:36:06 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:27.810 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:27.810 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:24:27.810 [2024-11-26 04:36:06.963227] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:27.810 04:36:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:27.810 04:36:06 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:27.810 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:27.810 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:24:27.810 Malloc1 00:24:27.810 04:36:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:27.810 04:36:06 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:27.810 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:27.810 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:24:27.810 04:36:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:27.810 04:36:07 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:27.810 04:36:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:27.810 04:36:07 -- common/autotest_common.sh@10 -- # set +x 00:24:27.810 04:36:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:27.810 04:36:07 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:27.810 04:36:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:27.810 04:36:07 -- common/autotest_common.sh@10 -- # set +x 00:24:27.810 [2024-11-26 04:36:07.014059] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:27.810 04:36:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:27.810 04:36:07 -- target/perf_adq.sh@94 -- # perfpid=2983599 00:24:27.810 04:36:07 -- target/perf_adq.sh@95 -- # sleep 2 00:24:27.810 04:36:07 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:28.068 EAL: No free 2048 kB hugepages reported on node 1 00:24:29.971 04:36:09 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:24:29.971 04:36:09 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:24:29.971 04:36:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:29.971 04:36:09 -- target/perf_adq.sh@97 -- # wc -l 00:24:29.971 04:36:09 -- common/autotest_common.sh@10 -- # set +x 00:24:29.971 04:36:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:29.971 04:36:09 -- target/perf_adq.sh@97 -- # count=2 00:24:29.971 04:36:09 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:24:29.971 04:36:09 -- target/perf_adq.sh@103 -- # wait 2983599 00:24:38.093 Initializing NVMe Controllers 00:24:38.093 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:38.093 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:38.093 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:38.093 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:38.093 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:38.093 Initialization complete. Launching workers. 00:24:38.093 ======================================================== 00:24:38.093 Latency(us) 00:24:38.093 Device Information : IOPS MiB/s Average min max 00:24:38.093 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7373.10 28.80 8681.46 991.34 54120.94 00:24:38.093 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4897.50 19.13 13091.95 2304.26 54148.92 00:24:38.093 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7720.40 30.16 8291.19 826.97 53837.84 00:24:38.093 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 9178.30 35.85 6973.95 1410.97 52404.99 00:24:38.093 ======================================================== 00:24:38.093 Total : 29169.29 113.94 8781.40 826.97 54148.92 00:24:38.093 00:24:38.093 04:36:17 -- target/perf_adq.sh@104 -- # nvmftestfini 00:24:38.093 04:36:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:38.093 04:36:17 -- nvmf/common.sh@116 -- # sync 00:24:38.093 04:36:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:38.093 04:36:17 -- nvmf/common.sh@119 -- # set +e 00:24:38.093 04:36:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:38.093 04:36:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:38.093 rmmod nvme_tcp 00:24:38.093 rmmod nvme_fabrics 00:24:38.353 rmmod nvme_keyring 00:24:38.353 04:36:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:38.353 04:36:17 -- nvmf/common.sh@123 -- # set -e 00:24:38.353 04:36:17 -- nvmf/common.sh@124 -- # return 0 00:24:38.353 04:36:17 -- nvmf/common.sh@477 -- # '[' -n 2983569 ']' 00:24:38.353 04:36:17 -- nvmf/common.sh@478 -- # killprocess 2983569 00:24:38.353 04:36:17 -- common/autotest_common.sh@936 -- # '[' -z 2983569 ']' 00:24:38.353 04:36:17 -- common/autotest_common.sh@940 -- # kill -0 2983569 00:24:38.353 04:36:17 -- common/autotest_common.sh@941 -- # uname 00:24:38.353 04:36:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:38.353 04:36:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2983569 00:24:38.353 04:36:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:38.353 04:36:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:38.353 04:36:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2983569' 00:24:38.353 killing process with pid 2983569 00:24:38.353 04:36:17 -- common/autotest_common.sh@955 -- # kill 2983569 00:24:38.353 04:36:17 -- common/autotest_common.sh@960 -- # wait 2983569 00:24:38.614 04:36:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:38.614 04:36:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:38.614 04:36:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:38.614 04:36:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:38.614 04:36:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:38.614 04:36:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:38.614 04:36:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:38.614 04:36:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:41.906 04:36:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:41.906 04:36:20 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:24:41.906 00:24:41.906 real 0m46.280s 00:24:41.906 user 2m36.570s 00:24:41.906 sys 0m11.183s 00:24:41.906 04:36:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:41.906 04:36:20 -- common/autotest_common.sh@10 -- # set +x 00:24:41.906 ************************************ 00:24:41.906 END TEST nvmf_perf_adq 00:24:41.906 ************************************ 00:24:41.906 04:36:20 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:41.906 04:36:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:41.906 04:36:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:41.906 04:36:20 -- common/autotest_common.sh@10 -- # set +x 00:24:41.906 ************************************ 00:24:41.906 START TEST nvmf_shutdown 00:24:41.906 ************************************ 00:24:41.906 04:36:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:41.906 * Looking for test storage... 00:24:41.906 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:41.906 04:36:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:41.906 04:36:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:41.906 04:36:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:41.906 04:36:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:41.906 04:36:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:41.906 04:36:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:41.906 04:36:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:41.906 04:36:20 -- scripts/common.sh@335 -- # IFS=.-: 00:24:41.906 04:36:20 -- scripts/common.sh@335 -- # read -ra ver1 00:24:41.906 04:36:20 -- scripts/common.sh@336 -- # IFS=.-: 00:24:41.906 04:36:20 -- scripts/common.sh@336 -- # read -ra ver2 00:24:41.906 04:36:20 -- scripts/common.sh@337 -- # local 'op=<' 00:24:41.906 04:36:20 -- scripts/common.sh@339 -- # ver1_l=2 00:24:41.906 04:36:20 -- scripts/common.sh@340 -- # ver2_l=1 00:24:41.906 04:36:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:41.906 04:36:20 -- scripts/common.sh@343 -- # case "$op" in 00:24:41.906 04:36:20 -- scripts/common.sh@344 -- # : 1 00:24:41.906 04:36:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:41.907 04:36:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:41.907 04:36:20 -- scripts/common.sh@364 -- # decimal 1 00:24:41.907 04:36:20 -- scripts/common.sh@352 -- # local d=1 00:24:41.907 04:36:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:41.907 04:36:20 -- scripts/common.sh@354 -- # echo 1 00:24:41.907 04:36:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:41.907 04:36:20 -- scripts/common.sh@365 -- # decimal 2 00:24:41.907 04:36:20 -- scripts/common.sh@352 -- # local d=2 00:24:41.907 04:36:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:41.907 04:36:20 -- scripts/common.sh@354 -- # echo 2 00:24:41.907 04:36:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:41.907 04:36:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:41.907 04:36:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:41.907 04:36:20 -- scripts/common.sh@367 -- # return 0 00:24:41.907 04:36:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:41.907 04:36:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:41.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:41.907 --rc genhtml_branch_coverage=1 00:24:41.907 --rc genhtml_function_coverage=1 00:24:41.907 --rc genhtml_legend=1 00:24:41.907 --rc geninfo_all_blocks=1 00:24:41.907 --rc geninfo_unexecuted_blocks=1 00:24:41.907 00:24:41.907 ' 00:24:41.907 04:36:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:41.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:41.907 --rc genhtml_branch_coverage=1 00:24:41.907 --rc genhtml_function_coverage=1 00:24:41.907 --rc genhtml_legend=1 00:24:41.907 --rc geninfo_all_blocks=1 00:24:41.907 --rc geninfo_unexecuted_blocks=1 00:24:41.907 00:24:41.907 ' 00:24:41.907 04:36:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:41.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:41.907 --rc genhtml_branch_coverage=1 00:24:41.907 --rc genhtml_function_coverage=1 00:24:41.907 --rc genhtml_legend=1 00:24:41.907 --rc geninfo_all_blocks=1 00:24:41.907 --rc geninfo_unexecuted_blocks=1 00:24:41.907 00:24:41.907 ' 00:24:41.907 04:36:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:41.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:41.907 --rc genhtml_branch_coverage=1 00:24:41.907 --rc genhtml_function_coverage=1 00:24:41.907 --rc genhtml_legend=1 00:24:41.907 --rc geninfo_all_blocks=1 00:24:41.907 --rc geninfo_unexecuted_blocks=1 00:24:41.907 00:24:41.907 ' 00:24:41.907 04:36:20 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:41.907 04:36:20 -- nvmf/common.sh@7 -- # uname -s 00:24:41.907 04:36:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:41.907 04:36:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:41.907 04:36:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:41.907 04:36:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:41.907 04:36:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:41.907 04:36:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:41.907 04:36:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:41.907 04:36:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:41.907 04:36:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:41.907 04:36:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:41.907 04:36:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:41.907 04:36:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:41.907 04:36:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:41.907 04:36:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:41.907 04:36:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:41.907 04:36:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:41.907 04:36:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:41.907 04:36:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:41.907 04:36:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:41.907 04:36:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:41.907 04:36:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:41.907 04:36:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:41.907 04:36:20 -- paths/export.sh@5 -- # export PATH 00:24:41.907 04:36:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:41.907 04:36:20 -- nvmf/common.sh@46 -- # : 0 00:24:41.907 04:36:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:41.907 04:36:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:41.907 04:36:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:41.907 04:36:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:41.907 04:36:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:41.907 04:36:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:41.907 04:36:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:41.907 04:36:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:41.907 04:36:20 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:41.907 04:36:20 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:41.907 04:36:20 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:24:41.907 04:36:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:41.907 04:36:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:41.907 04:36:20 -- common/autotest_common.sh@10 -- # set +x 00:24:41.907 ************************************ 00:24:41.907 START TEST nvmf_shutdown_tc1 00:24:41.907 ************************************ 00:24:41.907 04:36:20 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:24:41.907 04:36:20 -- target/shutdown.sh@74 -- # starttarget 00:24:41.907 04:36:20 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:41.907 04:36:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:41.907 04:36:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:41.907 04:36:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:41.907 04:36:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:41.907 04:36:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:41.907 04:36:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:41.907 04:36:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:41.907 04:36:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:41.907 04:36:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:41.907 04:36:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:41.907 04:36:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:41.907 04:36:20 -- common/autotest_common.sh@10 -- # set +x 00:24:43.807 04:36:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:43.807 04:36:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:43.807 04:36:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:43.807 04:36:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:43.807 04:36:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:43.807 04:36:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:43.807 04:36:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:43.807 04:36:22 -- nvmf/common.sh@294 -- # net_devs=() 00:24:43.807 04:36:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:43.807 04:36:22 -- nvmf/common.sh@295 -- # e810=() 00:24:43.807 04:36:22 -- nvmf/common.sh@295 -- # local -ga e810 00:24:43.807 04:36:22 -- nvmf/common.sh@296 -- # x722=() 00:24:43.807 04:36:22 -- nvmf/common.sh@296 -- # local -ga x722 00:24:43.807 04:36:22 -- nvmf/common.sh@297 -- # mlx=() 00:24:43.807 04:36:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:43.807 04:36:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:43.807 04:36:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:43.807 04:36:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:43.807 04:36:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:43.807 04:36:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:43.807 04:36:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:43.807 04:36:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:43.807 04:36:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:43.807 04:36:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:43.807 04:36:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:43.807 04:36:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:43.807 04:36:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:43.807 04:36:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:43.807 04:36:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:43.807 04:36:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:43.807 04:36:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:43.807 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:43.807 04:36:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:43.807 04:36:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:43.807 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:43.807 04:36:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:43.807 04:36:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:43.807 04:36:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:43.807 04:36:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:43.807 04:36:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:43.807 04:36:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:43.807 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:43.807 04:36:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:43.807 04:36:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:43.807 04:36:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:43.807 04:36:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:43.807 04:36:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:43.807 04:36:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:43.807 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:43.807 04:36:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:43.807 04:36:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:43.807 04:36:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:43.807 04:36:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:43.807 04:36:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:43.807 04:36:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:43.807 04:36:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:43.807 04:36:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:43.807 04:36:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:43.807 04:36:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:43.807 04:36:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:43.807 04:36:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:43.807 04:36:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:43.807 04:36:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:43.807 04:36:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:43.807 04:36:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:43.807 04:36:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:43.807 04:36:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:43.807 04:36:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:43.807 04:36:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:43.807 04:36:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:43.807 04:36:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:43.807 04:36:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:43.807 04:36:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:43.807 04:36:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:43.808 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:43.808 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:24:43.808 00:24:43.808 --- 10.0.0.2 ping statistics --- 00:24:43.808 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:43.808 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:24:43.808 04:36:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:43.808 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:43.808 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:24:43.808 00:24:43.808 --- 10.0.0.1 ping statistics --- 00:24:43.808 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:43.808 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:24:43.808 04:36:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:43.808 04:36:22 -- nvmf/common.sh@410 -- # return 0 00:24:43.808 04:36:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:43.808 04:36:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:43.808 04:36:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:43.808 04:36:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:43.808 04:36:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:43.808 04:36:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:43.808 04:36:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:43.808 04:36:22 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:43.808 04:36:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:43.808 04:36:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:43.808 04:36:22 -- common/autotest_common.sh@10 -- # set +x 00:24:43.808 04:36:22 -- nvmf/common.sh@469 -- # nvmfpid=2987446 00:24:43.808 04:36:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:43.808 04:36:22 -- nvmf/common.sh@470 -- # waitforlisten 2987446 00:24:43.808 04:36:22 -- common/autotest_common.sh@829 -- # '[' -z 2987446 ']' 00:24:43.808 04:36:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:43.808 04:36:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:43.808 04:36:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:43.808 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:43.808 04:36:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:43.808 04:36:22 -- common/autotest_common.sh@10 -- # set +x 00:24:43.808 [2024-11-26 04:36:22.965507] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:43.808 [2024-11-26 04:36:22.965577] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:43.808 EAL: No free 2048 kB hugepages reported on node 1 00:24:44.067 [2024-11-26 04:36:23.032831] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:44.067 [2024-11-26 04:36:23.127423] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:44.067 [2024-11-26 04:36:23.127563] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:44.067 [2024-11-26 04:36:23.127579] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:44.067 [2024-11-26 04:36:23.127591] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:44.067 [2024-11-26 04:36:23.127645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:44.067 [2024-11-26 04:36:23.127774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:44.067 [2024-11-26 04:36:23.127800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:44.067 [2024-11-26 04:36:23.127803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:45.001 04:36:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:45.001 04:36:23 -- common/autotest_common.sh@862 -- # return 0 00:24:45.001 04:36:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:45.001 04:36:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:45.001 04:36:23 -- common/autotest_common.sh@10 -- # set +x 00:24:45.001 04:36:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:45.001 04:36:23 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:45.001 04:36:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:45.001 04:36:23 -- common/autotest_common.sh@10 -- # set +x 00:24:45.001 [2024-11-26 04:36:24.003467] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:45.001 04:36:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:45.001 04:36:24 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:45.001 04:36:24 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:45.001 04:36:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:45.001 04:36:24 -- common/autotest_common.sh@10 -- # set +x 00:24:45.001 04:36:24 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:45.001 04:36:24 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:45.001 04:36:24 -- target/shutdown.sh@28 -- # cat 00:24:45.001 04:36:24 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:45.001 04:36:24 -- target/shutdown.sh@28 -- # cat 00:24:45.001 04:36:24 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:45.001 04:36:24 -- target/shutdown.sh@28 -- # cat 00:24:45.001 04:36:24 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:45.001 04:36:24 -- target/shutdown.sh@28 -- # cat 00:24:45.001 04:36:24 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:45.001 04:36:24 -- target/shutdown.sh@28 -- # cat 00:24:45.001 04:36:24 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:45.001 04:36:24 -- target/shutdown.sh@28 -- # cat 00:24:45.001 04:36:24 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:45.001 04:36:24 -- target/shutdown.sh@28 -- # cat 00:24:45.001 04:36:24 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:45.001 04:36:24 -- target/shutdown.sh@28 -- # cat 00:24:45.001 04:36:24 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:45.001 04:36:24 -- target/shutdown.sh@28 -- # cat 00:24:45.001 04:36:24 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:45.001 04:36:24 -- target/shutdown.sh@28 -- # cat 00:24:45.001 04:36:24 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:45.001 04:36:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:45.001 04:36:24 -- common/autotest_common.sh@10 -- # set +x 00:24:45.001 Malloc1 00:24:45.001 [2024-11-26 04:36:24.078356] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:45.001 Malloc2 00:24:45.001 Malloc3 00:24:45.001 Malloc4 00:24:45.259 Malloc5 00:24:45.259 Malloc6 00:24:45.259 Malloc7 00:24:45.259 Malloc8 00:24:45.259 Malloc9 00:24:45.518 Malloc10 00:24:45.518 04:36:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:45.518 04:36:24 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:45.518 04:36:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:45.518 04:36:24 -- common/autotest_common.sh@10 -- # set +x 00:24:45.518 04:36:24 -- target/shutdown.sh@78 -- # perfpid=2987762 00:24:45.518 04:36:24 -- target/shutdown.sh@79 -- # waitforlisten 2987762 /var/tmp/bdevperf.sock 00:24:45.518 04:36:24 -- common/autotest_common.sh@829 -- # '[' -z 2987762 ']' 00:24:45.518 04:36:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:45.518 04:36:24 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:24:45.518 04:36:24 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:45.518 04:36:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:45.518 04:36:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:45.518 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:45.518 04:36:24 -- nvmf/common.sh@520 -- # config=() 00:24:45.518 04:36:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:45.518 04:36:24 -- nvmf/common.sh@520 -- # local subsystem config 00:24:45.518 04:36:24 -- common/autotest_common.sh@10 -- # set +x 00:24:45.518 04:36:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:45.518 { 00:24:45.518 "params": { 00:24:45.518 "name": "Nvme$subsystem", 00:24:45.518 "trtype": "$TEST_TRANSPORT", 00:24:45.518 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:45.518 "adrfam": "ipv4", 00:24:45.518 "trsvcid": "$NVMF_PORT", 00:24:45.518 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:45.518 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:45.518 "hdgst": ${hdgst:-false}, 00:24:45.518 "ddgst": ${ddgst:-false} 00:24:45.518 }, 00:24:45.518 "method": "bdev_nvme_attach_controller" 00:24:45.518 } 00:24:45.518 EOF 00:24:45.518 )") 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # cat 00:24:45.518 04:36:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:45.518 { 00:24:45.518 "params": { 00:24:45.518 "name": "Nvme$subsystem", 00:24:45.518 "trtype": "$TEST_TRANSPORT", 00:24:45.518 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:45.518 "adrfam": "ipv4", 00:24:45.518 "trsvcid": "$NVMF_PORT", 00:24:45.518 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:45.518 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:45.518 "hdgst": ${hdgst:-false}, 00:24:45.518 "ddgst": ${ddgst:-false} 00:24:45.518 }, 00:24:45.518 "method": "bdev_nvme_attach_controller" 00:24:45.518 } 00:24:45.518 EOF 00:24:45.518 )") 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # cat 00:24:45.518 04:36:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:45.518 { 00:24:45.518 "params": { 00:24:45.518 "name": "Nvme$subsystem", 00:24:45.518 "trtype": "$TEST_TRANSPORT", 00:24:45.518 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:45.518 "adrfam": "ipv4", 00:24:45.518 "trsvcid": "$NVMF_PORT", 00:24:45.518 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:45.518 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:45.518 "hdgst": ${hdgst:-false}, 00:24:45.518 "ddgst": ${ddgst:-false} 00:24:45.518 }, 00:24:45.518 "method": "bdev_nvme_attach_controller" 00:24:45.518 } 00:24:45.518 EOF 00:24:45.518 )") 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # cat 00:24:45.518 04:36:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:45.518 { 00:24:45.518 "params": { 00:24:45.518 "name": "Nvme$subsystem", 00:24:45.518 "trtype": "$TEST_TRANSPORT", 00:24:45.518 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:45.518 "adrfam": "ipv4", 00:24:45.518 "trsvcid": "$NVMF_PORT", 00:24:45.518 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:45.518 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:45.518 "hdgst": ${hdgst:-false}, 00:24:45.518 "ddgst": ${ddgst:-false} 00:24:45.518 }, 00:24:45.518 "method": "bdev_nvme_attach_controller" 00:24:45.518 } 00:24:45.518 EOF 00:24:45.518 )") 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # cat 00:24:45.518 04:36:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:45.518 { 00:24:45.518 "params": { 00:24:45.518 "name": "Nvme$subsystem", 00:24:45.518 "trtype": "$TEST_TRANSPORT", 00:24:45.518 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:45.518 "adrfam": "ipv4", 00:24:45.518 "trsvcid": "$NVMF_PORT", 00:24:45.518 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:45.518 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:45.518 "hdgst": ${hdgst:-false}, 00:24:45.518 "ddgst": ${ddgst:-false} 00:24:45.518 }, 00:24:45.518 "method": "bdev_nvme_attach_controller" 00:24:45.518 } 00:24:45.518 EOF 00:24:45.518 )") 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # cat 00:24:45.518 04:36:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:45.518 { 00:24:45.518 "params": { 00:24:45.518 "name": "Nvme$subsystem", 00:24:45.518 "trtype": "$TEST_TRANSPORT", 00:24:45.518 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:45.518 "adrfam": "ipv4", 00:24:45.518 "trsvcid": "$NVMF_PORT", 00:24:45.518 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:45.518 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:45.518 "hdgst": ${hdgst:-false}, 00:24:45.518 "ddgst": ${ddgst:-false} 00:24:45.518 }, 00:24:45.518 "method": "bdev_nvme_attach_controller" 00:24:45.518 } 00:24:45.518 EOF 00:24:45.518 )") 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # cat 00:24:45.518 04:36:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:45.518 { 00:24:45.518 "params": { 00:24:45.518 "name": "Nvme$subsystem", 00:24:45.518 "trtype": "$TEST_TRANSPORT", 00:24:45.518 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:45.518 "adrfam": "ipv4", 00:24:45.518 "trsvcid": "$NVMF_PORT", 00:24:45.518 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:45.518 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:45.518 "hdgst": ${hdgst:-false}, 00:24:45.518 "ddgst": ${ddgst:-false} 00:24:45.518 }, 00:24:45.518 "method": "bdev_nvme_attach_controller" 00:24:45.518 } 00:24:45.518 EOF 00:24:45.518 )") 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # cat 00:24:45.518 04:36:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:45.518 { 00:24:45.518 "params": { 00:24:45.518 "name": "Nvme$subsystem", 00:24:45.518 "trtype": "$TEST_TRANSPORT", 00:24:45.518 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:45.518 "adrfam": "ipv4", 00:24:45.518 "trsvcid": "$NVMF_PORT", 00:24:45.518 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:45.518 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:45.518 "hdgst": ${hdgst:-false}, 00:24:45.518 "ddgst": ${ddgst:-false} 00:24:45.518 }, 00:24:45.518 "method": "bdev_nvme_attach_controller" 00:24:45.518 } 00:24:45.518 EOF 00:24:45.518 )") 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # cat 00:24:45.518 04:36:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:45.518 04:36:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:45.518 { 00:24:45.518 "params": { 00:24:45.518 "name": "Nvme$subsystem", 00:24:45.518 "trtype": "$TEST_TRANSPORT", 00:24:45.518 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:45.518 "adrfam": "ipv4", 00:24:45.518 "trsvcid": "$NVMF_PORT", 00:24:45.518 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:45.518 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:45.518 "hdgst": ${hdgst:-false}, 00:24:45.518 "ddgst": ${ddgst:-false} 00:24:45.518 }, 00:24:45.518 "method": "bdev_nvme_attach_controller" 00:24:45.518 } 00:24:45.518 EOF 00:24:45.518 )") 00:24:45.519 04:36:24 -- nvmf/common.sh@542 -- # cat 00:24:45.519 04:36:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:45.519 04:36:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:45.519 { 00:24:45.519 "params": { 00:24:45.519 "name": "Nvme$subsystem", 00:24:45.519 "trtype": "$TEST_TRANSPORT", 00:24:45.519 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:45.519 "adrfam": "ipv4", 00:24:45.519 "trsvcid": "$NVMF_PORT", 00:24:45.519 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:45.519 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:45.519 "hdgst": ${hdgst:-false}, 00:24:45.519 "ddgst": ${ddgst:-false} 00:24:45.519 }, 00:24:45.519 "method": "bdev_nvme_attach_controller" 00:24:45.519 } 00:24:45.519 EOF 00:24:45.519 )") 00:24:45.519 04:36:24 -- nvmf/common.sh@542 -- # cat 00:24:45.519 04:36:24 -- nvmf/common.sh@544 -- # jq . 00:24:45.519 04:36:24 -- nvmf/common.sh@545 -- # IFS=, 00:24:45.519 04:36:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:45.519 "params": { 00:24:45.519 "name": "Nvme1", 00:24:45.519 "trtype": "tcp", 00:24:45.519 "traddr": "10.0.0.2", 00:24:45.519 "adrfam": "ipv4", 00:24:45.519 "trsvcid": "4420", 00:24:45.519 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:45.519 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:45.519 "hdgst": false, 00:24:45.519 "ddgst": false 00:24:45.519 }, 00:24:45.519 "method": "bdev_nvme_attach_controller" 00:24:45.519 },{ 00:24:45.519 "params": { 00:24:45.519 "name": "Nvme2", 00:24:45.519 "trtype": "tcp", 00:24:45.519 "traddr": "10.0.0.2", 00:24:45.519 "adrfam": "ipv4", 00:24:45.519 "trsvcid": "4420", 00:24:45.519 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:45.519 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:45.519 "hdgst": false, 00:24:45.519 "ddgst": false 00:24:45.519 }, 00:24:45.519 "method": "bdev_nvme_attach_controller" 00:24:45.519 },{ 00:24:45.519 "params": { 00:24:45.519 "name": "Nvme3", 00:24:45.519 "trtype": "tcp", 00:24:45.519 "traddr": "10.0.0.2", 00:24:45.519 "adrfam": "ipv4", 00:24:45.519 "trsvcid": "4420", 00:24:45.519 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:45.519 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:45.519 "hdgst": false, 00:24:45.519 "ddgst": false 00:24:45.519 }, 00:24:45.519 "method": "bdev_nvme_attach_controller" 00:24:45.519 },{ 00:24:45.519 "params": { 00:24:45.519 "name": "Nvme4", 00:24:45.519 "trtype": "tcp", 00:24:45.519 "traddr": "10.0.0.2", 00:24:45.519 "adrfam": "ipv4", 00:24:45.519 "trsvcid": "4420", 00:24:45.519 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:45.519 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:45.519 "hdgst": false, 00:24:45.519 "ddgst": false 00:24:45.519 }, 00:24:45.519 "method": "bdev_nvme_attach_controller" 00:24:45.519 },{ 00:24:45.519 "params": { 00:24:45.519 "name": "Nvme5", 00:24:45.519 "trtype": "tcp", 00:24:45.519 "traddr": "10.0.0.2", 00:24:45.519 "adrfam": "ipv4", 00:24:45.519 "trsvcid": "4420", 00:24:45.519 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:45.519 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:45.519 "hdgst": false, 00:24:45.519 "ddgst": false 00:24:45.519 }, 00:24:45.519 "method": "bdev_nvme_attach_controller" 00:24:45.519 },{ 00:24:45.519 "params": { 00:24:45.519 "name": "Nvme6", 00:24:45.519 "trtype": "tcp", 00:24:45.519 "traddr": "10.0.0.2", 00:24:45.519 "adrfam": "ipv4", 00:24:45.519 "trsvcid": "4420", 00:24:45.519 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:45.519 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:45.519 "hdgst": false, 00:24:45.519 "ddgst": false 00:24:45.519 }, 00:24:45.519 "method": "bdev_nvme_attach_controller" 00:24:45.519 },{ 00:24:45.519 "params": { 00:24:45.519 "name": "Nvme7", 00:24:45.519 "trtype": "tcp", 00:24:45.519 "traddr": "10.0.0.2", 00:24:45.519 "adrfam": "ipv4", 00:24:45.519 "trsvcid": "4420", 00:24:45.519 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:45.519 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:45.519 "hdgst": false, 00:24:45.519 "ddgst": false 00:24:45.519 }, 00:24:45.519 "method": "bdev_nvme_attach_controller" 00:24:45.519 },{ 00:24:45.519 "params": { 00:24:45.519 "name": "Nvme8", 00:24:45.519 "trtype": "tcp", 00:24:45.519 "traddr": "10.0.0.2", 00:24:45.519 "adrfam": "ipv4", 00:24:45.519 "trsvcid": "4420", 00:24:45.519 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:45.519 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:45.519 "hdgst": false, 00:24:45.519 "ddgst": false 00:24:45.519 }, 00:24:45.519 "method": "bdev_nvme_attach_controller" 00:24:45.519 },{ 00:24:45.519 "params": { 00:24:45.519 "name": "Nvme9", 00:24:45.519 "trtype": "tcp", 00:24:45.519 "traddr": "10.0.0.2", 00:24:45.519 "adrfam": "ipv4", 00:24:45.519 "trsvcid": "4420", 00:24:45.519 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:45.519 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:45.519 "hdgst": false, 00:24:45.519 "ddgst": false 00:24:45.519 }, 00:24:45.519 "method": "bdev_nvme_attach_controller" 00:24:45.519 },{ 00:24:45.519 "params": { 00:24:45.519 "name": "Nvme10", 00:24:45.519 "trtype": "tcp", 00:24:45.519 "traddr": "10.0.0.2", 00:24:45.519 "adrfam": "ipv4", 00:24:45.519 "trsvcid": "4420", 00:24:45.519 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:45.519 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:45.519 "hdgst": false, 00:24:45.519 "ddgst": false 00:24:45.519 }, 00:24:45.519 "method": "bdev_nvme_attach_controller" 00:24:45.519 }' 00:24:45.519 [2024-11-26 04:36:24.574579] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:45.519 [2024-11-26 04:36:24.574652] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:24:45.519 EAL: No free 2048 kB hugepages reported on node 1 00:24:45.519 [2024-11-26 04:36:24.638093] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:45.519 [2024-11-26 04:36:24.722702] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:47.420 04:36:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:47.420 04:36:26 -- common/autotest_common.sh@862 -- # return 0 00:24:47.420 04:36:26 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:47.420 04:36:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:47.420 04:36:26 -- common/autotest_common.sh@10 -- # set +x 00:24:47.420 04:36:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:47.420 04:36:26 -- target/shutdown.sh@83 -- # kill -9 2987762 00:24:47.420 04:36:26 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:24:47.420 04:36:26 -- target/shutdown.sh@87 -- # sleep 1 00:24:48.369 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 2987762 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:24:48.369 04:36:27 -- target/shutdown.sh@88 -- # kill -0 2987446 00:24:48.369 04:36:27 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:24:48.369 04:36:27 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:48.369 04:36:27 -- nvmf/common.sh@520 -- # config=() 00:24:48.369 04:36:27 -- nvmf/common.sh@520 -- # local subsystem config 00:24:48.369 04:36:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.369 04:36:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.369 { 00:24:48.369 "params": { 00:24:48.369 "name": "Nvme$subsystem", 00:24:48.369 "trtype": "$TEST_TRANSPORT", 00:24:48.369 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.369 "adrfam": "ipv4", 00:24:48.369 "trsvcid": "$NVMF_PORT", 00:24:48.369 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.369 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.369 "hdgst": ${hdgst:-false}, 00:24:48.369 "ddgst": ${ddgst:-false} 00:24:48.369 }, 00:24:48.369 "method": "bdev_nvme_attach_controller" 00:24:48.369 } 00:24:48.369 EOF 00:24:48.369 )") 00:24:48.369 04:36:27 -- nvmf/common.sh@542 -- # cat 00:24:48.369 04:36:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.369 04:36:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.369 { 00:24:48.369 "params": { 00:24:48.369 "name": "Nvme$subsystem", 00:24:48.369 "trtype": "$TEST_TRANSPORT", 00:24:48.369 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.369 "adrfam": "ipv4", 00:24:48.369 "trsvcid": "$NVMF_PORT", 00:24:48.369 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.369 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.369 "hdgst": ${hdgst:-false}, 00:24:48.369 "ddgst": ${ddgst:-false} 00:24:48.369 }, 00:24:48.369 "method": "bdev_nvme_attach_controller" 00:24:48.369 } 00:24:48.369 EOF 00:24:48.369 )") 00:24:48.369 04:36:27 -- nvmf/common.sh@542 -- # cat 00:24:48.369 04:36:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.369 04:36:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.369 { 00:24:48.369 "params": { 00:24:48.369 "name": "Nvme$subsystem", 00:24:48.369 "trtype": "$TEST_TRANSPORT", 00:24:48.369 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.369 "adrfam": "ipv4", 00:24:48.369 "trsvcid": "$NVMF_PORT", 00:24:48.369 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.369 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.369 "hdgst": ${hdgst:-false}, 00:24:48.369 "ddgst": ${ddgst:-false} 00:24:48.369 }, 00:24:48.369 "method": "bdev_nvme_attach_controller" 00:24:48.369 } 00:24:48.369 EOF 00:24:48.369 )") 00:24:48.369 04:36:27 -- nvmf/common.sh@542 -- # cat 00:24:48.369 04:36:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.369 04:36:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.369 { 00:24:48.369 "params": { 00:24:48.369 "name": "Nvme$subsystem", 00:24:48.369 "trtype": "$TEST_TRANSPORT", 00:24:48.370 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.370 "adrfam": "ipv4", 00:24:48.370 "trsvcid": "$NVMF_PORT", 00:24:48.370 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.370 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.370 "hdgst": ${hdgst:-false}, 00:24:48.370 "ddgst": ${ddgst:-false} 00:24:48.370 }, 00:24:48.370 "method": "bdev_nvme_attach_controller" 00:24:48.370 } 00:24:48.370 EOF 00:24:48.370 )") 00:24:48.370 04:36:27 -- nvmf/common.sh@542 -- # cat 00:24:48.370 04:36:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.370 04:36:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.370 { 00:24:48.370 "params": { 00:24:48.370 "name": "Nvme$subsystem", 00:24:48.370 "trtype": "$TEST_TRANSPORT", 00:24:48.370 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.370 "adrfam": "ipv4", 00:24:48.370 "trsvcid": "$NVMF_PORT", 00:24:48.370 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.370 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.370 "hdgst": ${hdgst:-false}, 00:24:48.370 "ddgst": ${ddgst:-false} 00:24:48.370 }, 00:24:48.370 "method": "bdev_nvme_attach_controller" 00:24:48.370 } 00:24:48.370 EOF 00:24:48.370 )") 00:24:48.370 04:36:27 -- nvmf/common.sh@542 -- # cat 00:24:48.370 04:36:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.370 04:36:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.370 { 00:24:48.370 "params": { 00:24:48.370 "name": "Nvme$subsystem", 00:24:48.370 "trtype": "$TEST_TRANSPORT", 00:24:48.370 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.370 "adrfam": "ipv4", 00:24:48.370 "trsvcid": "$NVMF_PORT", 00:24:48.370 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.370 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.370 "hdgst": ${hdgst:-false}, 00:24:48.370 "ddgst": ${ddgst:-false} 00:24:48.370 }, 00:24:48.370 "method": "bdev_nvme_attach_controller" 00:24:48.370 } 00:24:48.370 EOF 00:24:48.370 )") 00:24:48.370 04:36:27 -- nvmf/common.sh@542 -- # cat 00:24:48.370 04:36:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.370 04:36:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.370 { 00:24:48.370 "params": { 00:24:48.370 "name": "Nvme$subsystem", 00:24:48.370 "trtype": "$TEST_TRANSPORT", 00:24:48.370 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.370 "adrfam": "ipv4", 00:24:48.370 "trsvcid": "$NVMF_PORT", 00:24:48.370 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.370 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.370 "hdgst": ${hdgst:-false}, 00:24:48.370 "ddgst": ${ddgst:-false} 00:24:48.370 }, 00:24:48.370 "method": "bdev_nvme_attach_controller" 00:24:48.370 } 00:24:48.370 EOF 00:24:48.370 )") 00:24:48.370 04:36:27 -- nvmf/common.sh@542 -- # cat 00:24:48.370 04:36:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.370 04:36:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.370 { 00:24:48.370 "params": { 00:24:48.370 "name": "Nvme$subsystem", 00:24:48.370 "trtype": "$TEST_TRANSPORT", 00:24:48.370 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.370 "adrfam": "ipv4", 00:24:48.370 "trsvcid": "$NVMF_PORT", 00:24:48.370 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.370 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.370 "hdgst": ${hdgst:-false}, 00:24:48.370 "ddgst": ${ddgst:-false} 00:24:48.370 }, 00:24:48.370 "method": "bdev_nvme_attach_controller" 00:24:48.370 } 00:24:48.370 EOF 00:24:48.370 )") 00:24:48.370 04:36:27 -- nvmf/common.sh@542 -- # cat 00:24:48.370 04:36:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.370 04:36:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.370 { 00:24:48.370 "params": { 00:24:48.370 "name": "Nvme$subsystem", 00:24:48.370 "trtype": "$TEST_TRANSPORT", 00:24:48.370 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.370 "adrfam": "ipv4", 00:24:48.370 "trsvcid": "$NVMF_PORT", 00:24:48.370 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.370 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.370 "hdgst": ${hdgst:-false}, 00:24:48.370 "ddgst": ${ddgst:-false} 00:24:48.370 }, 00:24:48.370 "method": "bdev_nvme_attach_controller" 00:24:48.370 } 00:24:48.370 EOF 00:24:48.370 )") 00:24:48.370 04:36:27 -- nvmf/common.sh@542 -- # cat 00:24:48.370 04:36:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.370 04:36:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.370 { 00:24:48.370 "params": { 00:24:48.370 "name": "Nvme$subsystem", 00:24:48.370 "trtype": "$TEST_TRANSPORT", 00:24:48.370 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.370 "adrfam": "ipv4", 00:24:48.370 "trsvcid": "$NVMF_PORT", 00:24:48.371 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.371 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.371 "hdgst": ${hdgst:-false}, 00:24:48.371 "ddgst": ${ddgst:-false} 00:24:48.371 }, 00:24:48.371 "method": "bdev_nvme_attach_controller" 00:24:48.371 } 00:24:48.371 EOF 00:24:48.371 )") 00:24:48.371 04:36:27 -- nvmf/common.sh@542 -- # cat 00:24:48.371 04:36:27 -- nvmf/common.sh@544 -- # jq . 00:24:48.371 04:36:27 -- nvmf/common.sh@545 -- # IFS=, 00:24:48.371 04:36:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:48.371 "params": { 00:24:48.371 "name": "Nvme1", 00:24:48.371 "trtype": "tcp", 00:24:48.371 "traddr": "10.0.0.2", 00:24:48.371 "adrfam": "ipv4", 00:24:48.371 "trsvcid": "4420", 00:24:48.371 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:48.371 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:48.371 "hdgst": false, 00:24:48.371 "ddgst": false 00:24:48.371 }, 00:24:48.371 "method": "bdev_nvme_attach_controller" 00:24:48.371 },{ 00:24:48.371 "params": { 00:24:48.371 "name": "Nvme2", 00:24:48.371 "trtype": "tcp", 00:24:48.371 "traddr": "10.0.0.2", 00:24:48.371 "adrfam": "ipv4", 00:24:48.371 "trsvcid": "4420", 00:24:48.371 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:48.371 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:48.371 "hdgst": false, 00:24:48.371 "ddgst": false 00:24:48.371 }, 00:24:48.371 "method": "bdev_nvme_attach_controller" 00:24:48.371 },{ 00:24:48.371 "params": { 00:24:48.371 "name": "Nvme3", 00:24:48.371 "trtype": "tcp", 00:24:48.371 "traddr": "10.0.0.2", 00:24:48.371 "adrfam": "ipv4", 00:24:48.371 "trsvcid": "4420", 00:24:48.371 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:48.371 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:48.371 "hdgst": false, 00:24:48.371 "ddgst": false 00:24:48.371 }, 00:24:48.371 "method": "bdev_nvme_attach_controller" 00:24:48.371 },{ 00:24:48.371 "params": { 00:24:48.371 "name": "Nvme4", 00:24:48.371 "trtype": "tcp", 00:24:48.371 "traddr": "10.0.0.2", 00:24:48.371 "adrfam": "ipv4", 00:24:48.371 "trsvcid": "4420", 00:24:48.371 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:48.371 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:48.371 "hdgst": false, 00:24:48.371 "ddgst": false 00:24:48.371 }, 00:24:48.371 "method": "bdev_nvme_attach_controller" 00:24:48.371 },{ 00:24:48.371 "params": { 00:24:48.371 "name": "Nvme5", 00:24:48.371 "trtype": "tcp", 00:24:48.371 "traddr": "10.0.0.2", 00:24:48.371 "adrfam": "ipv4", 00:24:48.371 "trsvcid": "4420", 00:24:48.371 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:48.371 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:48.371 "hdgst": false, 00:24:48.371 "ddgst": false 00:24:48.371 }, 00:24:48.371 "method": "bdev_nvme_attach_controller" 00:24:48.371 },{ 00:24:48.371 "params": { 00:24:48.371 "name": "Nvme6", 00:24:48.371 "trtype": "tcp", 00:24:48.371 "traddr": "10.0.0.2", 00:24:48.371 "adrfam": "ipv4", 00:24:48.371 "trsvcid": "4420", 00:24:48.371 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:48.371 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:48.371 "hdgst": false, 00:24:48.371 "ddgst": false 00:24:48.371 }, 00:24:48.371 "method": "bdev_nvme_attach_controller" 00:24:48.371 },{ 00:24:48.371 "params": { 00:24:48.371 "name": "Nvme7", 00:24:48.371 "trtype": "tcp", 00:24:48.371 "traddr": "10.0.0.2", 00:24:48.371 "adrfam": "ipv4", 00:24:48.371 "trsvcid": "4420", 00:24:48.371 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:48.371 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:48.371 "hdgst": false, 00:24:48.371 "ddgst": false 00:24:48.371 }, 00:24:48.371 "method": "bdev_nvme_attach_controller" 00:24:48.371 },{ 00:24:48.371 "params": { 00:24:48.371 "name": "Nvme8", 00:24:48.371 "trtype": "tcp", 00:24:48.371 "traddr": "10.0.0.2", 00:24:48.371 "adrfam": "ipv4", 00:24:48.371 "trsvcid": "4420", 00:24:48.371 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:48.371 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:48.371 "hdgst": false, 00:24:48.371 "ddgst": false 00:24:48.371 }, 00:24:48.371 "method": "bdev_nvme_attach_controller" 00:24:48.371 },{ 00:24:48.371 "params": { 00:24:48.371 "name": "Nvme9", 00:24:48.371 "trtype": "tcp", 00:24:48.371 "traddr": "10.0.0.2", 00:24:48.371 "adrfam": "ipv4", 00:24:48.371 "trsvcid": "4420", 00:24:48.371 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:48.372 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:48.372 "hdgst": false, 00:24:48.372 "ddgst": false 00:24:48.372 }, 00:24:48.372 "method": "bdev_nvme_attach_controller" 00:24:48.372 },{ 00:24:48.372 "params": { 00:24:48.372 "name": "Nvme10", 00:24:48.372 "trtype": "tcp", 00:24:48.372 "traddr": "10.0.0.2", 00:24:48.372 "adrfam": "ipv4", 00:24:48.372 "trsvcid": "4420", 00:24:48.372 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:48.372 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:48.372 "hdgst": false, 00:24:48.372 "ddgst": false 00:24:48.372 }, 00:24:48.372 "method": "bdev_nvme_attach_controller" 00:24:48.372 }' 00:24:48.372 [2024-11-26 04:36:27.396332] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:48.372 [2024-11-26 04:36:27.396416] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2988075 ] 00:24:48.372 EAL: No free 2048 kB hugepages reported on node 1 00:24:48.372 [2024-11-26 04:36:27.461784] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:48.372 [2024-11-26 04:36:27.546439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:49.757 Running I/O for 1 seconds... 00:24:50.693 00:24:50.693 Latency(us) 00:24:50.693 [2024-11-26T03:36:29.919Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:50.693 [2024-11-26T03:36:29.919Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:50.693 Verification LBA range: start 0x0 length 0x400 00:24:50.693 Nvme1n1 : 1.07 370.87 23.18 0.00 0.00 166849.80 47962.64 126605.84 00:24:50.693 [2024-11-26T03:36:29.919Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:50.693 Verification LBA range: start 0x0 length 0x400 00:24:50.693 Nvme2n1 : 1.07 370.32 23.15 0.00 0.00 165953.30 52428.80 123498.95 00:24:50.693 [2024-11-26T03:36:29.919Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:50.693 Verification LBA range: start 0x0 length 0x400 00:24:50.693 Nvme3n1 : 1.08 369.25 23.08 0.00 0.00 165194.14 53593.88 121945.51 00:24:50.693 [2024-11-26T03:36:29.919Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:50.693 Verification LBA range: start 0x0 length 0x400 00:24:50.693 Nvme4n1 : 1.08 368.25 23.02 0.00 0.00 164304.72 53982.25 121945.51 00:24:50.693 [2024-11-26T03:36:29.919Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:50.693 Verification LBA range: start 0x0 length 0x400 00:24:50.693 Nvme5n1 : 1.10 393.42 24.59 0.00 0.00 156465.44 8738.13 122722.23 00:24:50.693 [2024-11-26T03:36:29.919Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:50.693 Verification LBA range: start 0x0 length 0x400 00:24:50.693 Nvme6n1 : 1.10 392.92 24.56 0.00 0.00 155643.30 8058.50 125052.40 00:24:50.693 [2024-11-26T03:36:29.919Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:50.693 Verification LBA range: start 0x0 length 0x400 00:24:50.693 Nvme7n1 : 1.11 392.19 24.51 0.00 0.00 154811.66 8641.04 126605.84 00:24:50.693 [2024-11-26T03:36:29.919Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:50.693 Verification LBA range: start 0x0 length 0x400 00:24:50.693 Nvme8n1 : 1.09 365.81 22.86 0.00 0.00 163269.90 26408.58 136703.24 00:24:50.693 [2024-11-26T03:36:29.919Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:50.693 Verification LBA range: start 0x0 length 0x400 00:24:50.693 Nvme9n1 : 1.09 364.67 22.79 0.00 0.00 162745.42 24855.13 133596.35 00:24:50.693 [2024-11-26T03:36:29.919Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:50.693 Verification LBA range: start 0x0 length 0x400 00:24:50.693 Nvme10n1 : 1.11 392.16 24.51 0.00 0.00 151543.84 7961.41 127382.57 00:24:50.693 [2024-11-26T03:36:29.919Z] =================================================================================================================== 00:24:50.693 [2024-11-26T03:36:29.920Z] Total : 3779.86 236.24 0.00 0.00 160464.31 7961.41 136703.24 00:24:50.953 04:36:30 -- target/shutdown.sh@93 -- # stoptarget 00:24:50.953 04:36:30 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:50.953 04:36:30 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:50.953 04:36:30 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:50.953 04:36:30 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:50.953 04:36:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:50.953 04:36:30 -- nvmf/common.sh@116 -- # sync 00:24:50.953 04:36:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:50.953 04:36:30 -- nvmf/common.sh@119 -- # set +e 00:24:50.953 04:36:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:50.953 04:36:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:50.953 rmmod nvme_tcp 00:24:50.953 rmmod nvme_fabrics 00:24:51.213 rmmod nvme_keyring 00:24:51.213 04:36:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:51.213 04:36:30 -- nvmf/common.sh@123 -- # set -e 00:24:51.213 04:36:30 -- nvmf/common.sh@124 -- # return 0 00:24:51.213 04:36:30 -- nvmf/common.sh@477 -- # '[' -n 2987446 ']' 00:24:51.213 04:36:30 -- nvmf/common.sh@478 -- # killprocess 2987446 00:24:51.213 04:36:30 -- common/autotest_common.sh@936 -- # '[' -z 2987446 ']' 00:24:51.213 04:36:30 -- common/autotest_common.sh@940 -- # kill -0 2987446 00:24:51.213 04:36:30 -- common/autotest_common.sh@941 -- # uname 00:24:51.213 04:36:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:51.213 04:36:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2987446 00:24:51.213 04:36:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:51.213 04:36:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:51.213 04:36:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2987446' 00:24:51.213 killing process with pid 2987446 00:24:51.213 04:36:30 -- common/autotest_common.sh@955 -- # kill 2987446 00:24:51.213 04:36:30 -- common/autotest_common.sh@960 -- # wait 2987446 00:24:51.783 04:36:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:51.783 04:36:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:51.783 04:36:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:51.783 04:36:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:51.783 04:36:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:51.783 04:36:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:51.783 04:36:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:51.783 04:36:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:53.699 04:36:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:53.699 00:24:53.699 real 0m11.959s 00:24:53.699 user 0m35.203s 00:24:53.699 sys 0m3.189s 00:24:53.699 04:36:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:53.699 04:36:32 -- common/autotest_common.sh@10 -- # set +x 00:24:53.699 ************************************ 00:24:53.699 END TEST nvmf_shutdown_tc1 00:24:53.699 ************************************ 00:24:53.699 04:36:32 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:24:53.699 04:36:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:53.699 04:36:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:53.699 04:36:32 -- common/autotest_common.sh@10 -- # set +x 00:24:53.699 ************************************ 00:24:53.699 START TEST nvmf_shutdown_tc2 00:24:53.699 ************************************ 00:24:53.699 04:36:32 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:24:53.699 04:36:32 -- target/shutdown.sh@98 -- # starttarget 00:24:53.699 04:36:32 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:53.699 04:36:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:53.699 04:36:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:53.699 04:36:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:53.699 04:36:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:53.699 04:36:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:53.699 04:36:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:53.699 04:36:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:53.699 04:36:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:53.699 04:36:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:53.699 04:36:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:53.699 04:36:32 -- common/autotest_common.sh@10 -- # set +x 00:24:53.699 04:36:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:53.699 04:36:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:53.699 04:36:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:53.699 04:36:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:53.699 04:36:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:53.699 04:36:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:53.699 04:36:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:53.699 04:36:32 -- nvmf/common.sh@294 -- # net_devs=() 00:24:53.699 04:36:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:53.699 04:36:32 -- nvmf/common.sh@295 -- # e810=() 00:24:53.699 04:36:32 -- nvmf/common.sh@295 -- # local -ga e810 00:24:53.699 04:36:32 -- nvmf/common.sh@296 -- # x722=() 00:24:53.699 04:36:32 -- nvmf/common.sh@296 -- # local -ga x722 00:24:53.699 04:36:32 -- nvmf/common.sh@297 -- # mlx=() 00:24:53.699 04:36:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:53.699 04:36:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:53.699 04:36:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:53.699 04:36:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:53.699 04:36:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:53.699 04:36:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:53.699 04:36:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:53.699 04:36:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:53.699 04:36:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:53.699 04:36:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:53.699 04:36:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:53.699 04:36:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:53.699 04:36:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:53.699 04:36:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:53.699 04:36:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:53.699 04:36:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:53.699 04:36:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:53.699 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:53.699 04:36:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:53.699 04:36:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:53.699 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:53.699 04:36:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:53.699 04:36:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:53.699 04:36:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:53.699 04:36:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:53.699 04:36:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:53.699 04:36:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:53.699 04:36:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:53.699 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:53.699 04:36:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:53.699 04:36:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:53.699 04:36:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:53.699 04:36:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:53.699 04:36:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:53.699 04:36:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:53.699 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:53.699 04:36:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:53.699 04:36:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:53.699 04:36:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:53.699 04:36:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:53.700 04:36:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:53.700 04:36:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:53.700 04:36:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:53.700 04:36:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:53.700 04:36:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:53.700 04:36:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:53.700 04:36:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:53.700 04:36:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:53.700 04:36:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:53.700 04:36:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:53.700 04:36:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:53.700 04:36:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:53.700 04:36:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:53.700 04:36:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:53.700 04:36:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:53.962 04:36:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:53.962 04:36:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:53.962 04:36:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:53.962 04:36:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:53.962 04:36:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:53.962 04:36:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:53.962 04:36:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:53.962 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:53.962 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.375 ms 00:24:53.962 00:24:53.962 --- 10.0.0.2 ping statistics --- 00:24:53.962 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:53.962 rtt min/avg/max/mdev = 0.375/0.375/0.375/0.000 ms 00:24:53.962 04:36:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:53.962 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:53.962 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:24:53.962 00:24:53.962 --- 10.0.0.1 ping statistics --- 00:24:53.962 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:53.962 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:24:53.962 04:36:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:53.962 04:36:33 -- nvmf/common.sh@410 -- # return 0 00:24:53.962 04:36:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:53.962 04:36:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:53.962 04:36:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:53.962 04:36:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:53.962 04:36:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:53.962 04:36:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:53.962 04:36:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:53.962 04:36:33 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:53.962 04:36:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:53.962 04:36:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:53.962 04:36:33 -- common/autotest_common.sh@10 -- # set +x 00:24:53.962 04:36:33 -- nvmf/common.sh@469 -- # nvmfpid=2988848 00:24:53.962 04:36:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:53.962 04:36:33 -- nvmf/common.sh@470 -- # waitforlisten 2988848 00:24:53.962 04:36:33 -- common/autotest_common.sh@829 -- # '[' -z 2988848 ']' 00:24:53.962 04:36:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:53.962 04:36:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:53.962 04:36:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:53.962 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:53.962 04:36:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:53.962 04:36:33 -- common/autotest_common.sh@10 -- # set +x 00:24:53.962 [2024-11-26 04:36:33.074357] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:53.962 [2024-11-26 04:36:33.074437] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:53.962 EAL: No free 2048 kB hugepages reported on node 1 00:24:53.962 [2024-11-26 04:36:33.140254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:54.222 [2024-11-26 04:36:33.231468] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:54.222 [2024-11-26 04:36:33.231626] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:54.222 [2024-11-26 04:36:33.231643] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:54.222 [2024-11-26 04:36:33.231655] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:54.222 [2024-11-26 04:36:33.231738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:54.222 [2024-11-26 04:36:33.231808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:54.222 [2024-11-26 04:36:33.231874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:54.222 [2024-11-26 04:36:33.231877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:55.164 04:36:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:55.164 04:36:34 -- common/autotest_common.sh@862 -- # return 0 00:24:55.164 04:36:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:55.164 04:36:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:55.164 04:36:34 -- common/autotest_common.sh@10 -- # set +x 00:24:55.164 04:36:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:55.164 04:36:34 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:55.164 04:36:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:55.164 04:36:34 -- common/autotest_common.sh@10 -- # set +x 00:24:55.164 [2024-11-26 04:36:34.156540] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:55.164 04:36:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:55.164 04:36:34 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:55.164 04:36:34 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:55.164 04:36:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:55.164 04:36:34 -- common/autotest_common.sh@10 -- # set +x 00:24:55.164 04:36:34 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:55.164 04:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.164 04:36:34 -- target/shutdown.sh@28 -- # cat 00:24:55.164 04:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.164 04:36:34 -- target/shutdown.sh@28 -- # cat 00:24:55.164 04:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.164 04:36:34 -- target/shutdown.sh@28 -- # cat 00:24:55.164 04:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.164 04:36:34 -- target/shutdown.sh@28 -- # cat 00:24:55.164 04:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.164 04:36:34 -- target/shutdown.sh@28 -- # cat 00:24:55.164 04:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.164 04:36:34 -- target/shutdown.sh@28 -- # cat 00:24:55.164 04:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.164 04:36:34 -- target/shutdown.sh@28 -- # cat 00:24:55.164 04:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.164 04:36:34 -- target/shutdown.sh@28 -- # cat 00:24:55.164 04:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.164 04:36:34 -- target/shutdown.sh@28 -- # cat 00:24:55.164 04:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.164 04:36:34 -- target/shutdown.sh@28 -- # cat 00:24:55.164 04:36:34 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:55.164 04:36:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:55.164 04:36:34 -- common/autotest_common.sh@10 -- # set +x 00:24:55.164 Malloc1 00:24:55.164 [2024-11-26 04:36:34.239907] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:55.164 Malloc2 00:24:55.164 Malloc3 00:24:55.164 Malloc4 00:24:55.423 Malloc5 00:24:55.423 Malloc6 00:24:55.423 Malloc7 00:24:55.423 Malloc8 00:24:55.423 Malloc9 00:24:55.682 Malloc10 00:24:55.682 04:36:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:55.682 04:36:34 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:55.682 04:36:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:55.682 04:36:34 -- common/autotest_common.sh@10 -- # set +x 00:24:55.682 04:36:34 -- target/shutdown.sh@102 -- # perfpid=2989164 00:24:55.682 04:36:34 -- target/shutdown.sh@103 -- # waitforlisten 2989164 /var/tmp/bdevperf.sock 00:24:55.682 04:36:34 -- common/autotest_common.sh@829 -- # '[' -z 2989164 ']' 00:24:55.682 04:36:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:55.682 04:36:34 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:24:55.682 04:36:34 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:55.682 04:36:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:55.682 04:36:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:55.682 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:55.682 04:36:34 -- nvmf/common.sh@520 -- # config=() 00:24:55.682 04:36:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:55.682 04:36:34 -- nvmf/common.sh@520 -- # local subsystem config 00:24:55.682 04:36:34 -- common/autotest_common.sh@10 -- # set +x 00:24:55.682 04:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.682 04:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.682 { 00:24:55.682 "params": { 00:24:55.682 "name": "Nvme$subsystem", 00:24:55.682 "trtype": "$TEST_TRANSPORT", 00:24:55.682 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.682 "adrfam": "ipv4", 00:24:55.682 "trsvcid": "$NVMF_PORT", 00:24:55.682 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.682 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.682 "hdgst": ${hdgst:-false}, 00:24:55.682 "ddgst": ${ddgst:-false} 00:24:55.682 }, 00:24:55.682 "method": "bdev_nvme_attach_controller" 00:24:55.682 } 00:24:55.682 EOF 00:24:55.682 )") 00:24:55.682 04:36:34 -- nvmf/common.sh@542 -- # cat 00:24:55.682 04:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.682 04:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.682 { 00:24:55.682 "params": { 00:24:55.682 "name": "Nvme$subsystem", 00:24:55.682 "trtype": "$TEST_TRANSPORT", 00:24:55.682 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.682 "adrfam": "ipv4", 00:24:55.682 "trsvcid": "$NVMF_PORT", 00:24:55.682 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.682 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.682 "hdgst": ${hdgst:-false}, 00:24:55.682 "ddgst": ${ddgst:-false} 00:24:55.682 }, 00:24:55.682 "method": "bdev_nvme_attach_controller" 00:24:55.682 } 00:24:55.682 EOF 00:24:55.682 )") 00:24:55.682 04:36:34 -- nvmf/common.sh@542 -- # cat 00:24:55.682 04:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.682 04:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.682 { 00:24:55.682 "params": { 00:24:55.682 "name": "Nvme$subsystem", 00:24:55.682 "trtype": "$TEST_TRANSPORT", 00:24:55.682 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.682 "adrfam": "ipv4", 00:24:55.682 "trsvcid": "$NVMF_PORT", 00:24:55.682 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.682 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.682 "hdgst": ${hdgst:-false}, 00:24:55.682 "ddgst": ${ddgst:-false} 00:24:55.682 }, 00:24:55.682 "method": "bdev_nvme_attach_controller" 00:24:55.682 } 00:24:55.682 EOF 00:24:55.682 )") 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # cat 00:24:55.683 04:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.683 { 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme$subsystem", 00:24:55.683 "trtype": "$TEST_TRANSPORT", 00:24:55.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "$NVMF_PORT", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.683 "hdgst": ${hdgst:-false}, 00:24:55.683 "ddgst": ${ddgst:-false} 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 } 00:24:55.683 EOF 00:24:55.683 )") 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # cat 00:24:55.683 04:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.683 { 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme$subsystem", 00:24:55.683 "trtype": "$TEST_TRANSPORT", 00:24:55.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "$NVMF_PORT", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.683 "hdgst": ${hdgst:-false}, 00:24:55.683 "ddgst": ${ddgst:-false} 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 } 00:24:55.683 EOF 00:24:55.683 )") 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # cat 00:24:55.683 04:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.683 { 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme$subsystem", 00:24:55.683 "trtype": "$TEST_TRANSPORT", 00:24:55.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "$NVMF_PORT", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.683 "hdgst": ${hdgst:-false}, 00:24:55.683 "ddgst": ${ddgst:-false} 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 } 00:24:55.683 EOF 00:24:55.683 )") 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # cat 00:24:55.683 04:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.683 { 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme$subsystem", 00:24:55.683 "trtype": "$TEST_TRANSPORT", 00:24:55.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "$NVMF_PORT", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.683 "hdgst": ${hdgst:-false}, 00:24:55.683 "ddgst": ${ddgst:-false} 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 } 00:24:55.683 EOF 00:24:55.683 )") 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # cat 00:24:55.683 04:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.683 { 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme$subsystem", 00:24:55.683 "trtype": "$TEST_TRANSPORT", 00:24:55.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "$NVMF_PORT", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.683 "hdgst": ${hdgst:-false}, 00:24:55.683 "ddgst": ${ddgst:-false} 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 } 00:24:55.683 EOF 00:24:55.683 )") 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # cat 00:24:55.683 04:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.683 { 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme$subsystem", 00:24:55.683 "trtype": "$TEST_TRANSPORT", 00:24:55.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "$NVMF_PORT", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.683 "hdgst": ${hdgst:-false}, 00:24:55.683 "ddgst": ${ddgst:-false} 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 } 00:24:55.683 EOF 00:24:55.683 )") 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # cat 00:24:55.683 04:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.683 { 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme$subsystem", 00:24:55.683 "trtype": "$TEST_TRANSPORT", 00:24:55.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "$NVMF_PORT", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.683 "hdgst": ${hdgst:-false}, 00:24:55.683 "ddgst": ${ddgst:-false} 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 } 00:24:55.683 EOF 00:24:55.683 )") 00:24:55.683 04:36:34 -- nvmf/common.sh@542 -- # cat 00:24:55.683 04:36:34 -- nvmf/common.sh@544 -- # jq . 00:24:55.683 04:36:34 -- nvmf/common.sh@545 -- # IFS=, 00:24:55.683 04:36:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme1", 00:24:55.683 "trtype": "tcp", 00:24:55.683 "traddr": "10.0.0.2", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "4420", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:55.683 "hdgst": false, 00:24:55.683 "ddgst": false 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 },{ 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme2", 00:24:55.683 "trtype": "tcp", 00:24:55.683 "traddr": "10.0.0.2", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "4420", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:55.683 "hdgst": false, 00:24:55.683 "ddgst": false 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 },{ 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme3", 00:24:55.683 "trtype": "tcp", 00:24:55.683 "traddr": "10.0.0.2", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "4420", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:55.683 "hdgst": false, 00:24:55.683 "ddgst": false 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 },{ 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme4", 00:24:55.683 "trtype": "tcp", 00:24:55.683 "traddr": "10.0.0.2", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "4420", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:55.683 "hdgst": false, 00:24:55.683 "ddgst": false 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 },{ 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme5", 00:24:55.683 "trtype": "tcp", 00:24:55.683 "traddr": "10.0.0.2", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "4420", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:55.683 "hdgst": false, 00:24:55.683 "ddgst": false 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 },{ 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme6", 00:24:55.683 "trtype": "tcp", 00:24:55.683 "traddr": "10.0.0.2", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "4420", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:55.683 "hdgst": false, 00:24:55.683 "ddgst": false 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 },{ 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme7", 00:24:55.683 "trtype": "tcp", 00:24:55.683 "traddr": "10.0.0.2", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "4420", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:55.683 "hdgst": false, 00:24:55.683 "ddgst": false 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 },{ 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme8", 00:24:55.683 "trtype": "tcp", 00:24:55.683 "traddr": "10.0.0.2", 00:24:55.683 "adrfam": "ipv4", 00:24:55.683 "trsvcid": "4420", 00:24:55.683 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:55.683 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:55.683 "hdgst": false, 00:24:55.683 "ddgst": false 00:24:55.683 }, 00:24:55.683 "method": "bdev_nvme_attach_controller" 00:24:55.683 },{ 00:24:55.683 "params": { 00:24:55.683 "name": "Nvme9", 00:24:55.683 "trtype": "tcp", 00:24:55.683 "traddr": "10.0.0.2", 00:24:55.684 "adrfam": "ipv4", 00:24:55.684 "trsvcid": "4420", 00:24:55.684 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:55.684 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:55.684 "hdgst": false, 00:24:55.684 "ddgst": false 00:24:55.684 }, 00:24:55.684 "method": "bdev_nvme_attach_controller" 00:24:55.684 },{ 00:24:55.684 "params": { 00:24:55.684 "name": "Nvme10", 00:24:55.684 "trtype": "tcp", 00:24:55.684 "traddr": "10.0.0.2", 00:24:55.684 "adrfam": "ipv4", 00:24:55.684 "trsvcid": "4420", 00:24:55.684 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:55.684 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:55.684 "hdgst": false, 00:24:55.684 "ddgst": false 00:24:55.684 }, 00:24:55.684 "method": "bdev_nvme_attach_controller" 00:24:55.684 }' 00:24:55.684 [2024-11-26 04:36:34.743580] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:55.684 [2024-11-26 04:36:34.743667] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2989164 ] 00:24:55.684 EAL: No free 2048 kB hugepages reported on node 1 00:24:55.684 [2024-11-26 04:36:34.806781] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:55.684 [2024-11-26 04:36:34.891495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:58.223 Running I/O for 10 seconds... 00:24:58.223 04:36:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:58.223 04:36:37 -- common/autotest_common.sh@862 -- # return 0 00:24:58.223 04:36:37 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:58.223 04:36:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.223 04:36:37 -- common/autotest_common.sh@10 -- # set +x 00:24:58.223 04:36:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.223 04:36:37 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:24:58.223 04:36:37 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:24:58.223 04:36:37 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:24:58.223 04:36:37 -- target/shutdown.sh@57 -- # local ret=1 00:24:58.223 04:36:37 -- target/shutdown.sh@58 -- # local i 00:24:58.223 04:36:37 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:24:58.223 04:36:37 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:58.223 04:36:37 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:58.223 04:36:37 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:58.223 04:36:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.223 04:36:37 -- common/autotest_common.sh@10 -- # set +x 00:24:58.223 04:36:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.223 04:36:37 -- target/shutdown.sh@60 -- # read_io_count=129 00:24:58.223 04:36:37 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:24:58.223 04:36:37 -- target/shutdown.sh@64 -- # ret=0 00:24:58.223 04:36:37 -- target/shutdown.sh@65 -- # break 00:24:58.223 04:36:37 -- target/shutdown.sh@69 -- # return 0 00:24:58.223 04:36:37 -- target/shutdown.sh@109 -- # killprocess 2989164 00:24:58.223 04:36:37 -- common/autotest_common.sh@936 -- # '[' -z 2989164 ']' 00:24:58.223 04:36:37 -- common/autotest_common.sh@940 -- # kill -0 2989164 00:24:58.223 04:36:37 -- common/autotest_common.sh@941 -- # uname 00:24:58.223 04:36:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:58.223 04:36:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2989164 00:24:58.223 04:36:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:58.223 04:36:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:58.223 04:36:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2989164' 00:24:58.223 killing process with pid 2989164 00:24:58.223 04:36:37 -- common/autotest_common.sh@955 -- # kill 2989164 00:24:58.223 04:36:37 -- common/autotest_common.sh@960 -- # wait 2989164 00:24:58.223 Received shutdown signal, test time was about 0.560076 seconds 00:24:58.223 00:24:58.223 Latency(us) 00:24:58.223 [2024-11-26T03:36:37.449Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:58.223 [2024-11-26T03:36:37.449Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:58.223 Verification LBA range: start 0x0 length 0x400 00:24:58.223 Nvme1n1 : 0.55 417.76 26.11 0.00 0.00 147308.66 20097.71 118838.61 00:24:58.223 [2024-11-26T03:36:37.449Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:58.223 Verification LBA range: start 0x0 length 0x400 00:24:58.223 Nvme2n1 : 0.56 407.67 25.48 0.00 0.00 148846.78 23884.23 142140.30 00:24:58.223 [2024-11-26T03:36:37.449Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:58.223 Verification LBA range: start 0x0 length 0x400 00:24:58.223 Nvme3n1 : 0.55 416.68 26.04 0.00 0.00 143457.41 23787.14 118061.89 00:24:58.223 [2024-11-26T03:36:37.449Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:58.223 Verification LBA range: start 0x0 length 0x400 00:24:58.223 Nvme4n1 : 0.54 419.18 26.20 0.00 0.00 141165.14 18835.53 121945.51 00:24:58.223 [2024-11-26T03:36:37.449Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:58.223 Verification LBA range: start 0x0 length 0x400 00:24:58.223 Nvme5n1 : 0.55 413.61 25.85 0.00 0.00 140195.09 24855.13 114178.28 00:24:58.223 [2024-11-26T03:36:37.449Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:58.223 Verification LBA range: start 0x0 length 0x400 00:24:58.223 Nvme6n1 : 0.52 367.12 22.95 0.00 0.00 155727.33 21651.15 131266.18 00:24:58.223 [2024-11-26T03:36:37.449Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:58.223 Verification LBA range: start 0x0 length 0x400 00:24:58.223 Nvme7n1 : 0.55 411.82 25.74 0.00 0.00 136817.37 24175.50 114178.28 00:24:58.223 [2024-11-26T03:36:37.449Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:58.223 Verification LBA range: start 0x0 length 0x400 00:24:58.223 Nvme8n1 : 0.55 410.85 25.68 0.00 0.00 135169.38 24272.59 118061.89 00:24:58.223 [2024-11-26T03:36:37.449Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:58.223 Verification LBA range: start 0x0 length 0x400 00:24:58.223 Nvme9n1 : 0.56 409.88 25.62 0.00 0.00 133500.96 24175.50 111848.11 00:24:58.223 [2024-11-26T03:36:37.449Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:58.223 Verification LBA range: start 0x0 length 0x400 00:24:58.223 Nvme10n1 : 0.54 350.60 21.91 0.00 0.00 152006.73 26408.58 125052.40 00:24:58.223 [2024-11-26T03:36:37.449Z] =================================================================================================================== 00:24:58.223 [2024-11-26T03:36:37.449Z] Total : 4025.18 251.57 0.00 0.00 143059.22 18835.53 142140.30 00:24:58.483 04:36:37 -- target/shutdown.sh@112 -- # sleep 1 00:24:59.875 04:36:38 -- target/shutdown.sh@113 -- # kill -0 2988848 00:24:59.875 04:36:38 -- target/shutdown.sh@115 -- # stoptarget 00:24:59.875 04:36:38 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:59.875 04:36:38 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:59.875 04:36:38 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:59.875 04:36:38 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:59.875 04:36:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:59.875 04:36:38 -- nvmf/common.sh@116 -- # sync 00:24:59.875 04:36:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:59.875 04:36:38 -- nvmf/common.sh@119 -- # set +e 00:24:59.875 04:36:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:59.875 04:36:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:59.875 rmmod nvme_tcp 00:24:59.875 rmmod nvme_fabrics 00:24:59.875 rmmod nvme_keyring 00:24:59.875 04:36:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:59.875 04:36:38 -- nvmf/common.sh@123 -- # set -e 00:24:59.875 04:36:38 -- nvmf/common.sh@124 -- # return 0 00:24:59.875 04:36:38 -- nvmf/common.sh@477 -- # '[' -n 2988848 ']' 00:24:59.875 04:36:38 -- nvmf/common.sh@478 -- # killprocess 2988848 00:24:59.875 04:36:38 -- common/autotest_common.sh@936 -- # '[' -z 2988848 ']' 00:24:59.875 04:36:38 -- common/autotest_common.sh@940 -- # kill -0 2988848 00:24:59.875 04:36:38 -- common/autotest_common.sh@941 -- # uname 00:24:59.875 04:36:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:59.875 04:36:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2988848 00:24:59.875 04:36:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:59.875 04:36:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:59.875 04:36:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2988848' 00:24:59.875 killing process with pid 2988848 00:24:59.875 04:36:38 -- common/autotest_common.sh@955 -- # kill 2988848 00:24:59.875 04:36:38 -- common/autotest_common.sh@960 -- # wait 2988848 00:25:00.137 04:36:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:00.137 04:36:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:00.137 04:36:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:00.137 04:36:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:00.137 04:36:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:00.137 04:36:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:00.137 04:36:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:00.137 04:36:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:02.684 04:36:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:02.684 00:25:02.684 real 0m8.441s 00:25:02.684 user 0m27.000s 00:25:02.684 sys 0m1.499s 00:25:02.684 04:36:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:02.684 04:36:41 -- common/autotest_common.sh@10 -- # set +x 00:25:02.684 ************************************ 00:25:02.684 END TEST nvmf_shutdown_tc2 00:25:02.684 ************************************ 00:25:02.684 04:36:41 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:02.684 04:36:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:02.684 04:36:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:02.684 04:36:41 -- common/autotest_common.sh@10 -- # set +x 00:25:02.684 ************************************ 00:25:02.684 START TEST nvmf_shutdown_tc3 00:25:02.684 ************************************ 00:25:02.684 04:36:41 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:02.685 04:36:41 -- target/shutdown.sh@120 -- # starttarget 00:25:02.685 04:36:41 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:02.685 04:36:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:02.685 04:36:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:02.685 04:36:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:02.685 04:36:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:02.685 04:36:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:02.685 04:36:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:02.685 04:36:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:02.685 04:36:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:02.685 04:36:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:02.685 04:36:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:02.685 04:36:41 -- common/autotest_common.sh@10 -- # set +x 00:25:02.685 04:36:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:02.685 04:36:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:02.685 04:36:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:02.685 04:36:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:02.685 04:36:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:02.685 04:36:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:02.685 04:36:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:02.685 04:36:41 -- nvmf/common.sh@294 -- # net_devs=() 00:25:02.685 04:36:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:02.685 04:36:41 -- nvmf/common.sh@295 -- # e810=() 00:25:02.685 04:36:41 -- nvmf/common.sh@295 -- # local -ga e810 00:25:02.685 04:36:41 -- nvmf/common.sh@296 -- # x722=() 00:25:02.685 04:36:41 -- nvmf/common.sh@296 -- # local -ga x722 00:25:02.685 04:36:41 -- nvmf/common.sh@297 -- # mlx=() 00:25:02.685 04:36:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:02.685 04:36:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:02.685 04:36:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:02.685 04:36:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:02.685 04:36:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:02.685 04:36:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:02.685 04:36:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:02.685 04:36:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:02.685 04:36:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:02.685 04:36:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:02.685 04:36:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:02.685 04:36:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:02.685 04:36:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:02.685 04:36:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:02.685 04:36:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:02.685 04:36:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:02.685 04:36:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:02.685 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:02.685 04:36:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:02.685 04:36:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:02.685 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:02.685 04:36:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:02.685 04:36:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:02.685 04:36:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:02.685 04:36:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:02.685 04:36:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:02.685 04:36:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:02.685 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:02.685 04:36:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:02.685 04:36:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:02.685 04:36:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:02.685 04:36:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:02.685 04:36:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:02.685 04:36:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:02.685 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:02.685 04:36:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:02.685 04:36:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:02.685 04:36:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:02.685 04:36:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:02.685 04:36:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:02.685 04:36:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:02.685 04:36:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:02.685 04:36:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:02.685 04:36:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:02.685 04:36:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:02.685 04:36:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:02.685 04:36:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:02.685 04:36:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:02.685 04:36:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:02.685 04:36:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:02.685 04:36:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:02.685 04:36:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:02.685 04:36:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:02.685 04:36:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:02.685 04:36:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:02.685 04:36:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:02.685 04:36:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:02.685 04:36:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:02.685 04:36:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:02.685 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:02.685 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:25:02.685 00:25:02.685 --- 10.0.0.2 ping statistics --- 00:25:02.685 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:02.685 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:25:02.685 04:36:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:02.685 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:02.685 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.137 ms 00:25:02.685 00:25:02.685 --- 10.0.0.1 ping statistics --- 00:25:02.685 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:02.685 rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms 00:25:02.685 04:36:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:02.685 04:36:41 -- nvmf/common.sh@410 -- # return 0 00:25:02.685 04:36:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:02.685 04:36:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:02.685 04:36:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:02.685 04:36:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:02.685 04:36:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:02.685 04:36:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:02.685 04:36:41 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:02.685 04:36:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:02.685 04:36:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:02.685 04:36:41 -- common/autotest_common.sh@10 -- # set +x 00:25:02.685 04:36:41 -- nvmf/common.sh@469 -- # nvmfpid=2990098 00:25:02.685 04:36:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:02.685 04:36:41 -- nvmf/common.sh@470 -- # waitforlisten 2990098 00:25:02.685 04:36:41 -- common/autotest_common.sh@829 -- # '[' -z 2990098 ']' 00:25:02.685 04:36:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:02.685 04:36:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:02.685 04:36:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:02.685 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:02.685 04:36:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:02.685 04:36:41 -- common/autotest_common.sh@10 -- # set +x 00:25:02.685 [2024-11-26 04:36:41.543404] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:02.685 [2024-11-26 04:36:41.543478] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:02.685 EAL: No free 2048 kB hugepages reported on node 1 00:25:02.685 [2024-11-26 04:36:41.612482] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:02.685 [2024-11-26 04:36:41.702848] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:02.685 [2024-11-26 04:36:41.703024] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:02.685 [2024-11-26 04:36:41.703045] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:02.685 [2024-11-26 04:36:41.703060] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:02.685 [2024-11-26 04:36:41.703140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:02.686 [2024-11-26 04:36:41.703229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:02.686 [2024-11-26 04:36:41.703181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:02.686 [2024-11-26 04:36:41.703231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:03.625 04:36:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:03.625 04:36:42 -- common/autotest_common.sh@862 -- # return 0 00:25:03.625 04:36:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:03.625 04:36:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:03.625 04:36:42 -- common/autotest_common.sh@10 -- # set +x 00:25:03.625 04:36:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:03.625 04:36:42 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:03.625 04:36:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:03.625 04:36:42 -- common/autotest_common.sh@10 -- # set +x 00:25:03.625 [2024-11-26 04:36:42.626650] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:03.625 04:36:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:03.625 04:36:42 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:03.625 04:36:42 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:03.625 04:36:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:03.625 04:36:42 -- common/autotest_common.sh@10 -- # set +x 00:25:03.625 04:36:42 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:03.625 04:36:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:03.625 04:36:42 -- target/shutdown.sh@28 -- # cat 00:25:03.625 04:36:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:03.625 04:36:42 -- target/shutdown.sh@28 -- # cat 00:25:03.625 04:36:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:03.625 04:36:42 -- target/shutdown.sh@28 -- # cat 00:25:03.625 04:36:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:03.625 04:36:42 -- target/shutdown.sh@28 -- # cat 00:25:03.625 04:36:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:03.625 04:36:42 -- target/shutdown.sh@28 -- # cat 00:25:03.625 04:36:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:03.625 04:36:42 -- target/shutdown.sh@28 -- # cat 00:25:03.625 04:36:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:03.625 04:36:42 -- target/shutdown.sh@28 -- # cat 00:25:03.625 04:36:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:03.625 04:36:42 -- target/shutdown.sh@28 -- # cat 00:25:03.625 04:36:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:03.625 04:36:42 -- target/shutdown.sh@28 -- # cat 00:25:03.625 04:36:42 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:03.625 04:36:42 -- target/shutdown.sh@28 -- # cat 00:25:03.625 04:36:42 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:03.625 04:36:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:03.625 04:36:42 -- common/autotest_common.sh@10 -- # set +x 00:25:03.625 Malloc1 00:25:03.625 [2024-11-26 04:36:42.716204] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:03.625 Malloc2 00:25:03.625 Malloc3 00:25:03.625 Malloc4 00:25:03.885 Malloc5 00:25:03.885 Malloc6 00:25:03.885 Malloc7 00:25:03.885 Malloc8 00:25:03.885 Malloc9 00:25:04.144 Malloc10 00:25:04.144 04:36:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:04.144 04:36:43 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:04.144 04:36:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:04.144 04:36:43 -- common/autotest_common.sh@10 -- # set +x 00:25:04.144 04:36:43 -- target/shutdown.sh@124 -- # perfpid=2990287 00:25:04.144 04:36:43 -- target/shutdown.sh@125 -- # waitforlisten 2990287 /var/tmp/bdevperf.sock 00:25:04.144 04:36:43 -- common/autotest_common.sh@829 -- # '[' -z 2990287 ']' 00:25:04.145 04:36:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:04.145 04:36:43 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:04.145 04:36:43 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:04.145 04:36:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:04.145 04:36:43 -- nvmf/common.sh@520 -- # config=() 00:25:04.145 04:36:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:04.145 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:04.145 04:36:43 -- nvmf/common.sh@520 -- # local subsystem config 00:25:04.145 04:36:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:04.145 04:36:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:04.145 04:36:43 -- common/autotest_common.sh@10 -- # set +x 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:04.145 { 00:25:04.145 "params": { 00:25:04.145 "name": "Nvme$subsystem", 00:25:04.145 "trtype": "$TEST_TRANSPORT", 00:25:04.145 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:04.145 "adrfam": "ipv4", 00:25:04.145 "trsvcid": "$NVMF_PORT", 00:25:04.145 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:04.145 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:04.145 "hdgst": ${hdgst:-false}, 00:25:04.145 "ddgst": ${ddgst:-false} 00:25:04.145 }, 00:25:04.145 "method": "bdev_nvme_attach_controller" 00:25:04.145 } 00:25:04.145 EOF 00:25:04.145 )") 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # cat 00:25:04.145 04:36:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:04.145 { 00:25:04.145 "params": { 00:25:04.145 "name": "Nvme$subsystem", 00:25:04.145 "trtype": "$TEST_TRANSPORT", 00:25:04.145 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:04.145 "adrfam": "ipv4", 00:25:04.145 "trsvcid": "$NVMF_PORT", 00:25:04.145 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:04.145 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:04.145 "hdgst": ${hdgst:-false}, 00:25:04.145 "ddgst": ${ddgst:-false} 00:25:04.145 }, 00:25:04.145 "method": "bdev_nvme_attach_controller" 00:25:04.145 } 00:25:04.145 EOF 00:25:04.145 )") 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # cat 00:25:04.145 04:36:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:04.145 { 00:25:04.145 "params": { 00:25:04.145 "name": "Nvme$subsystem", 00:25:04.145 "trtype": "$TEST_TRANSPORT", 00:25:04.145 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:04.145 "adrfam": "ipv4", 00:25:04.145 "trsvcid": "$NVMF_PORT", 00:25:04.145 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:04.145 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:04.145 "hdgst": ${hdgst:-false}, 00:25:04.145 "ddgst": ${ddgst:-false} 00:25:04.145 }, 00:25:04.145 "method": "bdev_nvme_attach_controller" 00:25:04.145 } 00:25:04.145 EOF 00:25:04.145 )") 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # cat 00:25:04.145 04:36:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:04.145 { 00:25:04.145 "params": { 00:25:04.145 "name": "Nvme$subsystem", 00:25:04.145 "trtype": "$TEST_TRANSPORT", 00:25:04.145 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:04.145 "adrfam": "ipv4", 00:25:04.145 "trsvcid": "$NVMF_PORT", 00:25:04.145 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:04.145 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:04.145 "hdgst": ${hdgst:-false}, 00:25:04.145 "ddgst": ${ddgst:-false} 00:25:04.145 }, 00:25:04.145 "method": "bdev_nvme_attach_controller" 00:25:04.145 } 00:25:04.145 EOF 00:25:04.145 )") 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # cat 00:25:04.145 04:36:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:04.145 { 00:25:04.145 "params": { 00:25:04.145 "name": "Nvme$subsystem", 00:25:04.145 "trtype": "$TEST_TRANSPORT", 00:25:04.145 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:04.145 "adrfam": "ipv4", 00:25:04.145 "trsvcid": "$NVMF_PORT", 00:25:04.145 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:04.145 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:04.145 "hdgst": ${hdgst:-false}, 00:25:04.145 "ddgst": ${ddgst:-false} 00:25:04.145 }, 00:25:04.145 "method": "bdev_nvme_attach_controller" 00:25:04.145 } 00:25:04.145 EOF 00:25:04.145 )") 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # cat 00:25:04.145 04:36:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:04.145 { 00:25:04.145 "params": { 00:25:04.145 "name": "Nvme$subsystem", 00:25:04.145 "trtype": "$TEST_TRANSPORT", 00:25:04.145 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:04.145 "adrfam": "ipv4", 00:25:04.145 "trsvcid": "$NVMF_PORT", 00:25:04.145 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:04.145 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:04.145 "hdgst": ${hdgst:-false}, 00:25:04.145 "ddgst": ${ddgst:-false} 00:25:04.145 }, 00:25:04.145 "method": "bdev_nvme_attach_controller" 00:25:04.145 } 00:25:04.145 EOF 00:25:04.145 )") 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # cat 00:25:04.145 04:36:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:04.145 { 00:25:04.145 "params": { 00:25:04.145 "name": "Nvme$subsystem", 00:25:04.145 "trtype": "$TEST_TRANSPORT", 00:25:04.145 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:04.145 "adrfam": "ipv4", 00:25:04.145 "trsvcid": "$NVMF_PORT", 00:25:04.145 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:04.145 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:04.145 "hdgst": ${hdgst:-false}, 00:25:04.145 "ddgst": ${ddgst:-false} 00:25:04.145 }, 00:25:04.145 "method": "bdev_nvme_attach_controller" 00:25:04.145 } 00:25:04.145 EOF 00:25:04.145 )") 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # cat 00:25:04.145 04:36:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:04.145 { 00:25:04.145 "params": { 00:25:04.145 "name": "Nvme$subsystem", 00:25:04.145 "trtype": "$TEST_TRANSPORT", 00:25:04.145 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:04.145 "adrfam": "ipv4", 00:25:04.145 "trsvcid": "$NVMF_PORT", 00:25:04.145 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:04.145 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:04.145 "hdgst": ${hdgst:-false}, 00:25:04.145 "ddgst": ${ddgst:-false} 00:25:04.145 }, 00:25:04.145 "method": "bdev_nvme_attach_controller" 00:25:04.145 } 00:25:04.145 EOF 00:25:04.145 )") 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # cat 00:25:04.145 04:36:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:04.145 { 00:25:04.145 "params": { 00:25:04.145 "name": "Nvme$subsystem", 00:25:04.145 "trtype": "$TEST_TRANSPORT", 00:25:04.145 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:04.145 "adrfam": "ipv4", 00:25:04.145 "trsvcid": "$NVMF_PORT", 00:25:04.145 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:04.145 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:04.145 "hdgst": ${hdgst:-false}, 00:25:04.145 "ddgst": ${ddgst:-false} 00:25:04.145 }, 00:25:04.145 "method": "bdev_nvme_attach_controller" 00:25:04.145 } 00:25:04.145 EOF 00:25:04.145 )") 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # cat 00:25:04.145 04:36:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:04.145 { 00:25:04.145 "params": { 00:25:04.145 "name": "Nvme$subsystem", 00:25:04.145 "trtype": "$TEST_TRANSPORT", 00:25:04.145 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:04.145 "adrfam": "ipv4", 00:25:04.145 "trsvcid": "$NVMF_PORT", 00:25:04.145 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:04.145 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:04.145 "hdgst": ${hdgst:-false}, 00:25:04.145 "ddgst": ${ddgst:-false} 00:25:04.145 }, 00:25:04.145 "method": "bdev_nvme_attach_controller" 00:25:04.145 } 00:25:04.145 EOF 00:25:04.145 )") 00:25:04.145 04:36:43 -- nvmf/common.sh@542 -- # cat 00:25:04.145 04:36:43 -- nvmf/common.sh@544 -- # jq . 00:25:04.145 04:36:43 -- nvmf/common.sh@545 -- # IFS=, 00:25:04.145 04:36:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:04.145 "params": { 00:25:04.145 "name": "Nvme1", 00:25:04.145 "trtype": "tcp", 00:25:04.145 "traddr": "10.0.0.2", 00:25:04.145 "adrfam": "ipv4", 00:25:04.145 "trsvcid": "4420", 00:25:04.145 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:04.145 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:04.145 "hdgst": false, 00:25:04.145 "ddgst": false 00:25:04.145 }, 00:25:04.145 "method": "bdev_nvme_attach_controller" 00:25:04.145 },{ 00:25:04.145 "params": { 00:25:04.145 "name": "Nvme2", 00:25:04.145 "trtype": "tcp", 00:25:04.145 "traddr": "10.0.0.2", 00:25:04.145 "adrfam": "ipv4", 00:25:04.145 "trsvcid": "4420", 00:25:04.146 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:04.146 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:04.146 "hdgst": false, 00:25:04.146 "ddgst": false 00:25:04.146 }, 00:25:04.146 "method": "bdev_nvme_attach_controller" 00:25:04.146 },{ 00:25:04.146 "params": { 00:25:04.146 "name": "Nvme3", 00:25:04.146 "trtype": "tcp", 00:25:04.146 "traddr": "10.0.0.2", 00:25:04.146 "adrfam": "ipv4", 00:25:04.146 "trsvcid": "4420", 00:25:04.146 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:04.146 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:04.146 "hdgst": false, 00:25:04.146 "ddgst": false 00:25:04.146 }, 00:25:04.146 "method": "bdev_nvme_attach_controller" 00:25:04.146 },{ 00:25:04.146 "params": { 00:25:04.146 "name": "Nvme4", 00:25:04.146 "trtype": "tcp", 00:25:04.146 "traddr": "10.0.0.2", 00:25:04.146 "adrfam": "ipv4", 00:25:04.146 "trsvcid": "4420", 00:25:04.146 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:04.146 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:04.146 "hdgst": false, 00:25:04.146 "ddgst": false 00:25:04.146 }, 00:25:04.146 "method": "bdev_nvme_attach_controller" 00:25:04.146 },{ 00:25:04.146 "params": { 00:25:04.146 "name": "Nvme5", 00:25:04.146 "trtype": "tcp", 00:25:04.146 "traddr": "10.0.0.2", 00:25:04.146 "adrfam": "ipv4", 00:25:04.146 "trsvcid": "4420", 00:25:04.146 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:04.146 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:04.146 "hdgst": false, 00:25:04.146 "ddgst": false 00:25:04.146 }, 00:25:04.146 "method": "bdev_nvme_attach_controller" 00:25:04.146 },{ 00:25:04.146 "params": { 00:25:04.146 "name": "Nvme6", 00:25:04.146 "trtype": "tcp", 00:25:04.146 "traddr": "10.0.0.2", 00:25:04.146 "adrfam": "ipv4", 00:25:04.146 "trsvcid": "4420", 00:25:04.146 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:04.146 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:04.146 "hdgst": false, 00:25:04.146 "ddgst": false 00:25:04.146 }, 00:25:04.146 "method": "bdev_nvme_attach_controller" 00:25:04.146 },{ 00:25:04.146 "params": { 00:25:04.146 "name": "Nvme7", 00:25:04.146 "trtype": "tcp", 00:25:04.146 "traddr": "10.0.0.2", 00:25:04.146 "adrfam": "ipv4", 00:25:04.146 "trsvcid": "4420", 00:25:04.146 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:04.146 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:04.146 "hdgst": false, 00:25:04.146 "ddgst": false 00:25:04.146 }, 00:25:04.146 "method": "bdev_nvme_attach_controller" 00:25:04.146 },{ 00:25:04.146 "params": { 00:25:04.146 "name": "Nvme8", 00:25:04.146 "trtype": "tcp", 00:25:04.146 "traddr": "10.0.0.2", 00:25:04.146 "adrfam": "ipv4", 00:25:04.146 "trsvcid": "4420", 00:25:04.146 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:04.146 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:04.146 "hdgst": false, 00:25:04.146 "ddgst": false 00:25:04.146 }, 00:25:04.146 "method": "bdev_nvme_attach_controller" 00:25:04.146 },{ 00:25:04.146 "params": { 00:25:04.146 "name": "Nvme9", 00:25:04.146 "trtype": "tcp", 00:25:04.146 "traddr": "10.0.0.2", 00:25:04.146 "adrfam": "ipv4", 00:25:04.146 "trsvcid": "4420", 00:25:04.146 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:04.146 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:04.146 "hdgst": false, 00:25:04.146 "ddgst": false 00:25:04.146 }, 00:25:04.146 "method": "bdev_nvme_attach_controller" 00:25:04.146 },{ 00:25:04.146 "params": { 00:25:04.146 "name": "Nvme10", 00:25:04.146 "trtype": "tcp", 00:25:04.146 "traddr": "10.0.0.2", 00:25:04.146 "adrfam": "ipv4", 00:25:04.146 "trsvcid": "4420", 00:25:04.146 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:04.146 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:04.146 "hdgst": false, 00:25:04.146 "ddgst": false 00:25:04.146 }, 00:25:04.146 "method": "bdev_nvme_attach_controller" 00:25:04.146 }' 00:25:04.146 [2024-11-26 04:36:43.227063] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:04.146 [2024-11-26 04:36:43.227151] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2990287 ] 00:25:04.146 EAL: No free 2048 kB hugepages reported on node 1 00:25:04.146 [2024-11-26 04:36:43.289959] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:04.404 [2024-11-26 04:36:43.375202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:05.786 Running I/O for 10 seconds... 00:25:05.786 04:36:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:05.786 04:36:45 -- common/autotest_common.sh@862 -- # return 0 00:25:05.786 04:36:45 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:05.786 04:36:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:05.786 04:36:45 -- common/autotest_common.sh@10 -- # set +x 00:25:06.044 04:36:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:06.044 04:36:45 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:06.044 04:36:45 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:06.044 04:36:45 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:06.044 04:36:45 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:06.044 04:36:45 -- target/shutdown.sh@57 -- # local ret=1 00:25:06.044 04:36:45 -- target/shutdown.sh@58 -- # local i 00:25:06.044 04:36:45 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:06.044 04:36:45 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:06.044 04:36:45 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:06.044 04:36:45 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:06.044 04:36:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:06.044 04:36:45 -- common/autotest_common.sh@10 -- # set +x 00:25:06.044 04:36:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:06.044 04:36:45 -- target/shutdown.sh@60 -- # read_io_count=3 00:25:06.044 04:36:45 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:25:06.044 04:36:45 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:06.317 04:36:45 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:06.317 04:36:45 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:06.317 04:36:45 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:06.317 04:36:45 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:06.317 04:36:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:06.317 04:36:45 -- common/autotest_common.sh@10 -- # set +x 00:25:06.317 04:36:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:06.317 04:36:45 -- target/shutdown.sh@60 -- # read_io_count=129 00:25:06.317 04:36:45 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:25:06.317 04:36:45 -- target/shutdown.sh@64 -- # ret=0 00:25:06.317 04:36:45 -- target/shutdown.sh@65 -- # break 00:25:06.317 04:36:45 -- target/shutdown.sh@69 -- # return 0 00:25:06.317 04:36:45 -- target/shutdown.sh@134 -- # killprocess 2990098 00:25:06.317 04:36:45 -- common/autotest_common.sh@936 -- # '[' -z 2990098 ']' 00:25:06.317 04:36:45 -- common/autotest_common.sh@940 -- # kill -0 2990098 00:25:06.317 04:36:45 -- common/autotest_common.sh@941 -- # uname 00:25:06.317 04:36:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:06.317 04:36:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2990098 00:25:06.317 04:36:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:06.317 04:36:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:06.317 04:36:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2990098' 00:25:06.317 killing process with pid 2990098 00:25:06.317 04:36:45 -- common/autotest_common.sh@955 -- # kill 2990098 00:25:06.317 04:36:45 -- common/autotest_common.sh@960 -- # wait 2990098 00:25:06.317 [2024-11-26 04:36:45.436100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436236] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.317 [2024-11-26 04:36:45.436626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.436947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d770 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.437997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.318 [2024-11-26 04:36:45.438199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.438418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15300 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.439679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e157b0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.440294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15c40 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.440327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e15c40 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.440695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e160f0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.440730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e160f0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.441282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e165a0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16a50 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.442993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.319 [2024-11-26 04:36:45.443200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.443507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e16ee0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.320 [2024-11-26 04:36:45.444730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.444995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.445006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.445018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.445030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.445042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.445068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.445080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d2c0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.471302] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471416] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471446] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471477] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x249e190 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.471572] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471609] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471649] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471681] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24aa4f0 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.471764] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471799] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471826] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471854] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x247f200 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.471925] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471961] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.471980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.471992] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.472005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.472019] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.472032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.472045] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x247d710 is same with the state(5) to be set 00:25:06.321 [2024-11-26 04:36:45.472088] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.472113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.472129] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.321 [2024-11-26 04:36:45.472142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.321 [2024-11-26 04:36:45.472157] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472184] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2452fe0 is same with the state(5) to be set 00:25:06.322 [2024-11-26 04:36:45.472254] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472289] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472316] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472343] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24a4c00 is same with the state(5) to be set 00:25:06.322 [2024-11-26 04:36:45.472416] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472452] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472479] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472506] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x25fc980 is same with the state(5) to be set 00:25:06.322 [2024-11-26 04:36:45.472581] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472616] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472643] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472677] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261a960 is same with the state(5) to be set 00:25:06.322 [2024-11-26 04:36:45.472758] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472794] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472820] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472847] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261a240 is same with the state(5) to be set 00:25:06.322 [2024-11-26 04:36:45.472921] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472956] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.472976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.472990] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.473002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.473016] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.322 [2024-11-26 04:36:45.473033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.473046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620e80 is same with the state(5) to be set 00:25:06.322 [2024-11-26 04:36:45.473120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.322 [2024-11-26 04:36:45.473141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.322 [2024-11-26 04:36:45.473170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.322 [2024-11-26 04:36:45.473186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.323 [2024-11-26 04:36:45.473881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.323 [2024-11-26 04:36:45.473898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.473911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.473927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.473940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.473957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.473981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.473996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.324 [2024-11-26 04:36:45.474510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.324 [2024-11-26 04:36:45.474526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.474979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.474993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2432ad0 is same with the state(5) to be set 00:25:06.325 [2024-11-26 04:36:45.475209] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2432ad0 was disconnected and freed. reset controller. 00:25:06.325 [2024-11-26 04:36:45.475361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.325 [2024-11-26 04:36:45.475683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.325 [2024-11-26 04:36:45.475707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.475723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.475737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.475753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.475767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.475782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.475795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.475810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.475824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.475839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.475853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.475868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.475882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.475897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.475910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.475925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.475938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.475954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.475978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.475993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.326 [2024-11-26 04:36:45.476581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.326 [2024-11-26 04:36:45.476594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.476624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.476653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.476698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.476728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.476757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.476785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.476819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.476848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.476877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.476906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.476934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.476973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.476988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x25d7290 is same with the state(5) to be set 00:25:06.327 [2024-11-26 04:36:45.477380] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x25d7290 was disconnected and freed. reset controller. 00:25:06.327 [2024-11-26 04:36:45.477438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.327 [2024-11-26 04:36:45.477642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.327 [2024-11-26 04:36:45.477662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.477681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.477706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.477722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.477737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.477751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.477767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.477780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.477795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.477809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.477825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.477838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.477853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.477867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.477883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.477896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.477911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.477924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.477939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.477953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.477968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.477985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.328 [2024-11-26 04:36:45.478602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.328 [2024-11-26 04:36:45.478617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.478639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.478655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.478669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.478699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.478716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.478732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.478746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.478761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.478777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.478792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.478810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.478826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.478840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.478855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.478869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.478884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.478898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.478913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.478927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.478943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.478959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.478975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.478988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.479003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.479017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.479032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.479046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.479061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.479075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.479090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.479103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.479119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.479133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.479148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.479161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.479185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.479200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.479216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.479231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.479246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.479260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.479275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.479288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.479303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.479317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.329 [2024-11-26 04:36:45.479333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.329 [2024-11-26 04:36:45.479347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2449e00 is same with the state(5) to be set 00:25:06.330 [2024-11-26 04:36:45.479460] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2449e00 was disconnected and freed. reset controller. 00:25:06.330 [2024-11-26 04:36:45.479515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.479979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.479997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.330 [2024-11-26 04:36:45.480448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.330 [2024-11-26 04:36:45.480463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.480984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.480998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.331 [2024-11-26 04:36:45.481401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.331 [2024-11-26 04:36:45.481415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x244b3e0 is same with the state(5) to be set 00:25:06.332 [2024-11-26 04:36:45.481529] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x244b3e0 was disconnected and freed. reset controller. 00:25:06.332 [2024-11-26 04:36:45.481585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.481974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.481988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.332 [2024-11-26 04:36:45.482482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.332 [2024-11-26 04:36:45.482495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.482974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.482990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.333 [2024-11-26 04:36:45.483427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.333 [2024-11-26 04:36:45.483441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.483456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.483470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.483485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.483499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.483512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2fab190 is same with the state(5) to be set 00:25:06.334 [2024-11-26 04:36:45.488864] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2fab190 was disconnected and freed. reset controller. 00:25:06.334 [2024-11-26 04:36:45.489359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x249e190 (9): Bad file descriptor 00:25:06.334 [2024-11-26 04:36:45.489409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24aa4f0 (9): Bad file descriptor 00:25:06.334 [2024-11-26 04:36:45.489440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x247f200 (9): Bad file descriptor 00:25:06.334 [2024-11-26 04:36:45.489469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x247d710 (9): Bad file descriptor 00:25:06.334 [2024-11-26 04:36:45.489494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2452fe0 (9): Bad file descriptor 00:25:06.334 [2024-11-26 04:36:45.489518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24a4c00 (9): Bad file descriptor 00:25:06.334 [2024-11-26 04:36:45.489541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x25fc980 (9): Bad file descriptor 00:25:06.334 [2024-11-26 04:36:45.489564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x261a960 (9): Bad file descriptor 00:25:06.334 [2024-11-26 04:36:45.489588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x261a240 (9): Bad file descriptor 00:25:06.334 [2024-11-26 04:36:45.489611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2620e80 (9): Bad file descriptor 00:25:06.334 [2024-11-26 04:36:45.496439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:06.334 [2024-11-26 04:36:45.496871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.496912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.496937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.496963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.496979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.496995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.334 [2024-11-26 04:36:45.497374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.334 [2024-11-26 04:36:45.497389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.497404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.497417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.497432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.497446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.497462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.497476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.497492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.497506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.497525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.497539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.497555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.497569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.497584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.497598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.497613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.497627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.497642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.497656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.497670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.497684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.497713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x314de00 is same with the state(5) to be set 00:25:06.335 [2024-11-26 04:36:45.497787] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x314de00 was disconnected and freed. reset controller. 00:25:06.335 [2024-11-26 04:36:45.498000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:06.335 [2024-11-26 04:36:45.498038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:06.335 [2024-11-26 04:36:45.498224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.335 [2024-11-26 04:36:45.498323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.335 [2024-11-26 04:36:45.498349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2452fe0 with addr=10.0.0.2, port=4420 00:25:06.335 [2024-11-26 04:36:45.498366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2452fe0 is same with the state(5) to be set 00:25:06.335 [2024-11-26 04:36:45.498704] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:06.335 [2024-11-26 04:36:45.500728] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:06.335 [2024-11-26 04:36:45.500808] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:06.335 [2024-11-26 04:36:45.500883] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:06.335 [2024-11-26 04:36:45.500922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:06.335 [2024-11-26 04:36:45.500961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:06.335 [2024-11-26 04:36:45.501104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.335 [2024-11-26 04:36:45.501213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.335 [2024-11-26 04:36:45.501240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x247d710 with addr=10.0.0.2, port=4420 00:25:06.335 [2024-11-26 04:36:45.501257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x247d710 is same with the state(5) to be set 00:25:06.335 [2024-11-26 04:36:45.501358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.335 [2024-11-26 04:36:45.501461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.335 [2024-11-26 04:36:45.501487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x25fc980 with addr=10.0.0.2, port=4420 00:25:06.335 [2024-11-26 04:36:45.501503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x25fc980 is same with the state(5) to be set 00:25:06.335 [2024-11-26 04:36:45.501529] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2452fe0 (9): Bad file descriptor 00:25:06.335 [2024-11-26 04:36:45.501587] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:06.335 [2024-11-26 04:36:45.501784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:06.335 [2024-11-26 04:36:45.501922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.335 [2024-11-26 04:36:45.502018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.335 [2024-11-26 04:36:45.502044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x249e190 with addr=10.0.0.2, port=4420 00:25:06.335 [2024-11-26 04:36:45.502060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x249e190 is same with the state(5) to be set 00:25:06.335 [2024-11-26 04:36:45.502151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.335 [2024-11-26 04:36:45.502249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.335 [2024-11-26 04:36:45.502275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x24aa4f0 with addr=10.0.0.2, port=4420 00:25:06.335 [2024-11-26 04:36:45.502291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24aa4f0 is same with the state(5) to be set 00:25:06.335 [2024-11-26 04:36:45.502309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x247d710 (9): Bad file descriptor 00:25:06.335 [2024-11-26 04:36:45.502329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x25fc980 (9): Bad file descriptor 00:25:06.335 [2024-11-26 04:36:45.502345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:06.335 [2024-11-26 04:36:45.502359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:06.335 [2024-11-26 04:36:45.502375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:06.335 [2024-11-26 04:36:45.502442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.502465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.502488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.502504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.502522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.502535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.502551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.502565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.502586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.502601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.502617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.502631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.502647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.502661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.502676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.335 [2024-11-26 04:36:45.502699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.335 [2024-11-26 04:36:45.502717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.502732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.502747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.502760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.502775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.502789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.502804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.502818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.502833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.502847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.502862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.502876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.502891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.502905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.502921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.502935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.502950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.502973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.502990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.336 [2024-11-26 04:36:45.503666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.336 [2024-11-26 04:36:45.503682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.503758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.503781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.503798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.503812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.503827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.503841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.503856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.503869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.503885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.503898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.503913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.503927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.503942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.503956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.503970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.503984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.504431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.504445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x25cae90 is same with the state(5) to be set 00:25:06.337 [2024-11-26 04:36:45.505975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.506001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.506023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.506044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.506060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.506080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.506096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.506110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.506126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.506139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.506154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.506168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.506183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.506197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.506212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.506226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.506241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.506254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.506270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.506284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.506300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.506313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.337 [2024-11-26 04:36:45.506328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.337 [2024-11-26 04:36:45.506342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.506974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.506989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.507002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.507018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.507031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.507047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.507060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.507075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.507089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.507104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.507118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.507134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.507147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.507162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.507175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.507194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.507209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.507224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.507237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.507252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.507266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.507282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.338 [2024-11-26 04:36:45.507295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.338 [2024-11-26 04:36:45.507310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.507880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.507894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x32f0ac0 is same with the state(5) to be set 00:25:06.339 [2024-11-26 04:36:45.509090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.509117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.509139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.509155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.509171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.509184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.509199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.509213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.509229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.509242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.509257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.509271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.509286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.509300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.509315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.509329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.509344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.509358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.509373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.509386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.509402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.509415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.509430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.339 [2024-11-26 04:36:45.509444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.339 [2024-11-26 04:36:45.509460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.509976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.509990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.510005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.510020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.510035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.510049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.510065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.510079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.510094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.510107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.510122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.510136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.510151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.510164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.510179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.510192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.340 [2024-11-26 04:36:45.510207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.340 [2024-11-26 04:36:45.510221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.510974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.510989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.511003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x242ab40 is same with the state(5) to be set 00:25:06.341 [2024-11-26 04:36:45.513199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.513228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.513251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.513267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.513282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.513296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.513311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.513325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.341 [2024-11-26 04:36:45.513340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.341 [2024-11-26 04:36:45.513353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.513964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.513984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.514000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.342 [2024-11-26 04:36:45.514014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.342 [2024-11-26 04:36:45.514029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.372 [2024-11-26 04:36:45.514663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.372 [2024-11-26 04:36:45.514681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.514706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.514723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.514737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.514751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.514765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.514780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.514794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.514809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.514823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.514838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.514852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.514867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.514880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.514895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.514909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.514924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.514938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.514953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.514978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.514993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.515007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.515022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.515035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.515051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.515064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.515083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.515098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.515113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.515127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.515143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:06.373 [2024-11-26 04:36:45.515157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.373 [2024-11-26 04:36:45.515171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x242c080 is same with the state(5) to be set 00:25:06.373 [2024-11-26 04:36:45.517345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.373 [2024-11-26 04:36:45.517389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:06.373 [2024-11-26 04:36:45.517411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:06.373 [2024-11-26 04:36:45.517430] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:06.634 task offset: 24320 on job bdev=Nvme1n1 fails 00:25:06.634 00:25:06.634 Latency(us) 00:25:06.634 [2024-11-26T03:36:45.860Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme1n1 ended in about 0.49 seconds with error 00:25:06.634 Verification LBA range: start 0x0 length 0x400 00:25:06.634 Nvme1n1 : 0.49 332.79 20.80 129.87 0.00 137014.95 47962.64 121168.78 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme2n1 ended in about 0.51 seconds with error 00:25:06.634 Verification LBA range: start 0x0 length 0x400 00:25:06.634 Nvme2n1 : 0.51 248.25 15.52 126.10 0.00 166852.36 104080.88 144470.47 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme3n1 ended in about 0.49 seconds with error 00:25:06.634 Verification LBA range: start 0x0 length 0x400 00:25:06.634 Nvme3n1 : 0.49 331.99 20.75 129.56 0.00 133026.58 41943.04 118838.61 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme4n1 ended in about 0.50 seconds with error 00:25:06.634 Verification LBA range: start 0x0 length 0x400 00:25:06.634 Nvme4n1 : 0.50 331.26 20.70 129.27 0.00 131262.77 35923.44 117285.17 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme5n1 ended in about 0.50 seconds with error 00:25:06.634 Verification LBA range: start 0x0 length 0x400 00:25:06.634 Nvme5n1 : 0.50 330.54 20.66 128.99 0.00 129441.90 29709.65 117285.17 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme6n1 ended in about 0.50 seconds with error 00:25:06.634 Verification LBA range: start 0x0 length 0x400 00:25:06.634 Nvme6n1 : 0.50 329.81 20.61 128.71 0.00 127646.80 23592.96 118061.89 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme7n1 ended in about 0.50 seconds with error 00:25:06.634 Verification LBA range: start 0x0 length 0x400 00:25:06.634 Nvme7n1 : 0.50 326.26 20.39 51.72 0.00 151714.69 3883.61 135149.80 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme8n1 ended in about 0.51 seconds with error 00:25:06.634 Verification LBA range: start 0x0 length 0x400 00:25:06.634 Nvme8n1 : 0.51 246.59 15.41 125.25 0.00 152826.37 99420.54 125052.40 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme9n1 ended in about 0.51 seconds with error 00:25:06.634 Verification LBA range: start 0x0 length 0x400 00:25:06.634 Nvme9n1 : 0.51 245.10 15.32 124.50 0.00 151362.87 102527.43 125829.12 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:06.634 [2024-11-26T03:36:45.860Z] Job: Nvme10n1 ended in about 0.52 seconds with error 00:25:06.634 Verification LBA range: start 0x0 length 0x400 00:25:06.634 Nvme10n1 : 0.52 243.14 15.20 123.50 0.00 150443.06 94371.84 126605.84 00:25:06.634 [2024-11-26T03:36:45.860Z] =================================================================================================================== 00:25:06.634 [2024-11-26T03:36:45.860Z] Total : 2965.74 185.36 1197.47 0.00 142115.54 3883.61 144470.47 00:25:06.634 [2024-11-26 04:36:45.546747] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:06.634 [2024-11-26 04:36:45.547110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.634 [2024-11-26 04:36:45.547233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.634 [2024-11-26 04:36:45.547260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2620e80 with addr=10.0.0.2, port=4420 00:25:06.634 [2024-11-26 04:36:45.547281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2620e80 is same with the state(5) to be set 00:25:06.634 [2024-11-26 04:36:45.547308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x249e190 (9): Bad file descriptor 00:25:06.634 [2024-11-26 04:36:45.547332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24aa4f0 (9): Bad file descriptor 00:25:06.634 [2024-11-26 04:36:45.547350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:06.634 [2024-11-26 04:36:45.547364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:06.634 [2024-11-26 04:36:45.547380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:06.634 [2024-11-26 04:36:45.547407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:06.634 [2024-11-26 04:36:45.547422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:06.634 [2024-11-26 04:36:45.547436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:06.634 [2024-11-26 04:36:45.547503] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:06.634 [2024-11-26 04:36:45.547531] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:06.634 [2024-11-26 04:36:45.547555] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:06.634 [2024-11-26 04:36:45.547575] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:06.634 [2024-11-26 04:36:45.547596] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:06.634 [2024-11-26 04:36:45.547615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2620e80 (9): Bad file descriptor 00:25:06.634 [2024-11-26 04:36:45.547765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:06.634 [2024-11-26 04:36:45.547807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.634 [2024-11-26 04:36:45.547824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.634 [2024-11-26 04:36:45.547978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.634 [2024-11-26 04:36:45.548096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.634 [2024-11-26 04:36:45.548130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x247f200 with addr=10.0.0.2, port=4420 00:25:06.634 [2024-11-26 04:36:45.548148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x247f200 is same with the state(5) to be set 00:25:06.634 [2024-11-26 04:36:45.548236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.635 [2024-11-26 04:36:45.548332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.635 [2024-11-26 04:36:45.548359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x261a960 with addr=10.0.0.2, port=4420 00:25:06.635 [2024-11-26 04:36:45.548375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261a960 is same with the state(5) to be set 00:25:06.635 [2024-11-26 04:36:45.548461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.635 [2024-11-26 04:36:45.548569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.635 [2024-11-26 04:36:45.548595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x24a4c00 with addr=10.0.0.2, port=4420 00:25:06.635 [2024-11-26 04:36:45.548611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24a4c00 is same with the state(5) to be set 00:25:06.635 [2024-11-26 04:36:45.548627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:06.635 [2024-11-26 04:36:45.548641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:06.635 [2024-11-26 04:36:45.548655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:06.635 [2024-11-26 04:36:45.548675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:06.635 [2024-11-26 04:36:45.548699] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:06.635 [2024-11-26 04:36:45.548714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:06.635 [2024-11-26 04:36:45.548754] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:06.635 [2024-11-26 04:36:45.548793] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:06.635 [2024-11-26 04:36:45.548814] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:06.635 [2024-11-26 04:36:45.548833] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:06.635 [2024-11-26 04:36:45.549914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:06.635 [2024-11-26 04:36:45.549966] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.635 [2024-11-26 04:36:45.549983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.635 [2024-11-26 04:36:45.550106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.635 [2024-11-26 04:36:45.550213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.635 [2024-11-26 04:36:45.550239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x261a240 with addr=10.0.0.2, port=4420 00:25:06.635 [2024-11-26 04:36:45.550255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x261a240 is same with the state(5) to be set 00:25:06.635 [2024-11-26 04:36:45.550274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x247f200 (9): Bad file descriptor 00:25:06.635 [2024-11-26 04:36:45.550293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x261a960 (9): Bad file descriptor 00:25:06.635 [2024-11-26 04:36:45.550312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24a4c00 (9): Bad file descriptor 00:25:06.635 [2024-11-26 04:36:45.550327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:06.635 [2024-11-26 04:36:45.550345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:06.635 [2024-11-26 04:36:45.550360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:06.635 [2024-11-26 04:36:45.550438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:06.635 [2024-11-26 04:36:45.550464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:06.635 [2024-11-26 04:36:45.550481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.635 [2024-11-26 04:36:45.550590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.635 [2024-11-26 04:36:45.550696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.635 [2024-11-26 04:36:45.550734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2452fe0 with addr=10.0.0.2, port=4420 00:25:06.635 [2024-11-26 04:36:45.550749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2452fe0 is same with the state(5) to be set 00:25:06.635 [2024-11-26 04:36:45.550768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x261a240 (9): Bad file descriptor 00:25:06.635 [2024-11-26 04:36:45.550785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:06.635 [2024-11-26 04:36:45.550798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:06.635 [2024-11-26 04:36:45.550811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:06.635 [2024-11-26 04:36:45.550828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:06.635 [2024-11-26 04:36:45.550843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:06.635 [2024-11-26 04:36:45.550856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:06.635 [2024-11-26 04:36:45.550872] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:06.635 [2024-11-26 04:36:45.550886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:06.635 [2024-11-26 04:36:45.550899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:06.635 [2024-11-26 04:36:45.550964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.635 [2024-11-26 04:36:45.550995] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.635 [2024-11-26 04:36:45.551008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.635 [2024-11-26 04:36:45.551097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.635 [2024-11-26 04:36:45.551248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.635 [2024-11-26 04:36:45.551273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x25fc980 with addr=10.0.0.2, port=4420 00:25:06.635 [2024-11-26 04:36:45.551289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x25fc980 is same with the state(5) to be set 00:25:06.635 [2024-11-26 04:36:45.551384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.635 [2024-11-26 04:36:45.551588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:06.635 [2024-11-26 04:36:45.551613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x247d710 with addr=10.0.0.2, port=4420 00:25:06.635 [2024-11-26 04:36:45.551629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x247d710 is same with the state(5) to be set 00:25:06.635 [2024-11-26 04:36:45.551647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2452fe0 (9): Bad file descriptor 00:25:06.635 [2024-11-26 04:36:45.551669] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:06.635 [2024-11-26 04:36:45.551683] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:06.635 [2024-11-26 04:36:45.551706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:06.635 [2024-11-26 04:36:45.551749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.635 [2024-11-26 04:36:45.551772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x25fc980 (9): Bad file descriptor 00:25:06.635 [2024-11-26 04:36:45.551792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x247d710 (9): Bad file descriptor 00:25:06.635 [2024-11-26 04:36:45.551809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:06.635 [2024-11-26 04:36:45.551821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:06.635 [2024-11-26 04:36:45.551834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:06.635 [2024-11-26 04:36:45.551870] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.635 [2024-11-26 04:36:45.551890] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:06.635 [2024-11-26 04:36:45.551903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:06.635 [2024-11-26 04:36:45.551916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:06.635 [2024-11-26 04:36:45.551932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:06.635 [2024-11-26 04:36:45.551946] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:06.635 [2024-11-26 04:36:45.551959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:06.635 [2024-11-26 04:36:45.552022] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.635 [2024-11-26 04:36:45.552043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:06.896 04:36:45 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:06.896 04:36:45 -- target/shutdown.sh@138 -- # sleep 1 00:25:07.839 04:36:46 -- target/shutdown.sh@141 -- # kill -9 2990287 00:25:07.839 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (2990287) - No such process 00:25:07.839 04:36:46 -- target/shutdown.sh@141 -- # true 00:25:07.839 04:36:46 -- target/shutdown.sh@143 -- # stoptarget 00:25:07.839 04:36:46 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:07.839 04:36:46 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:07.839 04:36:46 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:07.839 04:36:46 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:07.839 04:36:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:07.839 04:36:46 -- nvmf/common.sh@116 -- # sync 00:25:07.839 04:36:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:07.839 04:36:46 -- nvmf/common.sh@119 -- # set +e 00:25:07.839 04:36:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:07.839 04:36:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:07.839 rmmod nvme_tcp 00:25:07.839 rmmod nvme_fabrics 00:25:07.839 rmmod nvme_keyring 00:25:07.839 04:36:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:07.839 04:36:47 -- nvmf/common.sh@123 -- # set -e 00:25:07.839 04:36:47 -- nvmf/common.sh@124 -- # return 0 00:25:07.839 04:36:47 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:07.839 04:36:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:07.839 04:36:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:07.839 04:36:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:07.839 04:36:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:07.839 04:36:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:07.839 04:36:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:07.839 04:36:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:07.839 04:36:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:10.381 04:36:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:10.381 00:25:10.381 real 0m7.742s 00:25:10.381 user 0m19.642s 00:25:10.381 sys 0m1.308s 00:25:10.381 04:36:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:10.381 04:36:49 -- common/autotest_common.sh@10 -- # set +x 00:25:10.381 ************************************ 00:25:10.381 END TEST nvmf_shutdown_tc3 00:25:10.381 ************************************ 00:25:10.381 04:36:49 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:10.381 00:25:10.381 real 0m28.378s 00:25:10.381 user 1m21.982s 00:25:10.381 sys 0m6.116s 00:25:10.381 04:36:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:10.381 04:36:49 -- common/autotest_common.sh@10 -- # set +x 00:25:10.381 ************************************ 00:25:10.381 END TEST nvmf_shutdown 00:25:10.381 ************************************ 00:25:10.381 04:36:49 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:10.381 04:36:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:10.381 04:36:49 -- common/autotest_common.sh@10 -- # set +x 00:25:10.381 04:36:49 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:10.381 04:36:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:10.381 04:36:49 -- common/autotest_common.sh@10 -- # set +x 00:25:10.381 04:36:49 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:10.381 04:36:49 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:10.381 04:36:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:10.381 04:36:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:10.381 04:36:49 -- common/autotest_common.sh@10 -- # set +x 00:25:10.381 ************************************ 00:25:10.381 START TEST nvmf_multicontroller 00:25:10.381 ************************************ 00:25:10.381 04:36:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:10.381 * Looking for test storage... 00:25:10.381 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:10.381 04:36:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:10.381 04:36:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:10.381 04:36:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:10.381 04:36:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:10.381 04:36:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:10.381 04:36:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:10.381 04:36:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:10.381 04:36:49 -- scripts/common.sh@335 -- # IFS=.-: 00:25:10.381 04:36:49 -- scripts/common.sh@335 -- # read -ra ver1 00:25:10.381 04:36:49 -- scripts/common.sh@336 -- # IFS=.-: 00:25:10.381 04:36:49 -- scripts/common.sh@336 -- # read -ra ver2 00:25:10.381 04:36:49 -- scripts/common.sh@337 -- # local 'op=<' 00:25:10.381 04:36:49 -- scripts/common.sh@339 -- # ver1_l=2 00:25:10.381 04:36:49 -- scripts/common.sh@340 -- # ver2_l=1 00:25:10.381 04:36:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:10.381 04:36:49 -- scripts/common.sh@343 -- # case "$op" in 00:25:10.381 04:36:49 -- scripts/common.sh@344 -- # : 1 00:25:10.381 04:36:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:10.381 04:36:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:10.381 04:36:49 -- scripts/common.sh@364 -- # decimal 1 00:25:10.381 04:36:49 -- scripts/common.sh@352 -- # local d=1 00:25:10.381 04:36:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:10.381 04:36:49 -- scripts/common.sh@354 -- # echo 1 00:25:10.381 04:36:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:10.381 04:36:49 -- scripts/common.sh@365 -- # decimal 2 00:25:10.381 04:36:49 -- scripts/common.sh@352 -- # local d=2 00:25:10.381 04:36:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:10.381 04:36:49 -- scripts/common.sh@354 -- # echo 2 00:25:10.381 04:36:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:10.381 04:36:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:10.381 04:36:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:10.381 04:36:49 -- scripts/common.sh@367 -- # return 0 00:25:10.381 04:36:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:10.381 04:36:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:10.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:10.381 --rc genhtml_branch_coverage=1 00:25:10.381 --rc genhtml_function_coverage=1 00:25:10.381 --rc genhtml_legend=1 00:25:10.381 --rc geninfo_all_blocks=1 00:25:10.381 --rc geninfo_unexecuted_blocks=1 00:25:10.381 00:25:10.381 ' 00:25:10.381 04:36:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:10.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:10.381 --rc genhtml_branch_coverage=1 00:25:10.381 --rc genhtml_function_coverage=1 00:25:10.381 --rc genhtml_legend=1 00:25:10.381 --rc geninfo_all_blocks=1 00:25:10.381 --rc geninfo_unexecuted_blocks=1 00:25:10.381 00:25:10.381 ' 00:25:10.381 04:36:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:10.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:10.382 --rc genhtml_branch_coverage=1 00:25:10.382 --rc genhtml_function_coverage=1 00:25:10.382 --rc genhtml_legend=1 00:25:10.382 --rc geninfo_all_blocks=1 00:25:10.382 --rc geninfo_unexecuted_blocks=1 00:25:10.382 00:25:10.382 ' 00:25:10.382 04:36:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:10.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:10.382 --rc genhtml_branch_coverage=1 00:25:10.382 --rc genhtml_function_coverage=1 00:25:10.382 --rc genhtml_legend=1 00:25:10.382 --rc geninfo_all_blocks=1 00:25:10.382 --rc geninfo_unexecuted_blocks=1 00:25:10.382 00:25:10.382 ' 00:25:10.382 04:36:49 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:10.382 04:36:49 -- nvmf/common.sh@7 -- # uname -s 00:25:10.382 04:36:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:10.382 04:36:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:10.382 04:36:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:10.382 04:36:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:10.382 04:36:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:10.382 04:36:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:10.382 04:36:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:10.382 04:36:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:10.382 04:36:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:10.382 04:36:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:10.382 04:36:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:10.382 04:36:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:10.382 04:36:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:10.382 04:36:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:10.382 04:36:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:10.382 04:36:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:10.382 04:36:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:10.382 04:36:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:10.382 04:36:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:10.382 04:36:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:10.382 04:36:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:10.382 04:36:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:10.382 04:36:49 -- paths/export.sh@5 -- # export PATH 00:25:10.382 04:36:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:10.382 04:36:49 -- nvmf/common.sh@46 -- # : 0 00:25:10.382 04:36:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:10.382 04:36:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:10.382 04:36:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:10.382 04:36:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:10.382 04:36:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:10.382 04:36:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:10.382 04:36:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:10.382 04:36:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:10.382 04:36:49 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:10.382 04:36:49 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:10.382 04:36:49 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:10.382 04:36:49 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:10.382 04:36:49 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:10.382 04:36:49 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:10.382 04:36:49 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:10.382 04:36:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:10.382 04:36:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:10.382 04:36:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:10.382 04:36:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:10.382 04:36:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:10.382 04:36:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:10.382 04:36:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:10.382 04:36:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:10.382 04:36:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:10.382 04:36:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:10.382 04:36:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:10.382 04:36:49 -- common/autotest_common.sh@10 -- # set +x 00:25:12.290 04:36:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:12.290 04:36:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:12.290 04:36:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:12.290 04:36:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:12.290 04:36:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:12.290 04:36:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:12.290 04:36:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:12.290 04:36:51 -- nvmf/common.sh@294 -- # net_devs=() 00:25:12.290 04:36:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:12.290 04:36:51 -- nvmf/common.sh@295 -- # e810=() 00:25:12.290 04:36:51 -- nvmf/common.sh@295 -- # local -ga e810 00:25:12.290 04:36:51 -- nvmf/common.sh@296 -- # x722=() 00:25:12.290 04:36:51 -- nvmf/common.sh@296 -- # local -ga x722 00:25:12.290 04:36:51 -- nvmf/common.sh@297 -- # mlx=() 00:25:12.290 04:36:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:12.290 04:36:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:12.290 04:36:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:12.290 04:36:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:12.290 04:36:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:12.290 04:36:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:12.290 04:36:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:12.290 04:36:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:12.290 04:36:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:12.290 04:36:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:12.290 04:36:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:12.290 04:36:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:12.290 04:36:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:12.290 04:36:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:12.290 04:36:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:12.290 04:36:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:12.290 04:36:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:12.290 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:12.290 04:36:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:12.290 04:36:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:12.290 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:12.290 04:36:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:12.290 04:36:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:12.290 04:36:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:12.290 04:36:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:12.290 04:36:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:12.290 04:36:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:12.290 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:12.290 04:36:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:12.290 04:36:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:12.290 04:36:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:12.290 04:36:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:12.290 04:36:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:12.290 04:36:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:12.290 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:12.290 04:36:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:12.290 04:36:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:12.290 04:36:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:12.290 04:36:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:12.290 04:36:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:12.290 04:36:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:12.290 04:36:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:12.290 04:36:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:12.290 04:36:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:12.290 04:36:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:12.290 04:36:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:12.290 04:36:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:12.290 04:36:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:12.290 04:36:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:12.290 04:36:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:12.290 04:36:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:12.290 04:36:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:12.290 04:36:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:12.290 04:36:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:12.290 04:36:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:12.290 04:36:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:12.290 04:36:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:12.290 04:36:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:12.551 04:36:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:12.551 04:36:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:12.551 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:12.551 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.241 ms 00:25:12.551 00:25:12.551 --- 10.0.0.2 ping statistics --- 00:25:12.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:12.551 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:25:12.551 04:36:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:12.551 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:12.551 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:25:12.551 00:25:12.551 --- 10.0.0.1 ping statistics --- 00:25:12.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:12.551 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:25:12.551 04:36:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:12.551 04:36:51 -- nvmf/common.sh@410 -- # return 0 00:25:12.551 04:36:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:12.551 04:36:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:12.551 04:36:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:12.551 04:36:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:12.551 04:36:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:12.551 04:36:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:12.551 04:36:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:12.551 04:36:51 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:12.551 04:36:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:12.551 04:36:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:12.551 04:36:51 -- common/autotest_common.sh@10 -- # set +x 00:25:12.551 04:36:51 -- nvmf/common.sh@469 -- # nvmfpid=2992832 00:25:12.551 04:36:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:12.551 04:36:51 -- nvmf/common.sh@470 -- # waitforlisten 2992832 00:25:12.551 04:36:51 -- common/autotest_common.sh@829 -- # '[' -z 2992832 ']' 00:25:12.551 04:36:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:12.551 04:36:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:12.551 04:36:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:12.551 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:12.551 04:36:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:12.551 04:36:51 -- common/autotest_common.sh@10 -- # set +x 00:25:12.551 [2024-11-26 04:36:51.599767] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:12.551 [2024-11-26 04:36:51.599846] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:12.551 EAL: No free 2048 kB hugepages reported on node 1 00:25:12.551 [2024-11-26 04:36:51.669041] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:12.551 [2024-11-26 04:36:51.762144] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:12.551 [2024-11-26 04:36:51.762316] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:12.551 [2024-11-26 04:36:51.762334] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:12.551 [2024-11-26 04:36:51.762346] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:12.551 [2024-11-26 04:36:51.762402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:12.551 [2024-11-26 04:36:51.762464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:12.551 [2024-11-26 04:36:51.762467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:13.485 04:36:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:13.485 04:36:52 -- common/autotest_common.sh@862 -- # return 0 00:25:13.485 04:36:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:13.485 04:36:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:13.485 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:13.485 04:36:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:13.485 04:36:52 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:13.485 04:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.485 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:13.485 [2024-11-26 04:36:52.622948] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:13.485 04:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.485 04:36:52 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:13.485 04:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.485 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:13.485 Malloc0 00:25:13.485 04:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.485 04:36:52 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:13.486 04:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.486 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:13.486 04:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.486 04:36:52 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:13.486 04:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.486 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:13.486 04:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.486 04:36:52 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:13.486 04:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.486 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:13.486 [2024-11-26 04:36:52.684370] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:13.486 04:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.486 04:36:52 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:13.486 04:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.486 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:13.486 [2024-11-26 04:36:52.692267] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:13.486 04:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.486 04:36:52 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:13.486 04:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.486 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:13.743 Malloc1 00:25:13.743 04:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.743 04:36:52 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:13.743 04:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.743 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:13.743 04:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.743 04:36:52 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:13.743 04:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.743 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:13.743 04:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.743 04:36:52 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:13.743 04:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.743 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:13.743 04:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.743 04:36:52 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:13.743 04:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.743 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:13.743 04:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.743 04:36:52 -- host/multicontroller.sh@44 -- # bdevperf_pid=2992996 00:25:13.743 04:36:52 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:13.743 04:36:52 -- host/multicontroller.sh@47 -- # waitforlisten 2992996 /var/tmp/bdevperf.sock 00:25:13.743 04:36:52 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:13.743 04:36:52 -- common/autotest_common.sh@829 -- # '[' -z 2992996 ']' 00:25:13.743 04:36:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:13.743 04:36:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:13.743 04:36:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:13.743 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:13.743 04:36:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:13.744 04:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:14.679 04:36:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:14.679 04:36:53 -- common/autotest_common.sh@862 -- # return 0 00:25:14.679 04:36:53 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:14.680 04:36:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:14.680 04:36:53 -- common/autotest_common.sh@10 -- # set +x 00:25:14.938 NVMe0n1 00:25:14.938 04:36:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:14.938 04:36:54 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:14.938 04:36:54 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:14.938 04:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:14.938 04:36:54 -- common/autotest_common.sh@10 -- # set +x 00:25:14.938 04:36:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:14.938 1 00:25:14.938 04:36:54 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:14.938 04:36:54 -- common/autotest_common.sh@650 -- # local es=0 00:25:14.938 04:36:54 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:14.938 04:36:54 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:14.938 04:36:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:14.938 04:36:54 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:14.938 04:36:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:14.938 04:36:54 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:14.938 04:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:14.938 04:36:54 -- common/autotest_common.sh@10 -- # set +x 00:25:14.938 request: 00:25:14.938 { 00:25:14.938 "name": "NVMe0", 00:25:14.938 "trtype": "tcp", 00:25:14.938 "traddr": "10.0.0.2", 00:25:14.938 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:14.938 "hostaddr": "10.0.0.2", 00:25:14.938 "hostsvcid": "60000", 00:25:14.938 "adrfam": "ipv4", 00:25:14.938 "trsvcid": "4420", 00:25:14.938 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:14.938 "method": "bdev_nvme_attach_controller", 00:25:14.938 "req_id": 1 00:25:14.938 } 00:25:14.938 Got JSON-RPC error response 00:25:14.938 response: 00:25:14.938 { 00:25:14.938 "code": -114, 00:25:14.938 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:14.938 } 00:25:14.938 04:36:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:14.938 04:36:54 -- common/autotest_common.sh@653 -- # es=1 00:25:14.938 04:36:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:14.938 04:36:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:14.938 04:36:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:14.938 04:36:54 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:14.938 04:36:54 -- common/autotest_common.sh@650 -- # local es=0 00:25:14.938 04:36:54 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:14.938 04:36:54 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:14.938 04:36:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:14.939 04:36:54 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:14.939 04:36:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:14.939 04:36:54 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:14.939 04:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:14.939 04:36:54 -- common/autotest_common.sh@10 -- # set +x 00:25:14.939 request: 00:25:14.939 { 00:25:14.939 "name": "NVMe0", 00:25:14.939 "trtype": "tcp", 00:25:14.939 "traddr": "10.0.0.2", 00:25:14.939 "hostaddr": "10.0.0.2", 00:25:14.939 "hostsvcid": "60000", 00:25:14.939 "adrfam": "ipv4", 00:25:14.939 "trsvcid": "4420", 00:25:14.939 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:14.939 "method": "bdev_nvme_attach_controller", 00:25:14.939 "req_id": 1 00:25:14.939 } 00:25:14.939 Got JSON-RPC error response 00:25:14.939 response: 00:25:14.939 { 00:25:14.939 "code": -114, 00:25:14.939 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:14.939 } 00:25:14.939 04:36:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:14.939 04:36:54 -- common/autotest_common.sh@653 -- # es=1 00:25:14.939 04:36:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:14.939 04:36:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:14.939 04:36:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:14.939 04:36:54 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:14.939 04:36:54 -- common/autotest_common.sh@650 -- # local es=0 00:25:14.939 04:36:54 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:14.939 04:36:54 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:14.939 04:36:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:14.939 04:36:54 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:14.939 04:36:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:14.939 04:36:54 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:14.939 04:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:14.939 04:36:54 -- common/autotest_common.sh@10 -- # set +x 00:25:14.939 request: 00:25:14.939 { 00:25:14.939 "name": "NVMe0", 00:25:14.939 "trtype": "tcp", 00:25:14.939 "traddr": "10.0.0.2", 00:25:14.939 "hostaddr": "10.0.0.2", 00:25:14.939 "hostsvcid": "60000", 00:25:14.939 "adrfam": "ipv4", 00:25:14.939 "trsvcid": "4420", 00:25:14.939 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:14.939 "multipath": "disable", 00:25:14.939 "method": "bdev_nvme_attach_controller", 00:25:14.939 "req_id": 1 00:25:14.939 } 00:25:14.939 Got JSON-RPC error response 00:25:14.939 response: 00:25:14.939 { 00:25:14.939 "code": -114, 00:25:14.939 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:14.939 } 00:25:14.939 04:36:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:14.939 04:36:54 -- common/autotest_common.sh@653 -- # es=1 00:25:14.939 04:36:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:14.939 04:36:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:14.939 04:36:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:14.939 04:36:54 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:14.939 04:36:54 -- common/autotest_common.sh@650 -- # local es=0 00:25:14.939 04:36:54 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:14.939 04:36:54 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:14.939 04:36:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:14.939 04:36:54 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:14.939 04:36:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:14.939 04:36:54 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:14.939 04:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:14.939 04:36:54 -- common/autotest_common.sh@10 -- # set +x 00:25:14.939 request: 00:25:14.939 { 00:25:14.939 "name": "NVMe0", 00:25:14.939 "trtype": "tcp", 00:25:14.939 "traddr": "10.0.0.2", 00:25:14.939 "hostaddr": "10.0.0.2", 00:25:14.939 "hostsvcid": "60000", 00:25:14.939 "adrfam": "ipv4", 00:25:14.939 "trsvcid": "4420", 00:25:14.939 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:14.939 "multipath": "failover", 00:25:14.939 "method": "bdev_nvme_attach_controller", 00:25:14.939 "req_id": 1 00:25:14.939 } 00:25:14.939 Got JSON-RPC error response 00:25:14.939 response: 00:25:14.939 { 00:25:14.939 "code": -114, 00:25:14.939 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:14.939 } 00:25:14.939 04:36:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:14.939 04:36:54 -- common/autotest_common.sh@653 -- # es=1 00:25:14.939 04:36:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:14.939 04:36:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:14.939 04:36:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:14.939 04:36:54 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:14.939 04:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:14.939 04:36:54 -- common/autotest_common.sh@10 -- # set +x 00:25:15.197 00:25:15.197 04:36:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.197 04:36:54 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:15.197 04:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.197 04:36:54 -- common/autotest_common.sh@10 -- # set +x 00:25:15.197 04:36:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.197 04:36:54 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:15.197 04:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.197 04:36:54 -- common/autotest_common.sh@10 -- # set +x 00:25:15.457 00:25:15.457 04:36:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.457 04:36:54 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:15.457 04:36:54 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:15.457 04:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.457 04:36:54 -- common/autotest_common.sh@10 -- # set +x 00:25:15.457 04:36:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.457 04:36:54 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:15.457 04:36:54 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:16.837 0 00:25:16.837 04:36:55 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:16.837 04:36:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:16.837 04:36:55 -- common/autotest_common.sh@10 -- # set +x 00:25:16.837 04:36:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:16.837 04:36:55 -- host/multicontroller.sh@100 -- # killprocess 2992996 00:25:16.837 04:36:55 -- common/autotest_common.sh@936 -- # '[' -z 2992996 ']' 00:25:16.837 04:36:55 -- common/autotest_common.sh@940 -- # kill -0 2992996 00:25:16.837 04:36:55 -- common/autotest_common.sh@941 -- # uname 00:25:16.837 04:36:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:16.837 04:36:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2992996 00:25:16.837 04:36:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:16.837 04:36:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:16.837 04:36:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2992996' 00:25:16.837 killing process with pid 2992996 00:25:16.837 04:36:55 -- common/autotest_common.sh@955 -- # kill 2992996 00:25:16.837 04:36:55 -- common/autotest_common.sh@960 -- # wait 2992996 00:25:16.837 04:36:55 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:16.837 04:36:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:16.837 04:36:55 -- common/autotest_common.sh@10 -- # set +x 00:25:16.837 04:36:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:16.837 04:36:55 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:16.837 04:36:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:16.837 04:36:55 -- common/autotest_common.sh@10 -- # set +x 00:25:16.837 04:36:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:16.837 04:36:55 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:16.837 04:36:55 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:16.837 04:36:55 -- common/autotest_common.sh@1607 -- # read -r file 00:25:16.837 04:36:55 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:16.837 04:36:55 -- common/autotest_common.sh@1606 -- # sort -u 00:25:16.837 04:36:55 -- common/autotest_common.sh@1608 -- # cat 00:25:16.837 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:16.837 [2024-11-26 04:36:52.787773] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:16.837 [2024-11-26 04:36:52.787868] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2992996 ] 00:25:16.837 EAL: No free 2048 kB hugepages reported on node 1 00:25:16.837 [2024-11-26 04:36:52.846519] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:16.837 [2024-11-26 04:36:52.929948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:16.837 [2024-11-26 04:36:54.504643] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 2e5c30d2-1a55-4838-a919-6280f8a2ffb7 already exists 00:25:16.837 [2024-11-26 04:36:54.504692] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:2e5c30d2-1a55-4838-a919-6280f8a2ffb7 alias for bdev NVMe1n1 00:25:16.837 [2024-11-26 04:36:54.504728] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:16.837 Running I/O for 1 seconds... 00:25:16.837 00:25:16.837 Latency(us) 00:25:16.837 [2024-11-26T03:36:56.063Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:16.837 [2024-11-26T03:36:56.063Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:16.837 NVMe0n1 : 1.01 19746.34 77.13 0.00 0.00 6472.72 4004.98 11942.12 00:25:16.837 [2024-11-26T03:36:56.063Z] =================================================================================================================== 00:25:16.837 [2024-11-26T03:36:56.063Z] Total : 19746.34 77.13 0.00 0.00 6472.72 4004.98 11942.12 00:25:16.837 Received shutdown signal, test time was about 1.000000 seconds 00:25:16.837 00:25:16.837 Latency(us) 00:25:16.837 [2024-11-26T03:36:56.063Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:16.837 [2024-11-26T03:36:56.063Z] =================================================================================================================== 00:25:16.837 [2024-11-26T03:36:56.063Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:16.838 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:16.838 04:36:55 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:16.838 04:36:55 -- common/autotest_common.sh@1607 -- # read -r file 00:25:16.838 04:36:55 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:16.838 04:36:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:16.838 04:36:55 -- nvmf/common.sh@116 -- # sync 00:25:16.838 04:36:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:16.838 04:36:55 -- nvmf/common.sh@119 -- # set +e 00:25:16.838 04:36:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:16.838 04:36:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:16.838 rmmod nvme_tcp 00:25:16.838 rmmod nvme_fabrics 00:25:16.838 rmmod nvme_keyring 00:25:16.838 04:36:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:16.838 04:36:56 -- nvmf/common.sh@123 -- # set -e 00:25:16.838 04:36:56 -- nvmf/common.sh@124 -- # return 0 00:25:16.838 04:36:56 -- nvmf/common.sh@477 -- # '[' -n 2992832 ']' 00:25:16.838 04:36:56 -- nvmf/common.sh@478 -- # killprocess 2992832 00:25:16.838 04:36:56 -- common/autotest_common.sh@936 -- # '[' -z 2992832 ']' 00:25:16.838 04:36:56 -- common/autotest_common.sh@940 -- # kill -0 2992832 00:25:16.838 04:36:56 -- common/autotest_common.sh@941 -- # uname 00:25:16.838 04:36:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:16.838 04:36:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2992832 00:25:16.838 04:36:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:16.838 04:36:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:16.838 04:36:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2992832' 00:25:16.838 killing process with pid 2992832 00:25:16.838 04:36:56 -- common/autotest_common.sh@955 -- # kill 2992832 00:25:16.838 04:36:56 -- common/autotest_common.sh@960 -- # wait 2992832 00:25:17.097 04:36:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:17.097 04:36:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:17.097 04:36:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:17.097 04:36:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:17.097 04:36:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:17.097 04:36:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:17.097 04:36:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:17.097 04:36:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:19.633 04:36:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:19.633 00:25:19.633 real 0m9.224s 00:25:19.633 user 0m18.111s 00:25:19.633 sys 0m2.415s 00:25:19.633 04:36:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:19.633 04:36:58 -- common/autotest_common.sh@10 -- # set +x 00:25:19.633 ************************************ 00:25:19.633 END TEST nvmf_multicontroller 00:25:19.633 ************************************ 00:25:19.633 04:36:58 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:19.633 04:36:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:19.633 04:36:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:19.633 04:36:58 -- common/autotest_common.sh@10 -- # set +x 00:25:19.633 ************************************ 00:25:19.633 START TEST nvmf_aer 00:25:19.633 ************************************ 00:25:19.633 04:36:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:19.633 * Looking for test storage... 00:25:19.633 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:19.633 04:36:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:19.633 04:36:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:19.633 04:36:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:19.633 04:36:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:19.633 04:36:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:19.633 04:36:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:19.633 04:36:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:19.633 04:36:58 -- scripts/common.sh@335 -- # IFS=.-: 00:25:19.633 04:36:58 -- scripts/common.sh@335 -- # read -ra ver1 00:25:19.633 04:36:58 -- scripts/common.sh@336 -- # IFS=.-: 00:25:19.633 04:36:58 -- scripts/common.sh@336 -- # read -ra ver2 00:25:19.633 04:36:58 -- scripts/common.sh@337 -- # local 'op=<' 00:25:19.633 04:36:58 -- scripts/common.sh@339 -- # ver1_l=2 00:25:19.633 04:36:58 -- scripts/common.sh@340 -- # ver2_l=1 00:25:19.633 04:36:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:19.633 04:36:58 -- scripts/common.sh@343 -- # case "$op" in 00:25:19.633 04:36:58 -- scripts/common.sh@344 -- # : 1 00:25:19.633 04:36:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:19.633 04:36:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:19.633 04:36:58 -- scripts/common.sh@364 -- # decimal 1 00:25:19.633 04:36:58 -- scripts/common.sh@352 -- # local d=1 00:25:19.633 04:36:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:19.633 04:36:58 -- scripts/common.sh@354 -- # echo 1 00:25:19.633 04:36:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:19.633 04:36:58 -- scripts/common.sh@365 -- # decimal 2 00:25:19.633 04:36:58 -- scripts/common.sh@352 -- # local d=2 00:25:19.633 04:36:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:19.633 04:36:58 -- scripts/common.sh@354 -- # echo 2 00:25:19.633 04:36:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:19.633 04:36:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:19.633 04:36:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:19.633 04:36:58 -- scripts/common.sh@367 -- # return 0 00:25:19.633 04:36:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:19.633 04:36:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:19.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:19.633 --rc genhtml_branch_coverage=1 00:25:19.633 --rc genhtml_function_coverage=1 00:25:19.633 --rc genhtml_legend=1 00:25:19.633 --rc geninfo_all_blocks=1 00:25:19.633 --rc geninfo_unexecuted_blocks=1 00:25:19.633 00:25:19.633 ' 00:25:19.633 04:36:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:19.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:19.633 --rc genhtml_branch_coverage=1 00:25:19.633 --rc genhtml_function_coverage=1 00:25:19.633 --rc genhtml_legend=1 00:25:19.633 --rc geninfo_all_blocks=1 00:25:19.633 --rc geninfo_unexecuted_blocks=1 00:25:19.633 00:25:19.633 ' 00:25:19.633 04:36:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:19.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:19.633 --rc genhtml_branch_coverage=1 00:25:19.633 --rc genhtml_function_coverage=1 00:25:19.633 --rc genhtml_legend=1 00:25:19.633 --rc geninfo_all_blocks=1 00:25:19.633 --rc geninfo_unexecuted_blocks=1 00:25:19.633 00:25:19.633 ' 00:25:19.633 04:36:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:19.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:19.633 --rc genhtml_branch_coverage=1 00:25:19.633 --rc genhtml_function_coverage=1 00:25:19.633 --rc genhtml_legend=1 00:25:19.633 --rc geninfo_all_blocks=1 00:25:19.633 --rc geninfo_unexecuted_blocks=1 00:25:19.633 00:25:19.633 ' 00:25:19.633 04:36:58 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:19.633 04:36:58 -- nvmf/common.sh@7 -- # uname -s 00:25:19.633 04:36:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:19.633 04:36:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:19.633 04:36:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:19.634 04:36:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:19.634 04:36:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:19.634 04:36:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:19.634 04:36:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:19.634 04:36:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:19.634 04:36:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:19.634 04:36:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:19.634 04:36:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:19.634 04:36:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:19.634 04:36:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:19.634 04:36:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:19.634 04:36:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:19.634 04:36:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:19.634 04:36:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:19.634 04:36:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:19.634 04:36:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:19.634 04:36:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:19.634 04:36:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:19.634 04:36:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:19.634 04:36:58 -- paths/export.sh@5 -- # export PATH 00:25:19.634 04:36:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:19.634 04:36:58 -- nvmf/common.sh@46 -- # : 0 00:25:19.634 04:36:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:19.634 04:36:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:19.634 04:36:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:19.634 04:36:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:19.634 04:36:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:19.634 04:36:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:19.634 04:36:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:19.634 04:36:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:19.634 04:36:58 -- host/aer.sh@11 -- # nvmftestinit 00:25:19.634 04:36:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:19.634 04:36:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:19.634 04:36:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:19.634 04:36:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:19.634 04:36:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:19.634 04:36:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:19.634 04:36:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:19.634 04:36:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:19.634 04:36:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:19.634 04:36:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:19.634 04:36:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:19.634 04:36:58 -- common/autotest_common.sh@10 -- # set +x 00:25:21.537 04:37:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:21.537 04:37:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:21.537 04:37:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:21.537 04:37:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:21.537 04:37:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:21.537 04:37:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:21.537 04:37:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:21.537 04:37:00 -- nvmf/common.sh@294 -- # net_devs=() 00:25:21.537 04:37:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:21.537 04:37:00 -- nvmf/common.sh@295 -- # e810=() 00:25:21.537 04:37:00 -- nvmf/common.sh@295 -- # local -ga e810 00:25:21.537 04:37:00 -- nvmf/common.sh@296 -- # x722=() 00:25:21.537 04:37:00 -- nvmf/common.sh@296 -- # local -ga x722 00:25:21.538 04:37:00 -- nvmf/common.sh@297 -- # mlx=() 00:25:21.538 04:37:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:21.538 04:37:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:21.538 04:37:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:21.538 04:37:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:21.538 04:37:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:21.538 04:37:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:21.538 04:37:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:21.538 04:37:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:21.538 04:37:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:21.538 04:37:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:21.538 04:37:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:21.538 04:37:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:21.538 04:37:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:21.538 04:37:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:21.538 04:37:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:21.538 04:37:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:21.538 04:37:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:21.538 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:21.538 04:37:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:21.538 04:37:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:21.538 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:21.538 04:37:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:21.538 04:37:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:21.538 04:37:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:21.538 04:37:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:21.538 04:37:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:21.538 04:37:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:21.538 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:21.538 04:37:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:21.538 04:37:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:21.538 04:37:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:21.538 04:37:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:21.538 04:37:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:21.538 04:37:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:21.538 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:21.538 04:37:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:21.538 04:37:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:21.538 04:37:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:21.538 04:37:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:21.538 04:37:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:21.538 04:37:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:21.538 04:37:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:21.538 04:37:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:21.538 04:37:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:21.538 04:37:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:21.538 04:37:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:21.538 04:37:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:21.538 04:37:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:21.538 04:37:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:21.538 04:37:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:21.538 04:37:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:21.538 04:37:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:21.538 04:37:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:21.538 04:37:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:21.538 04:37:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:21.538 04:37:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:21.538 04:37:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:21.538 04:37:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:21.538 04:37:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:21.538 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:21.538 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:25:21.538 00:25:21.538 --- 10.0.0.2 ping statistics --- 00:25:21.538 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:21.538 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:25:21.538 04:37:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:21.538 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:21.538 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:25:21.538 00:25:21.538 --- 10.0.0.1 ping statistics --- 00:25:21.538 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:21.538 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:25:21.538 04:37:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:21.538 04:37:00 -- nvmf/common.sh@410 -- # return 0 00:25:21.538 04:37:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:21.538 04:37:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:21.538 04:37:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:21.538 04:37:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:21.538 04:37:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:21.538 04:37:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:21.538 04:37:00 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:21.538 04:37:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:21.538 04:37:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:21.538 04:37:00 -- common/autotest_common.sh@10 -- # set +x 00:25:21.538 04:37:00 -- nvmf/common.sh@469 -- # nvmfpid=2995359 00:25:21.538 04:37:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:21.538 04:37:00 -- nvmf/common.sh@470 -- # waitforlisten 2995359 00:25:21.538 04:37:00 -- common/autotest_common.sh@829 -- # '[' -z 2995359 ']' 00:25:21.538 04:37:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:21.538 04:37:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:21.538 04:37:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:21.538 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:21.538 04:37:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:21.538 04:37:00 -- common/autotest_common.sh@10 -- # set +x 00:25:21.538 [2024-11-26 04:37:00.705266] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:21.538 [2024-11-26 04:37:00.705351] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:21.538 EAL: No free 2048 kB hugepages reported on node 1 00:25:21.797 [2024-11-26 04:37:00.775178] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:21.797 [2024-11-26 04:37:00.867360] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:21.797 [2024-11-26 04:37:00.867503] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:21.797 [2024-11-26 04:37:00.867521] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:21.797 [2024-11-26 04:37:00.867533] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:21.797 [2024-11-26 04:37:00.867591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:21.797 [2024-11-26 04:37:00.867650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:21.797 [2024-11-26 04:37:00.867715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:21.797 [2024-11-26 04:37:00.867718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:22.733 04:37:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:22.733 04:37:01 -- common/autotest_common.sh@862 -- # return 0 00:25:22.733 04:37:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:22.733 04:37:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:22.733 04:37:01 -- common/autotest_common.sh@10 -- # set +x 00:25:22.733 04:37:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:22.733 04:37:01 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:22.733 04:37:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.733 04:37:01 -- common/autotest_common.sh@10 -- # set +x 00:25:22.733 [2024-11-26 04:37:01.731407] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:22.733 04:37:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.733 04:37:01 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:22.733 04:37:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.733 04:37:01 -- common/autotest_common.sh@10 -- # set +x 00:25:22.733 Malloc0 00:25:22.733 04:37:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.733 04:37:01 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:22.733 04:37:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.733 04:37:01 -- common/autotest_common.sh@10 -- # set +x 00:25:22.733 04:37:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.733 04:37:01 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:22.733 04:37:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.733 04:37:01 -- common/autotest_common.sh@10 -- # set +x 00:25:22.733 04:37:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.733 04:37:01 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:22.733 04:37:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.733 04:37:01 -- common/autotest_common.sh@10 -- # set +x 00:25:22.733 [2024-11-26 04:37:01.784984] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:22.733 04:37:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.733 04:37:01 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:22.733 04:37:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.733 04:37:01 -- common/autotest_common.sh@10 -- # set +x 00:25:22.733 [2024-11-26 04:37:01.792664] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:22.733 [ 00:25:22.733 { 00:25:22.733 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:22.733 "subtype": "Discovery", 00:25:22.733 "listen_addresses": [], 00:25:22.733 "allow_any_host": true, 00:25:22.733 "hosts": [] 00:25:22.733 }, 00:25:22.733 { 00:25:22.733 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:22.733 "subtype": "NVMe", 00:25:22.733 "listen_addresses": [ 00:25:22.733 { 00:25:22.734 "transport": "TCP", 00:25:22.734 "trtype": "TCP", 00:25:22.734 "adrfam": "IPv4", 00:25:22.734 "traddr": "10.0.0.2", 00:25:22.734 "trsvcid": "4420" 00:25:22.734 } 00:25:22.734 ], 00:25:22.734 "allow_any_host": true, 00:25:22.734 "hosts": [], 00:25:22.734 "serial_number": "SPDK00000000000001", 00:25:22.734 "model_number": "SPDK bdev Controller", 00:25:22.734 "max_namespaces": 2, 00:25:22.734 "min_cntlid": 1, 00:25:22.734 "max_cntlid": 65519, 00:25:22.734 "namespaces": [ 00:25:22.734 { 00:25:22.734 "nsid": 1, 00:25:22.734 "bdev_name": "Malloc0", 00:25:22.734 "name": "Malloc0", 00:25:22.734 "nguid": "2A5212012C0D4F93B9CAEAEDCE0AF0FE", 00:25:22.734 "uuid": "2a521201-2c0d-4f93-b9ca-eaedce0af0fe" 00:25:22.734 } 00:25:22.734 ] 00:25:22.734 } 00:25:22.734 ] 00:25:22.734 04:37:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.734 04:37:01 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:22.734 04:37:01 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:22.734 04:37:01 -- host/aer.sh@33 -- # aerpid=2995525 00:25:22.734 04:37:01 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:22.734 04:37:01 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:22.734 04:37:01 -- common/autotest_common.sh@1254 -- # local i=0 00:25:22.734 04:37:01 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:22.734 04:37:01 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:25:22.734 04:37:01 -- common/autotest_common.sh@1257 -- # i=1 00:25:22.734 04:37:01 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:22.734 EAL: No free 2048 kB hugepages reported on node 1 00:25:22.734 04:37:01 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:22.734 04:37:01 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:25:22.734 04:37:01 -- common/autotest_common.sh@1257 -- # i=2 00:25:22.734 04:37:01 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:22.994 04:37:02 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:22.994 04:37:02 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:25:22.994 04:37:02 -- common/autotest_common.sh@1257 -- # i=3 00:25:22.994 04:37:02 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:22.994 04:37:02 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:22.994 04:37:02 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:22.994 04:37:02 -- common/autotest_common.sh@1265 -- # return 0 00:25:22.994 04:37:02 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:22.994 04:37:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.994 04:37:02 -- common/autotest_common.sh@10 -- # set +x 00:25:22.994 Malloc1 00:25:22.994 04:37:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.994 04:37:02 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:22.994 04:37:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.994 04:37:02 -- common/autotest_common.sh@10 -- # set +x 00:25:22.994 04:37:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.994 04:37:02 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:22.994 04:37:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.994 04:37:02 -- common/autotest_common.sh@10 -- # set +x 00:25:22.994 Asynchronous Event Request test 00:25:22.994 Attaching to 10.0.0.2 00:25:22.994 Attached to 10.0.0.2 00:25:22.994 Registering asynchronous event callbacks... 00:25:22.994 Starting namespace attribute notice tests for all controllers... 00:25:22.994 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:22.994 aer_cb - Changed Namespace 00:25:22.994 Cleaning up... 00:25:22.994 [ 00:25:22.994 { 00:25:22.994 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:22.994 "subtype": "Discovery", 00:25:22.994 "listen_addresses": [], 00:25:22.994 "allow_any_host": true, 00:25:22.994 "hosts": [] 00:25:22.994 }, 00:25:22.994 { 00:25:22.994 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:22.994 "subtype": "NVMe", 00:25:22.994 "listen_addresses": [ 00:25:22.994 { 00:25:22.994 "transport": "TCP", 00:25:22.994 "trtype": "TCP", 00:25:22.994 "adrfam": "IPv4", 00:25:22.994 "traddr": "10.0.0.2", 00:25:22.994 "trsvcid": "4420" 00:25:22.994 } 00:25:22.994 ], 00:25:22.994 "allow_any_host": true, 00:25:22.994 "hosts": [], 00:25:22.994 "serial_number": "SPDK00000000000001", 00:25:22.994 "model_number": "SPDK bdev Controller", 00:25:22.994 "max_namespaces": 2, 00:25:22.994 "min_cntlid": 1, 00:25:22.994 "max_cntlid": 65519, 00:25:22.994 "namespaces": [ 00:25:22.994 { 00:25:22.994 "nsid": 1, 00:25:22.994 "bdev_name": "Malloc0", 00:25:22.994 "name": "Malloc0", 00:25:22.994 "nguid": "2A5212012C0D4F93B9CAEAEDCE0AF0FE", 00:25:22.994 "uuid": "2a521201-2c0d-4f93-b9ca-eaedce0af0fe" 00:25:22.994 }, 00:25:22.994 { 00:25:22.994 "nsid": 2, 00:25:22.994 "bdev_name": "Malloc1", 00:25:22.994 "name": "Malloc1", 00:25:22.994 "nguid": "A5062F6FED20494C886A1B3011600E9D", 00:25:22.994 "uuid": "a5062f6f-ed20-494c-886a-1b3011600e9d" 00:25:22.994 } 00:25:22.994 ] 00:25:22.994 } 00:25:22.994 ] 00:25:22.994 04:37:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.994 04:37:02 -- host/aer.sh@43 -- # wait 2995525 00:25:22.994 04:37:02 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:22.994 04:37:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.994 04:37:02 -- common/autotest_common.sh@10 -- # set +x 00:25:23.255 04:37:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:23.255 04:37:02 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:23.255 04:37:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:23.255 04:37:02 -- common/autotest_common.sh@10 -- # set +x 00:25:23.255 04:37:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:23.255 04:37:02 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:23.255 04:37:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:23.255 04:37:02 -- common/autotest_common.sh@10 -- # set +x 00:25:23.255 04:37:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:23.255 04:37:02 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:23.255 04:37:02 -- host/aer.sh@51 -- # nvmftestfini 00:25:23.255 04:37:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:23.255 04:37:02 -- nvmf/common.sh@116 -- # sync 00:25:23.255 04:37:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:23.255 04:37:02 -- nvmf/common.sh@119 -- # set +e 00:25:23.255 04:37:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:23.255 04:37:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:23.255 rmmod nvme_tcp 00:25:23.255 rmmod nvme_fabrics 00:25:23.255 rmmod nvme_keyring 00:25:23.255 04:37:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:23.255 04:37:02 -- nvmf/common.sh@123 -- # set -e 00:25:23.255 04:37:02 -- nvmf/common.sh@124 -- # return 0 00:25:23.255 04:37:02 -- nvmf/common.sh@477 -- # '[' -n 2995359 ']' 00:25:23.255 04:37:02 -- nvmf/common.sh@478 -- # killprocess 2995359 00:25:23.255 04:37:02 -- common/autotest_common.sh@936 -- # '[' -z 2995359 ']' 00:25:23.255 04:37:02 -- common/autotest_common.sh@940 -- # kill -0 2995359 00:25:23.255 04:37:02 -- common/autotest_common.sh@941 -- # uname 00:25:23.255 04:37:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:23.255 04:37:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2995359 00:25:23.255 04:37:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:23.255 04:37:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:23.255 04:37:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2995359' 00:25:23.255 killing process with pid 2995359 00:25:23.255 04:37:02 -- common/autotest_common.sh@955 -- # kill 2995359 00:25:23.255 [2024-11-26 04:37:02.363834] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:23.255 04:37:02 -- common/autotest_common.sh@960 -- # wait 2995359 00:25:23.514 04:37:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:23.514 04:37:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:23.514 04:37:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:23.514 04:37:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:23.514 04:37:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:23.514 04:37:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:23.514 04:37:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:23.514 04:37:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:26.051 04:37:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:26.051 00:25:26.051 real 0m6.253s 00:25:26.051 user 0m7.817s 00:25:26.051 sys 0m1.937s 00:25:26.051 04:37:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:26.051 04:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:26.051 ************************************ 00:25:26.051 END TEST nvmf_aer 00:25:26.051 ************************************ 00:25:26.051 04:37:04 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:26.051 04:37:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:26.051 04:37:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:26.051 04:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:26.051 ************************************ 00:25:26.051 START TEST nvmf_async_init 00:25:26.051 ************************************ 00:25:26.051 04:37:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:26.051 * Looking for test storage... 00:25:26.051 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:26.051 04:37:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:26.051 04:37:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:26.051 04:37:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:26.051 04:37:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:26.051 04:37:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:26.051 04:37:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:26.051 04:37:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:26.051 04:37:04 -- scripts/common.sh@335 -- # IFS=.-: 00:25:26.051 04:37:04 -- scripts/common.sh@335 -- # read -ra ver1 00:25:26.051 04:37:04 -- scripts/common.sh@336 -- # IFS=.-: 00:25:26.051 04:37:04 -- scripts/common.sh@336 -- # read -ra ver2 00:25:26.051 04:37:04 -- scripts/common.sh@337 -- # local 'op=<' 00:25:26.051 04:37:04 -- scripts/common.sh@339 -- # ver1_l=2 00:25:26.051 04:37:04 -- scripts/common.sh@340 -- # ver2_l=1 00:25:26.051 04:37:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:26.051 04:37:04 -- scripts/common.sh@343 -- # case "$op" in 00:25:26.051 04:37:04 -- scripts/common.sh@344 -- # : 1 00:25:26.051 04:37:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:26.051 04:37:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:26.051 04:37:04 -- scripts/common.sh@364 -- # decimal 1 00:25:26.051 04:37:04 -- scripts/common.sh@352 -- # local d=1 00:25:26.051 04:37:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:26.051 04:37:04 -- scripts/common.sh@354 -- # echo 1 00:25:26.051 04:37:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:26.051 04:37:04 -- scripts/common.sh@365 -- # decimal 2 00:25:26.051 04:37:04 -- scripts/common.sh@352 -- # local d=2 00:25:26.051 04:37:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:26.051 04:37:04 -- scripts/common.sh@354 -- # echo 2 00:25:26.051 04:37:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:26.051 04:37:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:26.051 04:37:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:26.051 04:37:04 -- scripts/common.sh@367 -- # return 0 00:25:26.051 04:37:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:26.051 04:37:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:26.051 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:26.051 --rc genhtml_branch_coverage=1 00:25:26.051 --rc genhtml_function_coverage=1 00:25:26.051 --rc genhtml_legend=1 00:25:26.051 --rc geninfo_all_blocks=1 00:25:26.051 --rc geninfo_unexecuted_blocks=1 00:25:26.051 00:25:26.051 ' 00:25:26.051 04:37:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:26.051 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:26.051 --rc genhtml_branch_coverage=1 00:25:26.051 --rc genhtml_function_coverage=1 00:25:26.051 --rc genhtml_legend=1 00:25:26.051 --rc geninfo_all_blocks=1 00:25:26.051 --rc geninfo_unexecuted_blocks=1 00:25:26.051 00:25:26.051 ' 00:25:26.052 04:37:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:26.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:26.052 --rc genhtml_branch_coverage=1 00:25:26.052 --rc genhtml_function_coverage=1 00:25:26.052 --rc genhtml_legend=1 00:25:26.052 --rc geninfo_all_blocks=1 00:25:26.052 --rc geninfo_unexecuted_blocks=1 00:25:26.052 00:25:26.052 ' 00:25:26.052 04:37:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:26.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:26.052 --rc genhtml_branch_coverage=1 00:25:26.052 --rc genhtml_function_coverage=1 00:25:26.052 --rc genhtml_legend=1 00:25:26.052 --rc geninfo_all_blocks=1 00:25:26.052 --rc geninfo_unexecuted_blocks=1 00:25:26.052 00:25:26.052 ' 00:25:26.052 04:37:04 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:26.052 04:37:04 -- nvmf/common.sh@7 -- # uname -s 00:25:26.052 04:37:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:26.052 04:37:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:26.052 04:37:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:26.052 04:37:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:26.052 04:37:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:26.052 04:37:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:26.052 04:37:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:26.052 04:37:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:26.052 04:37:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:26.052 04:37:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:26.052 04:37:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:26.052 04:37:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:26.052 04:37:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:26.052 04:37:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:26.052 04:37:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:26.052 04:37:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:26.052 04:37:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:26.052 04:37:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:26.052 04:37:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:26.052 04:37:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:26.052 04:37:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:26.052 04:37:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:26.052 04:37:04 -- paths/export.sh@5 -- # export PATH 00:25:26.052 04:37:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:26.052 04:37:04 -- nvmf/common.sh@46 -- # : 0 00:25:26.052 04:37:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:26.052 04:37:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:26.052 04:37:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:26.052 04:37:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:26.052 04:37:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:26.052 04:37:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:26.052 04:37:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:26.052 04:37:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:26.052 04:37:04 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:26.052 04:37:04 -- host/async_init.sh@14 -- # null_block_size=512 00:25:26.052 04:37:04 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:26.052 04:37:04 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:26.052 04:37:04 -- host/async_init.sh@20 -- # uuidgen 00:25:26.052 04:37:04 -- host/async_init.sh@20 -- # tr -d - 00:25:26.052 04:37:04 -- host/async_init.sh@20 -- # nguid=f92b4292c7b84251846e83beb176ab3b 00:25:26.052 04:37:04 -- host/async_init.sh@22 -- # nvmftestinit 00:25:26.052 04:37:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:26.052 04:37:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:26.052 04:37:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:26.052 04:37:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:26.052 04:37:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:26.052 04:37:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:26.052 04:37:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:26.052 04:37:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:26.052 04:37:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:26.052 04:37:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:26.052 04:37:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:26.052 04:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:27.958 04:37:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:27.958 04:37:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:27.958 04:37:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:27.958 04:37:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:27.958 04:37:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:27.958 04:37:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:27.958 04:37:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:27.959 04:37:06 -- nvmf/common.sh@294 -- # net_devs=() 00:25:27.959 04:37:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:27.959 04:37:06 -- nvmf/common.sh@295 -- # e810=() 00:25:27.959 04:37:06 -- nvmf/common.sh@295 -- # local -ga e810 00:25:27.959 04:37:06 -- nvmf/common.sh@296 -- # x722=() 00:25:27.959 04:37:06 -- nvmf/common.sh@296 -- # local -ga x722 00:25:27.959 04:37:06 -- nvmf/common.sh@297 -- # mlx=() 00:25:27.959 04:37:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:27.959 04:37:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:27.959 04:37:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:27.959 04:37:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:27.959 04:37:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:27.959 04:37:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:27.959 04:37:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:27.959 04:37:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:27.959 04:37:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:27.959 04:37:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:27.959 04:37:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:27.959 04:37:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:27.959 04:37:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:27.959 04:37:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:27.959 04:37:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:27.959 04:37:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:27.959 04:37:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:27.959 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:27.959 04:37:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:27.959 04:37:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:27.959 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:27.959 04:37:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:27.959 04:37:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:27.959 04:37:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:27.959 04:37:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:27.959 04:37:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:27.959 04:37:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:27.959 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:27.959 04:37:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:27.959 04:37:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:27.959 04:37:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:27.959 04:37:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:27.959 04:37:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:27.959 04:37:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:27.959 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:27.959 04:37:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:27.959 04:37:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:27.959 04:37:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:27.959 04:37:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:27.959 04:37:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:27.959 04:37:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:27.959 04:37:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:27.959 04:37:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:27.959 04:37:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:27.959 04:37:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:27.959 04:37:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:27.959 04:37:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:27.959 04:37:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:27.959 04:37:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:27.959 04:37:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:27.959 04:37:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:27.959 04:37:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:27.959 04:37:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:27.959 04:37:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:27.959 04:37:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:27.959 04:37:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:27.959 04:37:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:27.959 04:37:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:27.959 04:37:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:27.959 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:27.959 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.215 ms 00:25:27.959 00:25:27.959 --- 10.0.0.2 ping statistics --- 00:25:27.959 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:27.959 rtt min/avg/max/mdev = 0.215/0.215/0.215/0.000 ms 00:25:27.959 04:37:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:27.959 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:27.959 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:25:27.959 00:25:27.959 --- 10.0.0.1 ping statistics --- 00:25:27.959 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:27.959 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:25:27.959 04:37:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:27.959 04:37:06 -- nvmf/common.sh@410 -- # return 0 00:25:27.959 04:37:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:27.959 04:37:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:27.959 04:37:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:27.959 04:37:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:27.959 04:37:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:27.959 04:37:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:27.959 04:37:06 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:27.959 04:37:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:27.959 04:37:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:27.959 04:37:06 -- common/autotest_common.sh@10 -- # set +x 00:25:27.959 04:37:06 -- nvmf/common.sh@469 -- # nvmfpid=2997479 00:25:27.959 04:37:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:27.959 04:37:06 -- nvmf/common.sh@470 -- # waitforlisten 2997479 00:25:27.959 04:37:06 -- common/autotest_common.sh@829 -- # '[' -z 2997479 ']' 00:25:27.959 04:37:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:27.959 04:37:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:27.959 04:37:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:27.959 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:27.959 04:37:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:27.959 04:37:06 -- common/autotest_common.sh@10 -- # set +x 00:25:27.959 [2024-11-26 04:37:06.975734] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:27.959 [2024-11-26 04:37:06.975819] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:27.959 EAL: No free 2048 kB hugepages reported on node 1 00:25:27.959 [2024-11-26 04:37:07.040160] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:27.959 [2024-11-26 04:37:07.126015] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:27.959 [2024-11-26 04:37:07.126167] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:27.959 [2024-11-26 04:37:07.126184] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:27.959 [2024-11-26 04:37:07.126196] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:27.959 [2024-11-26 04:37:07.126232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:28.932 04:37:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:28.932 04:37:08 -- common/autotest_common.sh@862 -- # return 0 00:25:28.932 04:37:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:28.932 04:37:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:28.932 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.932 04:37:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:28.932 04:37:08 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:28.932 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.932 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.932 [2024-11-26 04:37:08.036206] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:28.932 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.932 04:37:08 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:28.932 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.932 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.932 null0 00:25:28.932 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.932 04:37:08 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:28.932 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.932 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.932 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.932 04:37:08 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:28.932 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.932 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.932 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.932 04:37:08 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g f92b4292c7b84251846e83beb176ab3b 00:25:28.932 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.932 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.932 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.932 04:37:08 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:28.932 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.932 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:28.932 [2024-11-26 04:37:08.076451] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:28.932 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.932 04:37:08 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:28.932 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.932 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:29.227 nvme0n1 00:25:29.227 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.227 04:37:08 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:29.227 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.228 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:29.228 [ 00:25:29.228 { 00:25:29.228 "name": "nvme0n1", 00:25:29.228 "aliases": [ 00:25:29.228 "f92b4292-c7b8-4251-846e-83beb176ab3b" 00:25:29.228 ], 00:25:29.228 "product_name": "NVMe disk", 00:25:29.228 "block_size": 512, 00:25:29.228 "num_blocks": 2097152, 00:25:29.228 "uuid": "f92b4292-c7b8-4251-846e-83beb176ab3b", 00:25:29.228 "assigned_rate_limits": { 00:25:29.228 "rw_ios_per_sec": 0, 00:25:29.228 "rw_mbytes_per_sec": 0, 00:25:29.228 "r_mbytes_per_sec": 0, 00:25:29.228 "w_mbytes_per_sec": 0 00:25:29.228 }, 00:25:29.228 "claimed": false, 00:25:29.228 "zoned": false, 00:25:29.228 "supported_io_types": { 00:25:29.228 "read": true, 00:25:29.228 "write": true, 00:25:29.228 "unmap": false, 00:25:29.228 "write_zeroes": true, 00:25:29.228 "flush": true, 00:25:29.228 "reset": true, 00:25:29.228 "compare": true, 00:25:29.228 "compare_and_write": true, 00:25:29.228 "abort": true, 00:25:29.228 "nvme_admin": true, 00:25:29.228 "nvme_io": true 00:25:29.228 }, 00:25:29.228 "driver_specific": { 00:25:29.228 "nvme": [ 00:25:29.228 { 00:25:29.228 "trid": { 00:25:29.228 "trtype": "TCP", 00:25:29.228 "adrfam": "IPv4", 00:25:29.228 "traddr": "10.0.0.2", 00:25:29.228 "trsvcid": "4420", 00:25:29.228 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:29.228 }, 00:25:29.228 "ctrlr_data": { 00:25:29.228 "cntlid": 1, 00:25:29.228 "vendor_id": "0x8086", 00:25:29.228 "model_number": "SPDK bdev Controller", 00:25:29.228 "serial_number": "00000000000000000000", 00:25:29.228 "firmware_revision": "24.01.1", 00:25:29.228 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:29.228 "oacs": { 00:25:29.228 "security": 0, 00:25:29.228 "format": 0, 00:25:29.228 "firmware": 0, 00:25:29.228 "ns_manage": 0 00:25:29.228 }, 00:25:29.228 "multi_ctrlr": true, 00:25:29.228 "ana_reporting": false 00:25:29.228 }, 00:25:29.228 "vs": { 00:25:29.228 "nvme_version": "1.3" 00:25:29.228 }, 00:25:29.228 "ns_data": { 00:25:29.228 "id": 1, 00:25:29.228 "can_share": true 00:25:29.228 } 00:25:29.228 } 00:25:29.228 ], 00:25:29.228 "mp_policy": "active_passive" 00:25:29.228 } 00:25:29.228 } 00:25:29.228 ] 00:25:29.228 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.228 04:37:08 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:25:29.228 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.228 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:29.228 [2024-11-26 04:37:08.324993] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:29.228 [2024-11-26 04:37:08.325081] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcc4ba0 (9): Bad file descriptor 00:25:29.486 [2024-11-26 04:37:08.456849] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:29.486 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.486 04:37:08 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:29.486 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.486 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:29.486 [ 00:25:29.486 { 00:25:29.486 "name": "nvme0n1", 00:25:29.486 "aliases": [ 00:25:29.486 "f92b4292-c7b8-4251-846e-83beb176ab3b" 00:25:29.486 ], 00:25:29.486 "product_name": "NVMe disk", 00:25:29.486 "block_size": 512, 00:25:29.486 "num_blocks": 2097152, 00:25:29.486 "uuid": "f92b4292-c7b8-4251-846e-83beb176ab3b", 00:25:29.486 "assigned_rate_limits": { 00:25:29.486 "rw_ios_per_sec": 0, 00:25:29.486 "rw_mbytes_per_sec": 0, 00:25:29.486 "r_mbytes_per_sec": 0, 00:25:29.486 "w_mbytes_per_sec": 0 00:25:29.486 }, 00:25:29.486 "claimed": false, 00:25:29.486 "zoned": false, 00:25:29.486 "supported_io_types": { 00:25:29.486 "read": true, 00:25:29.486 "write": true, 00:25:29.486 "unmap": false, 00:25:29.486 "write_zeroes": true, 00:25:29.486 "flush": true, 00:25:29.486 "reset": true, 00:25:29.486 "compare": true, 00:25:29.486 "compare_and_write": true, 00:25:29.486 "abort": true, 00:25:29.486 "nvme_admin": true, 00:25:29.486 "nvme_io": true 00:25:29.486 }, 00:25:29.486 "driver_specific": { 00:25:29.486 "nvme": [ 00:25:29.486 { 00:25:29.486 "trid": { 00:25:29.486 "trtype": "TCP", 00:25:29.487 "adrfam": "IPv4", 00:25:29.487 "traddr": "10.0.0.2", 00:25:29.487 "trsvcid": "4420", 00:25:29.487 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:29.487 }, 00:25:29.487 "ctrlr_data": { 00:25:29.487 "cntlid": 2, 00:25:29.487 "vendor_id": "0x8086", 00:25:29.487 "model_number": "SPDK bdev Controller", 00:25:29.487 "serial_number": "00000000000000000000", 00:25:29.487 "firmware_revision": "24.01.1", 00:25:29.487 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:29.487 "oacs": { 00:25:29.487 "security": 0, 00:25:29.487 "format": 0, 00:25:29.487 "firmware": 0, 00:25:29.487 "ns_manage": 0 00:25:29.487 }, 00:25:29.487 "multi_ctrlr": true, 00:25:29.487 "ana_reporting": false 00:25:29.487 }, 00:25:29.487 "vs": { 00:25:29.487 "nvme_version": "1.3" 00:25:29.487 }, 00:25:29.487 "ns_data": { 00:25:29.487 "id": 1, 00:25:29.487 "can_share": true 00:25:29.487 } 00:25:29.487 } 00:25:29.487 ], 00:25:29.487 "mp_policy": "active_passive" 00:25:29.487 } 00:25:29.487 } 00:25:29.487 ] 00:25:29.487 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.487 04:37:08 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:29.487 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.487 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:29.487 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.487 04:37:08 -- host/async_init.sh@53 -- # mktemp 00:25:29.487 04:37:08 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.eTtNhmXqS7 00:25:29.487 04:37:08 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:25:29.487 04:37:08 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.eTtNhmXqS7 00:25:29.487 04:37:08 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:25:29.487 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.487 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:29.487 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.487 04:37:08 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:25:29.487 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.487 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:29.487 [2024-11-26 04:37:08.501570] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:25:29.487 [2024-11-26 04:37:08.501743] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:29.487 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.487 04:37:08 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.eTtNhmXqS7 00:25:29.487 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.487 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:29.487 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.487 04:37:08 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.eTtNhmXqS7 00:25:29.487 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.487 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:29.487 [2024-11-26 04:37:08.517602] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:25:29.487 nvme0n1 00:25:29.487 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.487 04:37:08 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:29.487 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.487 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:29.487 [ 00:25:29.487 { 00:25:29.487 "name": "nvme0n1", 00:25:29.487 "aliases": [ 00:25:29.487 "f92b4292-c7b8-4251-846e-83beb176ab3b" 00:25:29.487 ], 00:25:29.487 "product_name": "NVMe disk", 00:25:29.487 "block_size": 512, 00:25:29.487 "num_blocks": 2097152, 00:25:29.487 "uuid": "f92b4292-c7b8-4251-846e-83beb176ab3b", 00:25:29.487 "assigned_rate_limits": { 00:25:29.487 "rw_ios_per_sec": 0, 00:25:29.487 "rw_mbytes_per_sec": 0, 00:25:29.487 "r_mbytes_per_sec": 0, 00:25:29.487 "w_mbytes_per_sec": 0 00:25:29.487 }, 00:25:29.487 "claimed": false, 00:25:29.487 "zoned": false, 00:25:29.487 "supported_io_types": { 00:25:29.487 "read": true, 00:25:29.487 "write": true, 00:25:29.487 "unmap": false, 00:25:29.487 "write_zeroes": true, 00:25:29.487 "flush": true, 00:25:29.487 "reset": true, 00:25:29.487 "compare": true, 00:25:29.487 "compare_and_write": true, 00:25:29.487 "abort": true, 00:25:29.487 "nvme_admin": true, 00:25:29.487 "nvme_io": true 00:25:29.487 }, 00:25:29.487 "driver_specific": { 00:25:29.487 "nvme": [ 00:25:29.487 { 00:25:29.487 "trid": { 00:25:29.487 "trtype": "TCP", 00:25:29.487 "adrfam": "IPv4", 00:25:29.487 "traddr": "10.0.0.2", 00:25:29.487 "trsvcid": "4421", 00:25:29.487 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:29.487 }, 00:25:29.487 "ctrlr_data": { 00:25:29.487 "cntlid": 3, 00:25:29.487 "vendor_id": "0x8086", 00:25:29.487 "model_number": "SPDK bdev Controller", 00:25:29.487 "serial_number": "00000000000000000000", 00:25:29.487 "firmware_revision": "24.01.1", 00:25:29.487 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:29.487 "oacs": { 00:25:29.487 "security": 0, 00:25:29.487 "format": 0, 00:25:29.487 "firmware": 0, 00:25:29.487 "ns_manage": 0 00:25:29.487 }, 00:25:29.487 "multi_ctrlr": true, 00:25:29.487 "ana_reporting": false 00:25:29.487 }, 00:25:29.487 "vs": { 00:25:29.487 "nvme_version": "1.3" 00:25:29.487 }, 00:25:29.487 "ns_data": { 00:25:29.487 "id": 1, 00:25:29.487 "can_share": true 00:25:29.487 } 00:25:29.487 } 00:25:29.487 ], 00:25:29.487 "mp_policy": "active_passive" 00:25:29.487 } 00:25:29.487 } 00:25:29.487 ] 00:25:29.487 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.487 04:37:08 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:29.487 04:37:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.487 04:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:29.487 04:37:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.487 04:37:08 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.eTtNhmXqS7 00:25:29.487 04:37:08 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:25:29.487 04:37:08 -- host/async_init.sh@78 -- # nvmftestfini 00:25:29.487 04:37:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:29.487 04:37:08 -- nvmf/common.sh@116 -- # sync 00:25:29.487 04:37:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:29.487 04:37:08 -- nvmf/common.sh@119 -- # set +e 00:25:29.487 04:37:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:29.487 04:37:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:29.487 rmmod nvme_tcp 00:25:29.487 rmmod nvme_fabrics 00:25:29.487 rmmod nvme_keyring 00:25:29.487 04:37:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:29.487 04:37:08 -- nvmf/common.sh@123 -- # set -e 00:25:29.487 04:37:08 -- nvmf/common.sh@124 -- # return 0 00:25:29.487 04:37:08 -- nvmf/common.sh@477 -- # '[' -n 2997479 ']' 00:25:29.487 04:37:08 -- nvmf/common.sh@478 -- # killprocess 2997479 00:25:29.487 04:37:08 -- common/autotest_common.sh@936 -- # '[' -z 2997479 ']' 00:25:29.487 04:37:08 -- common/autotest_common.sh@940 -- # kill -0 2997479 00:25:29.487 04:37:08 -- common/autotest_common.sh@941 -- # uname 00:25:29.487 04:37:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:29.487 04:37:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2997479 00:25:29.487 04:37:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:29.487 04:37:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:29.487 04:37:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2997479' 00:25:29.487 killing process with pid 2997479 00:25:29.487 04:37:08 -- common/autotest_common.sh@955 -- # kill 2997479 00:25:29.487 04:37:08 -- common/autotest_common.sh@960 -- # wait 2997479 00:25:29.747 04:37:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:29.747 04:37:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:29.747 04:37:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:29.747 04:37:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:29.747 04:37:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:29.747 04:37:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:29.747 04:37:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:29.747 04:37:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:32.284 04:37:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:32.284 00:25:32.284 real 0m6.281s 00:25:32.284 user 0m3.131s 00:25:32.284 sys 0m1.849s 00:25:32.284 04:37:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:32.284 04:37:10 -- common/autotest_common.sh@10 -- # set +x 00:25:32.284 ************************************ 00:25:32.284 END TEST nvmf_async_init 00:25:32.284 ************************************ 00:25:32.284 04:37:10 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:32.284 04:37:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:32.284 04:37:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:32.284 04:37:10 -- common/autotest_common.sh@10 -- # set +x 00:25:32.284 ************************************ 00:25:32.284 START TEST dma 00:25:32.284 ************************************ 00:25:32.284 04:37:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:32.284 * Looking for test storage... 00:25:32.284 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:32.284 04:37:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:32.284 04:37:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:32.284 04:37:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:32.284 04:37:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:32.284 04:37:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:32.284 04:37:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:32.284 04:37:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:32.284 04:37:11 -- scripts/common.sh@335 -- # IFS=.-: 00:25:32.284 04:37:11 -- scripts/common.sh@335 -- # read -ra ver1 00:25:32.284 04:37:11 -- scripts/common.sh@336 -- # IFS=.-: 00:25:32.284 04:37:11 -- scripts/common.sh@336 -- # read -ra ver2 00:25:32.284 04:37:11 -- scripts/common.sh@337 -- # local 'op=<' 00:25:32.284 04:37:11 -- scripts/common.sh@339 -- # ver1_l=2 00:25:32.284 04:37:11 -- scripts/common.sh@340 -- # ver2_l=1 00:25:32.284 04:37:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:32.284 04:37:11 -- scripts/common.sh@343 -- # case "$op" in 00:25:32.284 04:37:11 -- scripts/common.sh@344 -- # : 1 00:25:32.284 04:37:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:32.284 04:37:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:32.284 04:37:11 -- scripts/common.sh@364 -- # decimal 1 00:25:32.284 04:37:11 -- scripts/common.sh@352 -- # local d=1 00:25:32.284 04:37:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:32.284 04:37:11 -- scripts/common.sh@354 -- # echo 1 00:25:32.284 04:37:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:32.284 04:37:11 -- scripts/common.sh@365 -- # decimal 2 00:25:32.285 04:37:11 -- scripts/common.sh@352 -- # local d=2 00:25:32.285 04:37:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:32.285 04:37:11 -- scripts/common.sh@354 -- # echo 2 00:25:32.285 04:37:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:32.285 04:37:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:32.285 04:37:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:32.285 04:37:11 -- scripts/common.sh@367 -- # return 0 00:25:32.285 04:37:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:32.285 04:37:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:32.285 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:32.285 --rc genhtml_branch_coverage=1 00:25:32.285 --rc genhtml_function_coverage=1 00:25:32.285 --rc genhtml_legend=1 00:25:32.285 --rc geninfo_all_blocks=1 00:25:32.285 --rc geninfo_unexecuted_blocks=1 00:25:32.285 00:25:32.285 ' 00:25:32.285 04:37:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:32.285 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:32.285 --rc genhtml_branch_coverage=1 00:25:32.285 --rc genhtml_function_coverage=1 00:25:32.285 --rc genhtml_legend=1 00:25:32.285 --rc geninfo_all_blocks=1 00:25:32.285 --rc geninfo_unexecuted_blocks=1 00:25:32.285 00:25:32.285 ' 00:25:32.285 04:37:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:32.285 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:32.285 --rc genhtml_branch_coverage=1 00:25:32.285 --rc genhtml_function_coverage=1 00:25:32.285 --rc genhtml_legend=1 00:25:32.285 --rc geninfo_all_blocks=1 00:25:32.285 --rc geninfo_unexecuted_blocks=1 00:25:32.285 00:25:32.285 ' 00:25:32.285 04:37:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:32.285 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:32.285 --rc genhtml_branch_coverage=1 00:25:32.285 --rc genhtml_function_coverage=1 00:25:32.285 --rc genhtml_legend=1 00:25:32.285 --rc geninfo_all_blocks=1 00:25:32.285 --rc geninfo_unexecuted_blocks=1 00:25:32.285 00:25:32.285 ' 00:25:32.285 04:37:11 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:32.285 04:37:11 -- nvmf/common.sh@7 -- # uname -s 00:25:32.285 04:37:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:32.285 04:37:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:32.285 04:37:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:32.285 04:37:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:32.285 04:37:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:32.285 04:37:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:32.285 04:37:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:32.285 04:37:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:32.285 04:37:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:32.285 04:37:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:32.285 04:37:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:32.285 04:37:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:32.285 04:37:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:32.285 04:37:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:32.285 04:37:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:32.285 04:37:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:32.285 04:37:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:32.285 04:37:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:32.285 04:37:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:32.285 04:37:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.285 04:37:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.285 04:37:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.285 04:37:11 -- paths/export.sh@5 -- # export PATH 00:25:32.285 04:37:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.285 04:37:11 -- nvmf/common.sh@46 -- # : 0 00:25:32.285 04:37:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:32.285 04:37:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:32.285 04:37:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:32.285 04:37:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:32.285 04:37:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:32.285 04:37:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:32.285 04:37:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:32.285 04:37:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:32.285 04:37:11 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:25:32.285 04:37:11 -- host/dma.sh@13 -- # exit 0 00:25:32.285 00:25:32.285 real 0m0.153s 00:25:32.285 user 0m0.103s 00:25:32.285 sys 0m0.059s 00:25:32.285 04:37:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:32.285 04:37:11 -- common/autotest_common.sh@10 -- # set +x 00:25:32.285 ************************************ 00:25:32.285 END TEST dma 00:25:32.285 ************************************ 00:25:32.285 04:37:11 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:32.285 04:37:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:32.285 04:37:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:32.285 04:37:11 -- common/autotest_common.sh@10 -- # set +x 00:25:32.285 ************************************ 00:25:32.285 START TEST nvmf_identify 00:25:32.285 ************************************ 00:25:32.285 04:37:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:32.285 * Looking for test storage... 00:25:32.285 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:32.285 04:37:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:32.285 04:37:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:32.285 04:37:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:32.285 04:37:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:32.285 04:37:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:32.285 04:37:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:32.285 04:37:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:32.285 04:37:11 -- scripts/common.sh@335 -- # IFS=.-: 00:25:32.285 04:37:11 -- scripts/common.sh@335 -- # read -ra ver1 00:25:32.285 04:37:11 -- scripts/common.sh@336 -- # IFS=.-: 00:25:32.285 04:37:11 -- scripts/common.sh@336 -- # read -ra ver2 00:25:32.285 04:37:11 -- scripts/common.sh@337 -- # local 'op=<' 00:25:32.285 04:37:11 -- scripts/common.sh@339 -- # ver1_l=2 00:25:32.285 04:37:11 -- scripts/common.sh@340 -- # ver2_l=1 00:25:32.285 04:37:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:32.285 04:37:11 -- scripts/common.sh@343 -- # case "$op" in 00:25:32.286 04:37:11 -- scripts/common.sh@344 -- # : 1 00:25:32.286 04:37:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:32.286 04:37:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:32.286 04:37:11 -- scripts/common.sh@364 -- # decimal 1 00:25:32.286 04:37:11 -- scripts/common.sh@352 -- # local d=1 00:25:32.286 04:37:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:32.286 04:37:11 -- scripts/common.sh@354 -- # echo 1 00:25:32.286 04:37:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:32.286 04:37:11 -- scripts/common.sh@365 -- # decimal 2 00:25:32.286 04:37:11 -- scripts/common.sh@352 -- # local d=2 00:25:32.286 04:37:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:32.286 04:37:11 -- scripts/common.sh@354 -- # echo 2 00:25:32.286 04:37:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:32.286 04:37:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:32.286 04:37:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:32.286 04:37:11 -- scripts/common.sh@367 -- # return 0 00:25:32.286 04:37:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:32.286 04:37:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:32.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:32.286 --rc genhtml_branch_coverage=1 00:25:32.286 --rc genhtml_function_coverage=1 00:25:32.286 --rc genhtml_legend=1 00:25:32.286 --rc geninfo_all_blocks=1 00:25:32.286 --rc geninfo_unexecuted_blocks=1 00:25:32.286 00:25:32.286 ' 00:25:32.286 04:37:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:32.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:32.286 --rc genhtml_branch_coverage=1 00:25:32.286 --rc genhtml_function_coverage=1 00:25:32.286 --rc genhtml_legend=1 00:25:32.286 --rc geninfo_all_blocks=1 00:25:32.286 --rc geninfo_unexecuted_blocks=1 00:25:32.286 00:25:32.286 ' 00:25:32.286 04:37:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:32.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:32.286 --rc genhtml_branch_coverage=1 00:25:32.286 --rc genhtml_function_coverage=1 00:25:32.286 --rc genhtml_legend=1 00:25:32.286 --rc geninfo_all_blocks=1 00:25:32.286 --rc geninfo_unexecuted_blocks=1 00:25:32.286 00:25:32.286 ' 00:25:32.286 04:37:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:32.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:32.286 --rc genhtml_branch_coverage=1 00:25:32.286 --rc genhtml_function_coverage=1 00:25:32.286 --rc genhtml_legend=1 00:25:32.286 --rc geninfo_all_blocks=1 00:25:32.286 --rc geninfo_unexecuted_blocks=1 00:25:32.286 00:25:32.286 ' 00:25:32.286 04:37:11 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:32.286 04:37:11 -- nvmf/common.sh@7 -- # uname -s 00:25:32.286 04:37:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:32.286 04:37:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:32.286 04:37:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:32.286 04:37:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:32.286 04:37:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:32.286 04:37:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:32.286 04:37:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:32.286 04:37:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:32.286 04:37:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:32.286 04:37:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:32.286 04:37:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:32.286 04:37:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:32.286 04:37:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:32.286 04:37:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:32.286 04:37:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:32.286 04:37:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:32.286 04:37:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:32.286 04:37:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:32.286 04:37:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:32.286 04:37:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.286 04:37:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.286 04:37:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.286 04:37:11 -- paths/export.sh@5 -- # export PATH 00:25:32.286 04:37:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.286 04:37:11 -- nvmf/common.sh@46 -- # : 0 00:25:32.286 04:37:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:32.286 04:37:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:32.286 04:37:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:32.286 04:37:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:32.286 04:37:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:32.286 04:37:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:32.286 04:37:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:32.286 04:37:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:32.286 04:37:11 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:32.286 04:37:11 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:32.286 04:37:11 -- host/identify.sh@14 -- # nvmftestinit 00:25:32.286 04:37:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:32.286 04:37:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:32.286 04:37:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:32.286 04:37:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:32.286 04:37:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:32.286 04:37:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:32.286 04:37:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:32.286 04:37:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:32.286 04:37:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:32.286 04:37:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:32.286 04:37:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:32.286 04:37:11 -- common/autotest_common.sh@10 -- # set +x 00:25:34.190 04:37:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:34.190 04:37:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:34.190 04:37:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:34.190 04:37:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:34.190 04:37:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:34.190 04:37:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:34.190 04:37:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:34.190 04:37:13 -- nvmf/common.sh@294 -- # net_devs=() 00:25:34.190 04:37:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:34.190 04:37:13 -- nvmf/common.sh@295 -- # e810=() 00:25:34.190 04:37:13 -- nvmf/common.sh@295 -- # local -ga e810 00:25:34.190 04:37:13 -- nvmf/common.sh@296 -- # x722=() 00:25:34.190 04:37:13 -- nvmf/common.sh@296 -- # local -ga x722 00:25:34.190 04:37:13 -- nvmf/common.sh@297 -- # mlx=() 00:25:34.190 04:37:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:34.190 04:37:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:34.190 04:37:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:34.190 04:37:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:34.190 04:37:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:34.190 04:37:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:34.190 04:37:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:34.190 04:37:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:34.190 04:37:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:34.191 04:37:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:34.191 04:37:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:34.191 04:37:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:34.191 04:37:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:34.191 04:37:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:34.191 04:37:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:34.191 04:37:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:34.191 04:37:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:34.191 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:34.191 04:37:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:34.191 04:37:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:34.191 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:34.191 04:37:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:34.191 04:37:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:34.191 04:37:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:34.191 04:37:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:34.191 04:37:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:34.191 04:37:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:34.191 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:34.191 04:37:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:34.191 04:37:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:34.191 04:37:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:34.191 04:37:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:34.191 04:37:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:34.191 04:37:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:34.191 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:34.191 04:37:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:34.191 04:37:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:34.191 04:37:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:34.191 04:37:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:34.191 04:37:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:34.191 04:37:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:34.191 04:37:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:34.191 04:37:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:34.191 04:37:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:34.191 04:37:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:34.191 04:37:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:34.191 04:37:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:34.191 04:37:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:34.191 04:37:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:34.191 04:37:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:34.191 04:37:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:34.191 04:37:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:34.191 04:37:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:34.191 04:37:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:34.191 04:37:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:34.191 04:37:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:34.191 04:37:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:34.191 04:37:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:34.191 04:37:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:34.191 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:34.191 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.329 ms 00:25:34.191 00:25:34.191 --- 10.0.0.2 ping statistics --- 00:25:34.191 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:34.191 rtt min/avg/max/mdev = 0.329/0.329/0.329/0.000 ms 00:25:34.191 04:37:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:34.191 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:34.191 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:25:34.191 00:25:34.191 --- 10.0.0.1 ping statistics --- 00:25:34.191 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:34.191 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:25:34.191 04:37:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:34.191 04:37:13 -- nvmf/common.sh@410 -- # return 0 00:25:34.191 04:37:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:34.191 04:37:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:34.191 04:37:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:34.191 04:37:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:34.191 04:37:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:34.191 04:37:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:34.191 04:37:13 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:25:34.191 04:37:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:34.191 04:37:13 -- common/autotest_common.sh@10 -- # set +x 00:25:34.191 04:37:13 -- host/identify.sh@19 -- # nvmfpid=2999763 00:25:34.191 04:37:13 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:34.191 04:37:13 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:34.191 04:37:13 -- host/identify.sh@23 -- # waitforlisten 2999763 00:25:34.191 04:37:13 -- common/autotest_common.sh@829 -- # '[' -z 2999763 ']' 00:25:34.191 04:37:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:34.191 04:37:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:34.191 04:37:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:34.191 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:34.191 04:37:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:34.191 04:37:13 -- common/autotest_common.sh@10 -- # set +x 00:25:34.450 [2024-11-26 04:37:13.453872] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:34.450 [2024-11-26 04:37:13.453972] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:34.450 EAL: No free 2048 kB hugepages reported on node 1 00:25:34.450 [2024-11-26 04:37:13.517985] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:34.450 [2024-11-26 04:37:13.602352] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:34.450 [2024-11-26 04:37:13.602509] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:34.450 [2024-11-26 04:37:13.602526] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:34.450 [2024-11-26 04:37:13.602539] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:34.450 [2024-11-26 04:37:13.602590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:34.450 [2024-11-26 04:37:13.602650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:34.450 [2024-11-26 04:37:13.602716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:34.450 [2024-11-26 04:37:13.602720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:35.387 04:37:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:35.388 04:37:14 -- common/autotest_common.sh@862 -- # return 0 00:25:35.388 04:37:14 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:35.388 04:37:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.388 04:37:14 -- common/autotest_common.sh@10 -- # set +x 00:25:35.388 [2024-11-26 04:37:14.436396] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:35.388 04:37:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.388 04:37:14 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:25:35.388 04:37:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:35.388 04:37:14 -- common/autotest_common.sh@10 -- # set +x 00:25:35.388 04:37:14 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:35.388 04:37:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.388 04:37:14 -- common/autotest_common.sh@10 -- # set +x 00:25:35.388 Malloc0 00:25:35.388 04:37:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.388 04:37:14 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:35.388 04:37:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.388 04:37:14 -- common/autotest_common.sh@10 -- # set +x 00:25:35.388 04:37:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.388 04:37:14 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:25:35.388 04:37:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.388 04:37:14 -- common/autotest_common.sh@10 -- # set +x 00:25:35.388 04:37:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.388 04:37:14 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:35.388 04:37:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.388 04:37:14 -- common/autotest_common.sh@10 -- # set +x 00:25:35.388 [2024-11-26 04:37:14.513488] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:35.388 04:37:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.388 04:37:14 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:35.388 04:37:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.388 04:37:14 -- common/autotest_common.sh@10 -- # set +x 00:25:35.388 04:37:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.388 04:37:14 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:25:35.388 04:37:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.388 04:37:14 -- common/autotest_common.sh@10 -- # set +x 00:25:35.388 [2024-11-26 04:37:14.529235] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:35.388 [ 00:25:35.388 { 00:25:35.388 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:35.388 "subtype": "Discovery", 00:25:35.388 "listen_addresses": [ 00:25:35.388 { 00:25:35.388 "transport": "TCP", 00:25:35.388 "trtype": "TCP", 00:25:35.388 "adrfam": "IPv4", 00:25:35.388 "traddr": "10.0.0.2", 00:25:35.388 "trsvcid": "4420" 00:25:35.388 } 00:25:35.388 ], 00:25:35.388 "allow_any_host": true, 00:25:35.388 "hosts": [] 00:25:35.388 }, 00:25:35.388 { 00:25:35.388 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:35.388 "subtype": "NVMe", 00:25:35.388 "listen_addresses": [ 00:25:35.388 { 00:25:35.388 "transport": "TCP", 00:25:35.388 "trtype": "TCP", 00:25:35.388 "adrfam": "IPv4", 00:25:35.388 "traddr": "10.0.0.2", 00:25:35.388 "trsvcid": "4420" 00:25:35.388 } 00:25:35.388 ], 00:25:35.388 "allow_any_host": true, 00:25:35.388 "hosts": [], 00:25:35.388 "serial_number": "SPDK00000000000001", 00:25:35.388 "model_number": "SPDK bdev Controller", 00:25:35.388 "max_namespaces": 32, 00:25:35.388 "min_cntlid": 1, 00:25:35.388 "max_cntlid": 65519, 00:25:35.388 "namespaces": [ 00:25:35.388 { 00:25:35.388 "nsid": 1, 00:25:35.388 "bdev_name": "Malloc0", 00:25:35.388 "name": "Malloc0", 00:25:35.388 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:25:35.388 "eui64": "ABCDEF0123456789", 00:25:35.388 "uuid": "f1f372ee-e97b-4dfa-bf48-c170c7d41d71" 00:25:35.388 } 00:25:35.388 ] 00:25:35.388 } 00:25:35.388 ] 00:25:35.388 04:37:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.388 04:37:14 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:25:35.388 [2024-11-26 04:37:14.555595] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:35.388 [2024-11-26 04:37:14.555637] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2999923 ] 00:25:35.388 EAL: No free 2048 kB hugepages reported on node 1 00:25:35.388 [2024-11-26 04:37:14.586893] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:25:35.388 [2024-11-26 04:37:14.586954] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:35.388 [2024-11-26 04:37:14.586964] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:35.388 [2024-11-26 04:37:14.587005] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:35.388 [2024-11-26 04:37:14.587017] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:35.388 [2024-11-26 04:37:14.590756] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:25:35.388 [2024-11-26 04:37:14.590816] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xac22f0 0 00:25:35.388 [2024-11-26 04:37:14.598715] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:35.388 [2024-11-26 04:37:14.598736] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:35.388 [2024-11-26 04:37:14.598745] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:35.388 [2024-11-26 04:37:14.598751] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:35.388 [2024-11-26 04:37:14.598801] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.388 [2024-11-26 04:37:14.598814] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.388 [2024-11-26 04:37:14.598821] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xac22f0) 00:25:35.388 [2024-11-26 04:37:14.598838] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:35.388 [2024-11-26 04:37:14.598864] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1aec0, cid 0, qid 0 00:25:35.388 [2024-11-26 04:37:14.605716] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.388 [2024-11-26 04:37:14.605736] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.388 [2024-11-26 04:37:14.605744] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.388 [2024-11-26 04:37:14.605751] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1aec0) on tqpair=0xac22f0 00:25:35.388 [2024-11-26 04:37:14.605772] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:35.388 [2024-11-26 04:37:14.605783] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:25:35.388 [2024-11-26 04:37:14.605792] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:25:35.388 [2024-11-26 04:37:14.605812] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.388 [2024-11-26 04:37:14.605825] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.388 [2024-11-26 04:37:14.605833] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xac22f0) 00:25:35.388 [2024-11-26 04:37:14.605844] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.388 [2024-11-26 04:37:14.605868] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1aec0, cid 0, qid 0 00:25:35.388 [2024-11-26 04:37:14.606064] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.388 [2024-11-26 04:37:14.606076] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.388 [2024-11-26 04:37:14.606083] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.388 [2024-11-26 04:37:14.606090] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1aec0) on tqpair=0xac22f0 00:25:35.388 [2024-11-26 04:37:14.606100] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:25:35.388 [2024-11-26 04:37:14.606112] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:25:35.388 [2024-11-26 04:37:14.606124] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.388 [2024-11-26 04:37:14.606132] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.388 [2024-11-26 04:37:14.606138] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xac22f0) 00:25:35.388 [2024-11-26 04:37:14.606148] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.388 [2024-11-26 04:37:14.606169] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1aec0, cid 0, qid 0 00:25:35.388 [2024-11-26 04:37:14.606312] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.388 [2024-11-26 04:37:14.606326] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.388 [2024-11-26 04:37:14.606333] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.388 [2024-11-26 04:37:14.606340] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1aec0) on tqpair=0xac22f0 00:25:35.388 [2024-11-26 04:37:14.606348] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:25:35.388 [2024-11-26 04:37:14.606362] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:25:35.388 [2024-11-26 04:37:14.606373] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.388 [2024-11-26 04:37:14.606381] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.388 [2024-11-26 04:37:14.606387] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xac22f0) 00:25:35.388 [2024-11-26 04:37:14.606397] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.388 [2024-11-26 04:37:14.606417] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1aec0, cid 0, qid 0 00:25:35.388 [2024-11-26 04:37:14.606510] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.388 [2024-11-26 04:37:14.606525] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.389 [2024-11-26 04:37:14.606531] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.606538] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1aec0) on tqpair=0xac22f0 00:25:35.389 [2024-11-26 04:37:14.606547] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:35.389 [2024-11-26 04:37:14.606563] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.606572] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.606578] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xac22f0) 00:25:35.389 [2024-11-26 04:37:14.606588] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.389 [2024-11-26 04:37:14.606613] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1aec0, cid 0, qid 0 00:25:35.389 [2024-11-26 04:37:14.606711] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.389 [2024-11-26 04:37:14.606726] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.389 [2024-11-26 04:37:14.606733] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.606739] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1aec0) on tqpair=0xac22f0 00:25:35.389 [2024-11-26 04:37:14.606748] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:25:35.389 [2024-11-26 04:37:14.606756] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:25:35.389 [2024-11-26 04:37:14.606769] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:35.389 [2024-11-26 04:37:14.606878] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:25:35.389 [2024-11-26 04:37:14.606886] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:35.389 [2024-11-26 04:37:14.606900] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.606907] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.606913] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xac22f0) 00:25:35.389 [2024-11-26 04:37:14.606924] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.389 [2024-11-26 04:37:14.606959] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1aec0, cid 0, qid 0 00:25:35.389 [2024-11-26 04:37:14.607149] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.389 [2024-11-26 04:37:14.607162] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.389 [2024-11-26 04:37:14.607168] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.607175] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1aec0) on tqpair=0xac22f0 00:25:35.389 [2024-11-26 04:37:14.607183] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:35.389 [2024-11-26 04:37:14.607199] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.607208] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.607214] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xac22f0) 00:25:35.389 [2024-11-26 04:37:14.607224] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.389 [2024-11-26 04:37:14.607244] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1aec0, cid 0, qid 0 00:25:35.389 [2024-11-26 04:37:14.607386] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.389 [2024-11-26 04:37:14.607400] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.389 [2024-11-26 04:37:14.607407] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.607414] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1aec0) on tqpair=0xac22f0 00:25:35.389 [2024-11-26 04:37:14.607421] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:35.389 [2024-11-26 04:37:14.607429] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:25:35.389 [2024-11-26 04:37:14.607442] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:25:35.389 [2024-11-26 04:37:14.607466] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:25:35.389 [2024-11-26 04:37:14.607481] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.607489] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.607495] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xac22f0) 00:25:35.389 [2024-11-26 04:37:14.607506] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.389 [2024-11-26 04:37:14.607526] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1aec0, cid 0, qid 0 00:25:35.389 [2024-11-26 04:37:14.607722] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.389 [2024-11-26 04:37:14.607739] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.389 [2024-11-26 04:37:14.607746] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.607753] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xac22f0): datao=0, datal=4096, cccid=0 00:25:35.389 [2024-11-26 04:37:14.607761] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb1aec0) on tqpair(0xac22f0): expected_datao=0, payload_size=4096 00:25:35.389 [2024-11-26 04:37:14.607781] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.389 [2024-11-26 04:37:14.607791] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.652711] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.654 [2024-11-26 04:37:14.652732] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.654 [2024-11-26 04:37:14.652740] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.652747] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1aec0) on tqpair=0xac22f0 00:25:35.654 [2024-11-26 04:37:14.652759] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:25:35.654 [2024-11-26 04:37:14.652768] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:25:35.654 [2024-11-26 04:37:14.652776] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:25:35.654 [2024-11-26 04:37:14.652784] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:25:35.654 [2024-11-26 04:37:14.652791] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:25:35.654 [2024-11-26 04:37:14.652799] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:25:35.654 [2024-11-26 04:37:14.652820] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:25:35.654 [2024-11-26 04:37:14.652834] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.652841] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.652847] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xac22f0) 00:25:35.654 [2024-11-26 04:37:14.652859] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:35.654 [2024-11-26 04:37:14.652882] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1aec0, cid 0, qid 0 00:25:35.654 [2024-11-26 04:37:14.653043] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.654 [2024-11-26 04:37:14.653056] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.654 [2024-11-26 04:37:14.653062] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653074] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1aec0) on tqpair=0xac22f0 00:25:35.654 [2024-11-26 04:37:14.653086] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653094] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653100] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xac22f0) 00:25:35.654 [2024-11-26 04:37:14.653110] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.654 [2024-11-26 04:37:14.653120] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653126] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653133] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xac22f0) 00:25:35.654 [2024-11-26 04:37:14.653141] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.654 [2024-11-26 04:37:14.653150] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653157] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653163] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xac22f0) 00:25:35.654 [2024-11-26 04:37:14.653171] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.654 [2024-11-26 04:37:14.653181] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653187] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653193] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.654 [2024-11-26 04:37:14.653202] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.654 [2024-11-26 04:37:14.653210] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:25:35.654 [2024-11-26 04:37:14.653229] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:35.654 [2024-11-26 04:37:14.653242] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653249] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653255] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xac22f0) 00:25:35.654 [2024-11-26 04:37:14.653265] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.654 [2024-11-26 04:37:14.653303] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1aec0, cid 0, qid 0 00:25:35.654 [2024-11-26 04:37:14.653314] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b020, cid 1, qid 0 00:25:35.654 [2024-11-26 04:37:14.653321] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b180, cid 2, qid 0 00:25:35.654 [2024-11-26 04:37:14.653328] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.654 [2024-11-26 04:37:14.653336] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b440, cid 4, qid 0 00:25:35.654 [2024-11-26 04:37:14.653545] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.654 [2024-11-26 04:37:14.653560] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.654 [2024-11-26 04:37:14.653567] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653574] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b440) on tqpair=0xac22f0 00:25:35.654 [2024-11-26 04:37:14.653582] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:25:35.654 [2024-11-26 04:37:14.653591] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:25:35.654 [2024-11-26 04:37:14.653613] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653623] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653629] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xac22f0) 00:25:35.654 [2024-11-26 04:37:14.653640] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.654 [2024-11-26 04:37:14.653660] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b440, cid 4, qid 0 00:25:35.654 [2024-11-26 04:37:14.653810] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.654 [2024-11-26 04:37:14.653826] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.654 [2024-11-26 04:37:14.653834] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653840] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xac22f0): datao=0, datal=4096, cccid=4 00:25:35.654 [2024-11-26 04:37:14.653848] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb1b440) on tqpair(0xac22f0): expected_datao=0, payload_size=4096 00:25:35.654 [2024-11-26 04:37:14.653859] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653867] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653900] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.654 [2024-11-26 04:37:14.653915] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.654 [2024-11-26 04:37:14.653921] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.654 [2024-11-26 04:37:14.653928] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b440) on tqpair=0xac22f0 00:25:35.655 [2024-11-26 04:37:14.653945] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:25:35.655 [2024-11-26 04:37:14.653984] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.653995] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.654001] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xac22f0) 00:25:35.655 [2024-11-26 04:37:14.654012] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.655 [2024-11-26 04:37:14.654023] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.654029] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.654036] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xac22f0) 00:25:35.655 [2024-11-26 04:37:14.654044] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.655 [2024-11-26 04:37:14.654071] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b440, cid 4, qid 0 00:25:35.655 [2024-11-26 04:37:14.654083] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b5a0, cid 5, qid 0 00:25:35.655 [2024-11-26 04:37:14.654273] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.655 [2024-11-26 04:37:14.654288] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.655 [2024-11-26 04:37:14.654295] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.654301] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xac22f0): datao=0, datal=1024, cccid=4 00:25:35.655 [2024-11-26 04:37:14.654308] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb1b440) on tqpair(0xac22f0): expected_datao=0, payload_size=1024 00:25:35.655 [2024-11-26 04:37:14.654319] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.654326] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.654335] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.655 [2024-11-26 04:37:14.654348] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.655 [2024-11-26 04:37:14.654355] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.654361] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b5a0) on tqpair=0xac22f0 00:25:35.655 [2024-11-26 04:37:14.694856] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.655 [2024-11-26 04:37:14.694875] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.655 [2024-11-26 04:37:14.694883] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.694890] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b440) on tqpair=0xac22f0 00:25:35.655 [2024-11-26 04:37:14.694908] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.694917] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.694923] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xac22f0) 00:25:35.655 [2024-11-26 04:37:14.694934] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.655 [2024-11-26 04:37:14.694963] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b440, cid 4, qid 0 00:25:35.655 [2024-11-26 04:37:14.695082] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.655 [2024-11-26 04:37:14.695097] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.655 [2024-11-26 04:37:14.695104] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.695111] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xac22f0): datao=0, datal=3072, cccid=4 00:25:35.655 [2024-11-26 04:37:14.695118] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb1b440) on tqpair(0xac22f0): expected_datao=0, payload_size=3072 00:25:35.655 [2024-11-26 04:37:14.695129] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.695137] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.695179] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.655 [2024-11-26 04:37:14.695191] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.655 [2024-11-26 04:37:14.695197] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.695204] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b440) on tqpair=0xac22f0 00:25:35.655 [2024-11-26 04:37:14.695218] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.695227] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.695233] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xac22f0) 00:25:35.655 [2024-11-26 04:37:14.695243] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.655 [2024-11-26 04:37:14.695270] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b440, cid 4, qid 0 00:25:35.655 [2024-11-26 04:37:14.695384] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.655 [2024-11-26 04:37:14.695399] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.655 [2024-11-26 04:37:14.695405] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.695412] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xac22f0): datao=0, datal=8, cccid=4 00:25:35.655 [2024-11-26 04:37:14.695419] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xb1b440) on tqpair(0xac22f0): expected_datao=0, payload_size=8 00:25:35.655 [2024-11-26 04:37:14.695429] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.695437] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.739703] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.655 [2024-11-26 04:37:14.739737] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.655 [2024-11-26 04:37:14.739749] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.655 [2024-11-26 04:37:14.739757] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b440) on tqpair=0xac22f0 00:25:35.655 ===================================================== 00:25:35.655 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:25:35.655 ===================================================== 00:25:35.655 Controller Capabilities/Features 00:25:35.655 ================================ 00:25:35.655 Vendor ID: 0000 00:25:35.655 Subsystem Vendor ID: 0000 00:25:35.655 Serial Number: .................... 00:25:35.655 Model Number: ........................................ 00:25:35.655 Firmware Version: 24.01.1 00:25:35.655 Recommended Arb Burst: 0 00:25:35.655 IEEE OUI Identifier: 00 00 00 00:25:35.655 Multi-path I/O 00:25:35.655 May have multiple subsystem ports: No 00:25:35.655 May have multiple controllers: No 00:25:35.655 Associated with SR-IOV VF: No 00:25:35.655 Max Data Transfer Size: 131072 00:25:35.655 Max Number of Namespaces: 0 00:25:35.655 Max Number of I/O Queues: 1024 00:25:35.655 NVMe Specification Version (VS): 1.3 00:25:35.655 NVMe Specification Version (Identify): 1.3 00:25:35.655 Maximum Queue Entries: 128 00:25:35.655 Contiguous Queues Required: Yes 00:25:35.655 Arbitration Mechanisms Supported 00:25:35.655 Weighted Round Robin: Not Supported 00:25:35.655 Vendor Specific: Not Supported 00:25:35.655 Reset Timeout: 15000 ms 00:25:35.655 Doorbell Stride: 4 bytes 00:25:35.655 NVM Subsystem Reset: Not Supported 00:25:35.655 Command Sets Supported 00:25:35.655 NVM Command Set: Supported 00:25:35.655 Boot Partition: Not Supported 00:25:35.655 Memory Page Size Minimum: 4096 bytes 00:25:35.655 Memory Page Size Maximum: 4096 bytes 00:25:35.655 Persistent Memory Region: Not Supported 00:25:35.655 Optional Asynchronous Events Supported 00:25:35.655 Namespace Attribute Notices: Not Supported 00:25:35.655 Firmware Activation Notices: Not Supported 00:25:35.655 ANA Change Notices: Not Supported 00:25:35.655 PLE Aggregate Log Change Notices: Not Supported 00:25:35.655 LBA Status Info Alert Notices: Not Supported 00:25:35.655 EGE Aggregate Log Change Notices: Not Supported 00:25:35.655 Normal NVM Subsystem Shutdown event: Not Supported 00:25:35.655 Zone Descriptor Change Notices: Not Supported 00:25:35.655 Discovery Log Change Notices: Supported 00:25:35.655 Controller Attributes 00:25:35.655 128-bit Host Identifier: Not Supported 00:25:35.655 Non-Operational Permissive Mode: Not Supported 00:25:35.655 NVM Sets: Not Supported 00:25:35.655 Read Recovery Levels: Not Supported 00:25:35.655 Endurance Groups: Not Supported 00:25:35.655 Predictable Latency Mode: Not Supported 00:25:35.655 Traffic Based Keep ALive: Not Supported 00:25:35.655 Namespace Granularity: Not Supported 00:25:35.655 SQ Associations: Not Supported 00:25:35.655 UUID List: Not Supported 00:25:35.655 Multi-Domain Subsystem: Not Supported 00:25:35.655 Fixed Capacity Management: Not Supported 00:25:35.655 Variable Capacity Management: Not Supported 00:25:35.655 Delete Endurance Group: Not Supported 00:25:35.655 Delete NVM Set: Not Supported 00:25:35.655 Extended LBA Formats Supported: Not Supported 00:25:35.655 Flexible Data Placement Supported: Not Supported 00:25:35.655 00:25:35.655 Controller Memory Buffer Support 00:25:35.655 ================================ 00:25:35.655 Supported: No 00:25:35.655 00:25:35.655 Persistent Memory Region Support 00:25:35.655 ================================ 00:25:35.655 Supported: No 00:25:35.656 00:25:35.656 Admin Command Set Attributes 00:25:35.656 ============================ 00:25:35.656 Security Send/Receive: Not Supported 00:25:35.656 Format NVM: Not Supported 00:25:35.656 Firmware Activate/Download: Not Supported 00:25:35.656 Namespace Management: Not Supported 00:25:35.656 Device Self-Test: Not Supported 00:25:35.656 Directives: Not Supported 00:25:35.656 NVMe-MI: Not Supported 00:25:35.656 Virtualization Management: Not Supported 00:25:35.656 Doorbell Buffer Config: Not Supported 00:25:35.656 Get LBA Status Capability: Not Supported 00:25:35.656 Command & Feature Lockdown Capability: Not Supported 00:25:35.656 Abort Command Limit: 1 00:25:35.656 Async Event Request Limit: 4 00:25:35.656 Number of Firmware Slots: N/A 00:25:35.656 Firmware Slot 1 Read-Only: N/A 00:25:35.656 Firmware Activation Without Reset: N/A 00:25:35.656 Multiple Update Detection Support: N/A 00:25:35.656 Firmware Update Granularity: No Information Provided 00:25:35.656 Per-Namespace SMART Log: No 00:25:35.656 Asymmetric Namespace Access Log Page: Not Supported 00:25:35.656 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:25:35.656 Command Effects Log Page: Not Supported 00:25:35.656 Get Log Page Extended Data: Supported 00:25:35.656 Telemetry Log Pages: Not Supported 00:25:35.656 Persistent Event Log Pages: Not Supported 00:25:35.656 Supported Log Pages Log Page: May Support 00:25:35.656 Commands Supported & Effects Log Page: Not Supported 00:25:35.656 Feature Identifiers & Effects Log Page:May Support 00:25:35.656 NVMe-MI Commands & Effects Log Page: May Support 00:25:35.656 Data Area 4 for Telemetry Log: Not Supported 00:25:35.656 Error Log Page Entries Supported: 128 00:25:35.656 Keep Alive: Not Supported 00:25:35.656 00:25:35.656 NVM Command Set Attributes 00:25:35.656 ========================== 00:25:35.656 Submission Queue Entry Size 00:25:35.656 Max: 1 00:25:35.656 Min: 1 00:25:35.656 Completion Queue Entry Size 00:25:35.656 Max: 1 00:25:35.656 Min: 1 00:25:35.656 Number of Namespaces: 0 00:25:35.656 Compare Command: Not Supported 00:25:35.656 Write Uncorrectable Command: Not Supported 00:25:35.656 Dataset Management Command: Not Supported 00:25:35.656 Write Zeroes Command: Not Supported 00:25:35.656 Set Features Save Field: Not Supported 00:25:35.656 Reservations: Not Supported 00:25:35.656 Timestamp: Not Supported 00:25:35.656 Copy: Not Supported 00:25:35.656 Volatile Write Cache: Not Present 00:25:35.656 Atomic Write Unit (Normal): 1 00:25:35.656 Atomic Write Unit (PFail): 1 00:25:35.656 Atomic Compare & Write Unit: 1 00:25:35.656 Fused Compare & Write: Supported 00:25:35.656 Scatter-Gather List 00:25:35.656 SGL Command Set: Supported 00:25:35.656 SGL Keyed: Supported 00:25:35.656 SGL Bit Bucket Descriptor: Not Supported 00:25:35.656 SGL Metadata Pointer: Not Supported 00:25:35.656 Oversized SGL: Not Supported 00:25:35.656 SGL Metadata Address: Not Supported 00:25:35.656 SGL Offset: Supported 00:25:35.656 Transport SGL Data Block: Not Supported 00:25:35.656 Replay Protected Memory Block: Not Supported 00:25:35.656 00:25:35.656 Firmware Slot Information 00:25:35.656 ========================= 00:25:35.656 Active slot: 0 00:25:35.656 00:25:35.656 00:25:35.656 Error Log 00:25:35.656 ========= 00:25:35.656 00:25:35.656 Active Namespaces 00:25:35.656 ================= 00:25:35.656 Discovery Log Page 00:25:35.656 ================== 00:25:35.656 Generation Counter: 2 00:25:35.656 Number of Records: 2 00:25:35.656 Record Format: 0 00:25:35.656 00:25:35.656 Discovery Log Entry 0 00:25:35.656 ---------------------- 00:25:35.656 Transport Type: 3 (TCP) 00:25:35.656 Address Family: 1 (IPv4) 00:25:35.656 Subsystem Type: 3 (Current Discovery Subsystem) 00:25:35.656 Entry Flags: 00:25:35.656 Duplicate Returned Information: 1 00:25:35.656 Explicit Persistent Connection Support for Discovery: 1 00:25:35.656 Transport Requirements: 00:25:35.656 Secure Channel: Not Required 00:25:35.656 Port ID: 0 (0x0000) 00:25:35.656 Controller ID: 65535 (0xffff) 00:25:35.656 Admin Max SQ Size: 128 00:25:35.656 Transport Service Identifier: 4420 00:25:35.656 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:25:35.656 Transport Address: 10.0.0.2 00:25:35.656 Discovery Log Entry 1 00:25:35.656 ---------------------- 00:25:35.656 Transport Type: 3 (TCP) 00:25:35.656 Address Family: 1 (IPv4) 00:25:35.656 Subsystem Type: 2 (NVM Subsystem) 00:25:35.656 Entry Flags: 00:25:35.656 Duplicate Returned Information: 0 00:25:35.656 Explicit Persistent Connection Support for Discovery: 0 00:25:35.656 Transport Requirements: 00:25:35.656 Secure Channel: Not Required 00:25:35.656 Port ID: 0 (0x0000) 00:25:35.656 Controller ID: 65535 (0xffff) 00:25:35.656 Admin Max SQ Size: 128 00:25:35.656 Transport Service Identifier: 4420 00:25:35.656 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:25:35.656 Transport Address: 10.0.0.2 [2024-11-26 04:37:14.739881] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:25:35.656 [2024-11-26 04:37:14.739906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:35.656 [2024-11-26 04:37:14.739918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:35.656 [2024-11-26 04:37:14.739927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:35.656 [2024-11-26 04:37:14.739936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:35.656 [2024-11-26 04:37:14.739950] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.656 [2024-11-26 04:37:14.739957] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.656 [2024-11-26 04:37:14.739964] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.656 [2024-11-26 04:37:14.739975] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.656 [2024-11-26 04:37:14.740000] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.656 [2024-11-26 04:37:14.740144] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.656 [2024-11-26 04:37:14.740160] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.656 [2024-11-26 04:37:14.740167] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.656 [2024-11-26 04:37:14.740173] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.656 [2024-11-26 04:37:14.740185] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.656 [2024-11-26 04:37:14.740192] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.656 [2024-11-26 04:37:14.740199] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.656 [2024-11-26 04:37:14.740209] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.656 [2024-11-26 04:37:14.740235] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.656 [2024-11-26 04:37:14.740400] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.656 [2024-11-26 04:37:14.740412] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.656 [2024-11-26 04:37:14.740419] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.656 [2024-11-26 04:37:14.740425] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.656 [2024-11-26 04:37:14.740433] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:25:35.656 [2024-11-26 04:37:14.740440] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:25:35.656 [2024-11-26 04:37:14.740455] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.656 [2024-11-26 04:37:14.740464] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.656 [2024-11-26 04:37:14.740470] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.656 [2024-11-26 04:37:14.740480] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.656 [2024-11-26 04:37:14.740500] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.656 [2024-11-26 04:37:14.740635] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.656 [2024-11-26 04:37:14.740647] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.656 [2024-11-26 04:37:14.740658] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.656 [2024-11-26 04:37:14.740665] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.656 [2024-11-26 04:37:14.740682] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.656 [2024-11-26 04:37:14.740704] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.656 [2024-11-26 04:37:14.740714] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.656 [2024-11-26 04:37:14.740725] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.657 [2024-11-26 04:37:14.740747] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.657 [2024-11-26 04:37:14.740843] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.657 [2024-11-26 04:37:14.740857] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.657 [2024-11-26 04:37:14.740864] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.740870] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.657 [2024-11-26 04:37:14.740887] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.740896] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.740902] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.657 [2024-11-26 04:37:14.740913] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.657 [2024-11-26 04:37:14.740933] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.657 [2024-11-26 04:37:14.741039] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.657 [2024-11-26 04:37:14.741054] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.657 [2024-11-26 04:37:14.741060] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741067] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.657 [2024-11-26 04:37:14.741083] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741092] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741098] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.657 [2024-11-26 04:37:14.741108] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.657 [2024-11-26 04:37:14.741128] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.657 [2024-11-26 04:37:14.741240] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.657 [2024-11-26 04:37:14.741255] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.657 [2024-11-26 04:37:14.741261] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741268] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.657 [2024-11-26 04:37:14.741284] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741293] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741299] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.657 [2024-11-26 04:37:14.741309] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.657 [2024-11-26 04:37:14.741329] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.657 [2024-11-26 04:37:14.741438] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.657 [2024-11-26 04:37:14.741450] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.657 [2024-11-26 04:37:14.741457] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741472] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.657 [2024-11-26 04:37:14.741490] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741498] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741505] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.657 [2024-11-26 04:37:14.741515] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.657 [2024-11-26 04:37:14.741535] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.657 [2024-11-26 04:37:14.741625] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.657 [2024-11-26 04:37:14.741640] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.657 [2024-11-26 04:37:14.741646] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741653] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.657 [2024-11-26 04:37:14.741669] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741678] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741693] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.657 [2024-11-26 04:37:14.741705] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.657 [2024-11-26 04:37:14.741726] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.657 [2024-11-26 04:37:14.741865] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.657 [2024-11-26 04:37:14.741877] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.657 [2024-11-26 04:37:14.741883] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741890] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.657 [2024-11-26 04:37:14.741905] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741914] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.741920] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.657 [2024-11-26 04:37:14.741930] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.657 [2024-11-26 04:37:14.741950] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.657 [2024-11-26 04:37:14.742040] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.657 [2024-11-26 04:37:14.742054] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.657 [2024-11-26 04:37:14.742061] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742067] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.657 [2024-11-26 04:37:14.742084] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742092] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742099] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.657 [2024-11-26 04:37:14.742109] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.657 [2024-11-26 04:37:14.742129] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.657 [2024-11-26 04:37:14.742237] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.657 [2024-11-26 04:37:14.742249] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.657 [2024-11-26 04:37:14.742256] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742262] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.657 [2024-11-26 04:37:14.742281] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742291] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742297] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.657 [2024-11-26 04:37:14.742307] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.657 [2024-11-26 04:37:14.742327] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.657 [2024-11-26 04:37:14.742416] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.657 [2024-11-26 04:37:14.742430] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.657 [2024-11-26 04:37:14.742437] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742443] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.657 [2024-11-26 04:37:14.742459] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742468] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742474] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.657 [2024-11-26 04:37:14.742484] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.657 [2024-11-26 04:37:14.742504] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.657 [2024-11-26 04:37:14.742597] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.657 [2024-11-26 04:37:14.742609] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.657 [2024-11-26 04:37:14.742616] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742622] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.657 [2024-11-26 04:37:14.742637] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742646] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742652] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.657 [2024-11-26 04:37:14.742662] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.657 [2024-11-26 04:37:14.742682] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.657 [2024-11-26 04:37:14.742795] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.657 [2024-11-26 04:37:14.742810] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.657 [2024-11-26 04:37:14.742817] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742823] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.657 [2024-11-26 04:37:14.742840] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742849] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.657 [2024-11-26 04:37:14.742855] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.657 [2024-11-26 04:37:14.742865] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.657 [2024-11-26 04:37:14.742885] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.657 [2024-11-26 04:37:14.742978] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.657 [2024-11-26 04:37:14.742993] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.657 [2024-11-26 04:37:14.742999] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.743006] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.658 [2024-11-26 04:37:14.743022] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.743034] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.743041] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.658 [2024-11-26 04:37:14.743052] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.658 [2024-11-26 04:37:14.743072] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.658 [2024-11-26 04:37:14.743163] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.658 [2024-11-26 04:37:14.743175] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.658 [2024-11-26 04:37:14.743181] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.743187] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.658 [2024-11-26 04:37:14.743203] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.743212] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.743218] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.658 [2024-11-26 04:37:14.743228] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.658 [2024-11-26 04:37:14.743247] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.658 [2024-11-26 04:37:14.743334] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.658 [2024-11-26 04:37:14.743345] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.658 [2024-11-26 04:37:14.743352] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.743358] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.658 [2024-11-26 04:37:14.743374] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.743382] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.743388] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.658 [2024-11-26 04:37:14.743398] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.658 [2024-11-26 04:37:14.743418] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.658 [2024-11-26 04:37:14.743499] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.658 [2024-11-26 04:37:14.743510] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.658 [2024-11-26 04:37:14.743517] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.743523] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.658 [2024-11-26 04:37:14.743539] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.743547] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.743553] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.658 [2024-11-26 04:37:14.743564] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.658 [2024-11-26 04:37:14.743583] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.658 [2024-11-26 04:37:14.743667] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.658 [2024-11-26 04:37:14.743679] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.658 [2024-11-26 04:37:14.747693] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.747707] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.658 [2024-11-26 04:37:14.747726] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.747735] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.747745] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xac22f0) 00:25:35.658 [2024-11-26 04:37:14.747756] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.658 [2024-11-26 04:37:14.747777] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xb1b2e0, cid 3, qid 0 00:25:35.658 [2024-11-26 04:37:14.747908] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.658 [2024-11-26 04:37:14.747920] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.658 [2024-11-26 04:37:14.747927] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.747933] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xb1b2e0) on tqpair=0xac22f0 00:25:35.658 [2024-11-26 04:37:14.747946] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 7 milliseconds 00:25:35.658 00:25:35.658 04:37:14 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:25:35.658 [2024-11-26 04:37:14.780313] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:35.658 [2024-11-26 04:37:14.780354] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2999925 ] 00:25:35.658 EAL: No free 2048 kB hugepages reported on node 1 00:25:35.658 [2024-11-26 04:37:14.813405] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:25:35.658 [2024-11-26 04:37:14.813453] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:35.658 [2024-11-26 04:37:14.813463] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:35.658 [2024-11-26 04:37:14.813477] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:35.658 [2024-11-26 04:37:14.813489] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:35.658 [2024-11-26 04:37:14.813673] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:25:35.658 [2024-11-26 04:37:14.813724] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x236c2f0 0 00:25:35.658 [2024-11-26 04:37:14.827707] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:35.658 [2024-11-26 04:37:14.827729] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:35.658 [2024-11-26 04:37:14.827737] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:35.658 [2024-11-26 04:37:14.827744] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:35.658 [2024-11-26 04:37:14.827782] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.827794] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.827801] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x236c2f0) 00:25:35.658 [2024-11-26 04:37:14.827814] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:35.658 [2024-11-26 04:37:14.827840] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c4ec0, cid 0, qid 0 00:25:35.658 [2024-11-26 04:37:14.834699] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.658 [2024-11-26 04:37:14.834718] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.658 [2024-11-26 04:37:14.834726] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.834732] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c4ec0) on tqpair=0x236c2f0 00:25:35.658 [2024-11-26 04:37:14.834752] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:35.658 [2024-11-26 04:37:14.834763] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:25:35.658 [2024-11-26 04:37:14.834772] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:25:35.658 [2024-11-26 04:37:14.834788] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.834797] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.834803] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x236c2f0) 00:25:35.658 [2024-11-26 04:37:14.834814] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.658 [2024-11-26 04:37:14.834837] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c4ec0, cid 0, qid 0 00:25:35.658 [2024-11-26 04:37:14.834997] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.658 [2024-11-26 04:37:14.835012] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.658 [2024-11-26 04:37:14.835018] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.835025] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c4ec0) on tqpair=0x236c2f0 00:25:35.658 [2024-11-26 04:37:14.835034] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:25:35.658 [2024-11-26 04:37:14.835047] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:25:35.658 [2024-11-26 04:37:14.835060] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.835067] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.835073] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x236c2f0) 00:25:35.658 [2024-11-26 04:37:14.835083] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.658 [2024-11-26 04:37:14.835105] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c4ec0, cid 0, qid 0 00:25:35.658 [2024-11-26 04:37:14.835247] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.658 [2024-11-26 04:37:14.835259] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.658 [2024-11-26 04:37:14.835265] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.658 [2024-11-26 04:37:14.835272] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c4ec0) on tqpair=0x236c2f0 00:25:35.658 [2024-11-26 04:37:14.835281] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:25:35.658 [2024-11-26 04:37:14.835294] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:25:35.658 [2024-11-26 04:37:14.835305] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.835312] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.835318] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x236c2f0) 00:25:35.659 [2024-11-26 04:37:14.835328] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.659 [2024-11-26 04:37:14.835349] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c4ec0, cid 0, qid 0 00:25:35.659 [2024-11-26 04:37:14.835450] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.659 [2024-11-26 04:37:14.835465] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.659 [2024-11-26 04:37:14.835472] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.835478] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c4ec0) on tqpair=0x236c2f0 00:25:35.659 [2024-11-26 04:37:14.835491] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:35.659 [2024-11-26 04:37:14.835509] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.835518] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.835525] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x236c2f0) 00:25:35.659 [2024-11-26 04:37:14.835535] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.659 [2024-11-26 04:37:14.835555] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c4ec0, cid 0, qid 0 00:25:35.659 [2024-11-26 04:37:14.835710] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.659 [2024-11-26 04:37:14.835727] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.659 [2024-11-26 04:37:14.835734] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.835740] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c4ec0) on tqpair=0x236c2f0 00:25:35.659 [2024-11-26 04:37:14.835749] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:25:35.659 [2024-11-26 04:37:14.835757] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:25:35.659 [2024-11-26 04:37:14.835771] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:35.659 [2024-11-26 04:37:14.835881] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:25:35.659 [2024-11-26 04:37:14.835888] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:35.659 [2024-11-26 04:37:14.835900] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.835907] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.835913] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x236c2f0) 00:25:35.659 [2024-11-26 04:37:14.835922] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.659 [2024-11-26 04:37:14.835944] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c4ec0, cid 0, qid 0 00:25:35.659 [2024-11-26 04:37:14.836098] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.659 [2024-11-26 04:37:14.836111] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.659 [2024-11-26 04:37:14.836117] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.836123] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c4ec0) on tqpair=0x236c2f0 00:25:35.659 [2024-11-26 04:37:14.836132] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:35.659 [2024-11-26 04:37:14.836148] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.836157] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.836163] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x236c2f0) 00:25:35.659 [2024-11-26 04:37:14.836173] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.659 [2024-11-26 04:37:14.836193] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c4ec0, cid 0, qid 0 00:25:35.659 [2024-11-26 04:37:14.836300] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.659 [2024-11-26 04:37:14.836312] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.659 [2024-11-26 04:37:14.836319] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.836325] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c4ec0) on tqpair=0x236c2f0 00:25:35.659 [2024-11-26 04:37:14.836337] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:35.659 [2024-11-26 04:37:14.836346] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:25:35.659 [2024-11-26 04:37:14.836359] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:25:35.659 [2024-11-26 04:37:14.836373] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:25:35.659 [2024-11-26 04:37:14.836386] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.836393] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.836399] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x236c2f0) 00:25:35.659 [2024-11-26 04:37:14.836409] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.659 [2024-11-26 04:37:14.836430] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c4ec0, cid 0, qid 0 00:25:35.659 [2024-11-26 04:37:14.836566] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.659 [2024-11-26 04:37:14.836581] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.659 [2024-11-26 04:37:14.836588] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.836594] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x236c2f0): datao=0, datal=4096, cccid=0 00:25:35.659 [2024-11-26 04:37:14.836601] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23c4ec0) on tqpair(0x236c2f0): expected_datao=0, payload_size=4096 00:25:35.659 [2024-11-26 04:37:14.836623] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.836632] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.836721] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.659 [2024-11-26 04:37:14.836737] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.659 [2024-11-26 04:37:14.836743] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.836750] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c4ec0) on tqpair=0x236c2f0 00:25:35.659 [2024-11-26 04:37:14.836761] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:25:35.659 [2024-11-26 04:37:14.836769] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:25:35.659 [2024-11-26 04:37:14.836777] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:25:35.659 [2024-11-26 04:37:14.836783] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:25:35.659 [2024-11-26 04:37:14.836791] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:25:35.659 [2024-11-26 04:37:14.836798] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:25:35.659 [2024-11-26 04:37:14.836816] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:25:35.659 [2024-11-26 04:37:14.836829] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.836837] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.836843] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x236c2f0) 00:25:35.659 [2024-11-26 04:37:14.836853] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:35.659 [2024-11-26 04:37:14.836875] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c4ec0, cid 0, qid 0 00:25:35.659 [2024-11-26 04:37:14.836979] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.659 [2024-11-26 04:37:14.836994] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.659 [2024-11-26 04:37:14.837000] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.837006] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c4ec0) on tqpair=0x236c2f0 00:25:35.659 [2024-11-26 04:37:14.837018] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.837025] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.837031] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x236c2f0) 00:25:35.659 [2024-11-26 04:37:14.837040] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.659 [2024-11-26 04:37:14.837050] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.837057] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.659 [2024-11-26 04:37:14.837063] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x236c2f0) 00:25:35.660 [2024-11-26 04:37:14.837071] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.660 [2024-11-26 04:37:14.837080] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.837086] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.837092] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x236c2f0) 00:25:35.660 [2024-11-26 04:37:14.837101] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.660 [2024-11-26 04:37:14.837110] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.837116] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.837122] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x236c2f0) 00:25:35.660 [2024-11-26 04:37:14.837131] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.660 [2024-11-26 04:37:14.837139] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:25:35.660 [2024-11-26 04:37:14.837173] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:35.660 [2024-11-26 04:37:14.837186] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.837193] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.837199] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x236c2f0) 00:25:35.660 [2024-11-26 04:37:14.837208] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.660 [2024-11-26 04:37:14.837244] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c4ec0, cid 0, qid 0 00:25:35.660 [2024-11-26 04:37:14.837255] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c5020, cid 1, qid 0 00:25:35.660 [2024-11-26 04:37:14.837262] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c5180, cid 2, qid 0 00:25:35.660 [2024-11-26 04:37:14.837268] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c52e0, cid 3, qid 0 00:25:35.660 [2024-11-26 04:37:14.837275] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c5440, cid 4, qid 0 00:25:35.660 [2024-11-26 04:37:14.837478] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.660 [2024-11-26 04:37:14.837491] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.660 [2024-11-26 04:37:14.837498] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.837508] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c5440) on tqpair=0x236c2f0 00:25:35.660 [2024-11-26 04:37:14.837517] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:25:35.660 [2024-11-26 04:37:14.837526] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:25:35.660 [2024-11-26 04:37:14.837539] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:25:35.660 [2024-11-26 04:37:14.837553] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:25:35.660 [2024-11-26 04:37:14.837565] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.837572] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.837578] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x236c2f0) 00:25:35.660 [2024-11-26 04:37:14.837603] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:35.660 [2024-11-26 04:37:14.837623] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c5440, cid 4, qid 0 00:25:35.660 [2024-11-26 04:37:14.837815] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.660 [2024-11-26 04:37:14.837829] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.660 [2024-11-26 04:37:14.837835] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.837842] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c5440) on tqpair=0x236c2f0 00:25:35.660 [2024-11-26 04:37:14.837908] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:25:35.660 [2024-11-26 04:37:14.837925] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:25:35.660 [2024-11-26 04:37:14.837939] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.837946] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.837952] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x236c2f0) 00:25:35.660 [2024-11-26 04:37:14.837978] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.660 [2024-11-26 04:37:14.837999] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c5440, cid 4, qid 0 00:25:35.660 [2024-11-26 04:37:14.838176] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.660 [2024-11-26 04:37:14.838192] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.660 [2024-11-26 04:37:14.838199] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.838205] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x236c2f0): datao=0, datal=4096, cccid=4 00:25:35.660 [2024-11-26 04:37:14.838212] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23c5440) on tqpair(0x236c2f0): expected_datao=0, payload_size=4096 00:25:35.660 [2024-11-26 04:37:14.838236] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.660 [2024-11-26 04:37:14.838245] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.923 [2024-11-26 04:37:14.880735] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.923 [2024-11-26 04:37:14.880754] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.923 [2024-11-26 04:37:14.880762] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.923 [2024-11-26 04:37:14.880769] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c5440) on tqpair=0x236c2f0 00:25:35.923 [2024-11-26 04:37:14.880790] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:25:35.923 [2024-11-26 04:37:14.880809] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:25:35.923 [2024-11-26 04:37:14.880827] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:25:35.923 [2024-11-26 04:37:14.880840] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.923 [2024-11-26 04:37:14.880848] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.923 [2024-11-26 04:37:14.880854] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x236c2f0) 00:25:35.923 [2024-11-26 04:37:14.880864] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.923 [2024-11-26 04:37:14.880888] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c5440, cid 4, qid 0 00:25:35.923 [2024-11-26 04:37:14.881051] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.923 [2024-11-26 04:37:14.881063] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.923 [2024-11-26 04:37:14.881070] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.923 [2024-11-26 04:37:14.881076] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x236c2f0): datao=0, datal=4096, cccid=4 00:25:35.923 [2024-11-26 04:37:14.881084] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23c5440) on tqpair(0x236c2f0): expected_datao=0, payload_size=4096 00:25:35.923 [2024-11-26 04:37:14.881127] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.923 [2024-11-26 04:37:14.881137] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.923 [2024-11-26 04:37:14.921837] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.923 [2024-11-26 04:37:14.921857] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.923 [2024-11-26 04:37:14.921865] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.923 [2024-11-26 04:37:14.921872] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c5440) on tqpair=0x236c2f0 00:25:35.924 [2024-11-26 04:37:14.921897] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:25:35.924 [2024-11-26 04:37:14.921917] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:25:35.924 [2024-11-26 04:37:14.921931] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.921938] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.921945] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x236c2f0) 00:25:35.924 [2024-11-26 04:37:14.921956] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.924 [2024-11-26 04:37:14.921979] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c5440, cid 4, qid 0 00:25:35.924 [2024-11-26 04:37:14.922094] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.924 [2024-11-26 04:37:14.922107] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.924 [2024-11-26 04:37:14.922114] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922120] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x236c2f0): datao=0, datal=4096, cccid=4 00:25:35.924 [2024-11-26 04:37:14.922127] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23c5440) on tqpair(0x236c2f0): expected_datao=0, payload_size=4096 00:25:35.924 [2024-11-26 04:37:14.922138] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922145] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922157] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.924 [2024-11-26 04:37:14.922166] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.924 [2024-11-26 04:37:14.922173] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922183] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c5440) on tqpair=0x236c2f0 00:25:35.924 [2024-11-26 04:37:14.922197] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:25:35.924 [2024-11-26 04:37:14.922212] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:25:35.924 [2024-11-26 04:37:14.922227] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:25:35.924 [2024-11-26 04:37:14.922238] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:25:35.924 [2024-11-26 04:37:14.922261] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:25:35.924 [2024-11-26 04:37:14.922270] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:25:35.924 [2024-11-26 04:37:14.922277] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:25:35.924 [2024-11-26 04:37:14.922285] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:25:35.924 [2024-11-26 04:37:14.922304] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922312] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922318] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x236c2f0) 00:25:35.924 [2024-11-26 04:37:14.922328] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.924 [2024-11-26 04:37:14.922339] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922345] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922351] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x236c2f0) 00:25:35.924 [2024-11-26 04:37:14.922359] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.924 [2024-11-26 04:37:14.922399] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c5440, cid 4, qid 0 00:25:35.924 [2024-11-26 04:37:14.922410] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c55a0, cid 5, qid 0 00:25:35.924 [2024-11-26 04:37:14.922591] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.924 [2024-11-26 04:37:14.922604] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.924 [2024-11-26 04:37:14.922611] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922617] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c5440) on tqpair=0x236c2f0 00:25:35.924 [2024-11-26 04:37:14.922628] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.924 [2024-11-26 04:37:14.922637] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.924 [2024-11-26 04:37:14.922643] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922649] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c55a0) on tqpair=0x236c2f0 00:25:35.924 [2024-11-26 04:37:14.922665] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922674] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922680] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x236c2f0) 00:25:35.924 [2024-11-26 04:37:14.922699] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.924 [2024-11-26 04:37:14.922722] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c55a0, cid 5, qid 0 00:25:35.924 [2024-11-26 04:37:14.922842] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.924 [2024-11-26 04:37:14.922855] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.924 [2024-11-26 04:37:14.922861] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922867] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c55a0) on tqpair=0x236c2f0 00:25:35.924 [2024-11-26 04:37:14.922883] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922892] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.922898] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x236c2f0) 00:25:35.924 [2024-11-26 04:37:14.922908] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.924 [2024-11-26 04:37:14.922928] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c55a0, cid 5, qid 0 00:25:35.924 [2024-11-26 04:37:14.923033] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.924 [2024-11-26 04:37:14.923045] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.924 [2024-11-26 04:37:14.923051] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923057] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c55a0) on tqpair=0x236c2f0 00:25:35.924 [2024-11-26 04:37:14.923073] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923081] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923088] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x236c2f0) 00:25:35.924 [2024-11-26 04:37:14.923098] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.924 [2024-11-26 04:37:14.923117] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c55a0, cid 5, qid 0 00:25:35.924 [2024-11-26 04:37:14.923222] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.924 [2024-11-26 04:37:14.923234] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.924 [2024-11-26 04:37:14.923240] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923246] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c55a0) on tqpair=0x236c2f0 00:25:35.924 [2024-11-26 04:37:14.923265] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923275] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923281] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x236c2f0) 00:25:35.924 [2024-11-26 04:37:14.923291] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.924 [2024-11-26 04:37:14.923302] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923310] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923316] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x236c2f0) 00:25:35.924 [2024-11-26 04:37:14.923324] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.924 [2024-11-26 04:37:14.923335] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923342] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923348] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x236c2f0) 00:25:35.924 [2024-11-26 04:37:14.923357] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.924 [2024-11-26 04:37:14.923368] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923379] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923386] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x236c2f0) 00:25:35.924 [2024-11-26 04:37:14.923410] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.924 [2024-11-26 04:37:14.923431] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c55a0, cid 5, qid 0 00:25:35.924 [2024-11-26 04:37:14.923442] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c5440, cid 4, qid 0 00:25:35.924 [2024-11-26 04:37:14.923449] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c5700, cid 6, qid 0 00:25:35.924 [2024-11-26 04:37:14.923455] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c5860, cid 7, qid 0 00:25:35.924 [2024-11-26 04:37:14.923706] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.924 [2024-11-26 04:37:14.923719] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.924 [2024-11-26 04:37:14.923726] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923732] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x236c2f0): datao=0, datal=8192, cccid=5 00:25:35.924 [2024-11-26 04:37:14.923739] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23c55a0) on tqpair(0x236c2f0): expected_datao=0, payload_size=8192 00:25:35.924 [2024-11-26 04:37:14.923772] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923782] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.924 [2024-11-26 04:37:14.923791] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.924 [2024-11-26 04:37:14.923800] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.925 [2024-11-26 04:37:14.923806] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.923812] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x236c2f0): datao=0, datal=512, cccid=4 00:25:35.925 [2024-11-26 04:37:14.923819] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23c5440) on tqpair(0x236c2f0): expected_datao=0, payload_size=512 00:25:35.925 [2024-11-26 04:37:14.923829] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.923836] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.923844] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.925 [2024-11-26 04:37:14.923852] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.925 [2024-11-26 04:37:14.923858] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.923864] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x236c2f0): datao=0, datal=512, cccid=6 00:25:35.925 [2024-11-26 04:37:14.923871] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23c5700) on tqpair(0x236c2f0): expected_datao=0, payload_size=512 00:25:35.925 [2024-11-26 04:37:14.923881] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.923888] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.923896] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:35.925 [2024-11-26 04:37:14.923904] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:35.925 [2024-11-26 04:37:14.923911] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.923916] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x236c2f0): datao=0, datal=4096, cccid=7 00:25:35.925 [2024-11-26 04:37:14.923923] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23c5860) on tqpair(0x236c2f0): expected_datao=0, payload_size=4096 00:25:35.925 [2024-11-26 04:37:14.923934] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.923941] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.923952] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.925 [2024-11-26 04:37:14.923965] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.925 [2024-11-26 04:37:14.923972] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.923978] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c55a0) on tqpair=0x236c2f0 00:25:35.925 [2024-11-26 04:37:14.923998] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.925 [2024-11-26 04:37:14.924010] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.925 [2024-11-26 04:37:14.924016] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.924022] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c5440) on tqpair=0x236c2f0 00:25:35.925 [2024-11-26 04:37:14.924037] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.925 [2024-11-26 04:37:14.924064] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.925 [2024-11-26 04:37:14.924070] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.924076] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c5700) on tqpair=0x236c2f0 00:25:35.925 [2024-11-26 04:37:14.924087] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.925 [2024-11-26 04:37:14.924096] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.925 [2024-11-26 04:37:14.924102] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.925 [2024-11-26 04:37:14.924123] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c5860) on tqpair=0x236c2f0 00:25:35.925 ===================================================== 00:25:35.925 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:35.925 ===================================================== 00:25:35.925 Controller Capabilities/Features 00:25:35.925 ================================ 00:25:35.925 Vendor ID: 8086 00:25:35.925 Subsystem Vendor ID: 8086 00:25:35.925 Serial Number: SPDK00000000000001 00:25:35.925 Model Number: SPDK bdev Controller 00:25:35.925 Firmware Version: 24.01.1 00:25:35.925 Recommended Arb Burst: 6 00:25:35.925 IEEE OUI Identifier: e4 d2 5c 00:25:35.925 Multi-path I/O 00:25:35.925 May have multiple subsystem ports: Yes 00:25:35.925 May have multiple controllers: Yes 00:25:35.925 Associated with SR-IOV VF: No 00:25:35.925 Max Data Transfer Size: 131072 00:25:35.925 Max Number of Namespaces: 32 00:25:35.925 Max Number of I/O Queues: 127 00:25:35.925 NVMe Specification Version (VS): 1.3 00:25:35.925 NVMe Specification Version (Identify): 1.3 00:25:35.925 Maximum Queue Entries: 128 00:25:35.925 Contiguous Queues Required: Yes 00:25:35.925 Arbitration Mechanisms Supported 00:25:35.925 Weighted Round Robin: Not Supported 00:25:35.925 Vendor Specific: Not Supported 00:25:35.925 Reset Timeout: 15000 ms 00:25:35.925 Doorbell Stride: 4 bytes 00:25:35.925 NVM Subsystem Reset: Not Supported 00:25:35.925 Command Sets Supported 00:25:35.925 NVM Command Set: Supported 00:25:35.925 Boot Partition: Not Supported 00:25:35.925 Memory Page Size Minimum: 4096 bytes 00:25:35.925 Memory Page Size Maximum: 4096 bytes 00:25:35.925 Persistent Memory Region: Not Supported 00:25:35.925 Optional Asynchronous Events Supported 00:25:35.925 Namespace Attribute Notices: Supported 00:25:35.925 Firmware Activation Notices: Not Supported 00:25:35.925 ANA Change Notices: Not Supported 00:25:35.925 PLE Aggregate Log Change Notices: Not Supported 00:25:35.925 LBA Status Info Alert Notices: Not Supported 00:25:35.925 EGE Aggregate Log Change Notices: Not Supported 00:25:35.925 Normal NVM Subsystem Shutdown event: Not Supported 00:25:35.925 Zone Descriptor Change Notices: Not Supported 00:25:35.925 Discovery Log Change Notices: Not Supported 00:25:35.925 Controller Attributes 00:25:35.925 128-bit Host Identifier: Supported 00:25:35.925 Non-Operational Permissive Mode: Not Supported 00:25:35.925 NVM Sets: Not Supported 00:25:35.925 Read Recovery Levels: Not Supported 00:25:35.925 Endurance Groups: Not Supported 00:25:35.925 Predictable Latency Mode: Not Supported 00:25:35.925 Traffic Based Keep ALive: Not Supported 00:25:35.925 Namespace Granularity: Not Supported 00:25:35.925 SQ Associations: Not Supported 00:25:35.925 UUID List: Not Supported 00:25:35.925 Multi-Domain Subsystem: Not Supported 00:25:35.925 Fixed Capacity Management: Not Supported 00:25:35.925 Variable Capacity Management: Not Supported 00:25:35.925 Delete Endurance Group: Not Supported 00:25:35.925 Delete NVM Set: Not Supported 00:25:35.925 Extended LBA Formats Supported: Not Supported 00:25:35.925 Flexible Data Placement Supported: Not Supported 00:25:35.925 00:25:35.925 Controller Memory Buffer Support 00:25:35.925 ================================ 00:25:35.925 Supported: No 00:25:35.925 00:25:35.925 Persistent Memory Region Support 00:25:35.925 ================================ 00:25:35.925 Supported: No 00:25:35.925 00:25:35.925 Admin Command Set Attributes 00:25:35.925 ============================ 00:25:35.925 Security Send/Receive: Not Supported 00:25:35.925 Format NVM: Not Supported 00:25:35.925 Firmware Activate/Download: Not Supported 00:25:35.925 Namespace Management: Not Supported 00:25:35.925 Device Self-Test: Not Supported 00:25:35.925 Directives: Not Supported 00:25:35.925 NVMe-MI: Not Supported 00:25:35.925 Virtualization Management: Not Supported 00:25:35.925 Doorbell Buffer Config: Not Supported 00:25:35.925 Get LBA Status Capability: Not Supported 00:25:35.925 Command & Feature Lockdown Capability: Not Supported 00:25:35.925 Abort Command Limit: 4 00:25:35.925 Async Event Request Limit: 4 00:25:35.925 Number of Firmware Slots: N/A 00:25:35.925 Firmware Slot 1 Read-Only: N/A 00:25:35.925 Firmware Activation Without Reset: N/A 00:25:35.925 Multiple Update Detection Support: N/A 00:25:35.925 Firmware Update Granularity: No Information Provided 00:25:35.925 Per-Namespace SMART Log: No 00:25:35.925 Asymmetric Namespace Access Log Page: Not Supported 00:25:35.925 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:25:35.925 Command Effects Log Page: Supported 00:25:35.925 Get Log Page Extended Data: Supported 00:25:35.925 Telemetry Log Pages: Not Supported 00:25:35.925 Persistent Event Log Pages: Not Supported 00:25:35.925 Supported Log Pages Log Page: May Support 00:25:35.925 Commands Supported & Effects Log Page: Not Supported 00:25:35.925 Feature Identifiers & Effects Log Page:May Support 00:25:35.925 NVMe-MI Commands & Effects Log Page: May Support 00:25:35.925 Data Area 4 for Telemetry Log: Not Supported 00:25:35.925 Error Log Page Entries Supported: 128 00:25:35.925 Keep Alive: Supported 00:25:35.925 Keep Alive Granularity: 10000 ms 00:25:35.925 00:25:35.925 NVM Command Set Attributes 00:25:35.925 ========================== 00:25:35.925 Submission Queue Entry Size 00:25:35.925 Max: 64 00:25:35.925 Min: 64 00:25:35.925 Completion Queue Entry Size 00:25:35.925 Max: 16 00:25:35.925 Min: 16 00:25:35.925 Number of Namespaces: 32 00:25:35.925 Compare Command: Supported 00:25:35.925 Write Uncorrectable Command: Not Supported 00:25:35.925 Dataset Management Command: Supported 00:25:35.925 Write Zeroes Command: Supported 00:25:35.925 Set Features Save Field: Not Supported 00:25:35.925 Reservations: Supported 00:25:35.925 Timestamp: Not Supported 00:25:35.925 Copy: Supported 00:25:35.925 Volatile Write Cache: Present 00:25:35.925 Atomic Write Unit (Normal): 1 00:25:35.926 Atomic Write Unit (PFail): 1 00:25:35.926 Atomic Compare & Write Unit: 1 00:25:35.926 Fused Compare & Write: Supported 00:25:35.926 Scatter-Gather List 00:25:35.926 SGL Command Set: Supported 00:25:35.926 SGL Keyed: Supported 00:25:35.926 SGL Bit Bucket Descriptor: Not Supported 00:25:35.926 SGL Metadata Pointer: Not Supported 00:25:35.926 Oversized SGL: Not Supported 00:25:35.926 SGL Metadata Address: Not Supported 00:25:35.926 SGL Offset: Supported 00:25:35.926 Transport SGL Data Block: Not Supported 00:25:35.926 Replay Protected Memory Block: Not Supported 00:25:35.926 00:25:35.926 Firmware Slot Information 00:25:35.926 ========================= 00:25:35.926 Active slot: 1 00:25:35.926 Slot 1 Firmware Revision: 24.01.1 00:25:35.926 00:25:35.926 00:25:35.926 Commands Supported and Effects 00:25:35.926 ============================== 00:25:35.926 Admin Commands 00:25:35.926 -------------- 00:25:35.926 Get Log Page (02h): Supported 00:25:35.926 Identify (06h): Supported 00:25:35.926 Abort (08h): Supported 00:25:35.926 Set Features (09h): Supported 00:25:35.926 Get Features (0Ah): Supported 00:25:35.926 Asynchronous Event Request (0Ch): Supported 00:25:35.926 Keep Alive (18h): Supported 00:25:35.926 I/O Commands 00:25:35.926 ------------ 00:25:35.926 Flush (00h): Supported LBA-Change 00:25:35.926 Write (01h): Supported LBA-Change 00:25:35.926 Read (02h): Supported 00:25:35.926 Compare (05h): Supported 00:25:35.926 Write Zeroes (08h): Supported LBA-Change 00:25:35.926 Dataset Management (09h): Supported LBA-Change 00:25:35.926 Copy (19h): Supported LBA-Change 00:25:35.926 Unknown (79h): Supported LBA-Change 00:25:35.926 Unknown (7Ah): Supported 00:25:35.926 00:25:35.926 Error Log 00:25:35.926 ========= 00:25:35.926 00:25:35.926 Arbitration 00:25:35.926 =========== 00:25:35.926 Arbitration Burst: 1 00:25:35.926 00:25:35.926 Power Management 00:25:35.926 ================ 00:25:35.926 Number of Power States: 1 00:25:35.926 Current Power State: Power State #0 00:25:35.926 Power State #0: 00:25:35.926 Max Power: 0.00 W 00:25:35.926 Non-Operational State: Operational 00:25:35.926 Entry Latency: Not Reported 00:25:35.926 Exit Latency: Not Reported 00:25:35.926 Relative Read Throughput: 0 00:25:35.926 Relative Read Latency: 0 00:25:35.926 Relative Write Throughput: 0 00:25:35.926 Relative Write Latency: 0 00:25:35.926 Idle Power: Not Reported 00:25:35.926 Active Power: Not Reported 00:25:35.926 Non-Operational Permissive Mode: Not Supported 00:25:35.926 00:25:35.926 Health Information 00:25:35.926 ================== 00:25:35.926 Critical Warnings: 00:25:35.926 Available Spare Space: OK 00:25:35.926 Temperature: OK 00:25:35.926 Device Reliability: OK 00:25:35.926 Read Only: No 00:25:35.926 Volatile Memory Backup: OK 00:25:35.926 Current Temperature: 0 Kelvin (-273 Celsius) 00:25:35.926 Temperature Threshold: [2024-11-26 04:37:14.924241] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.924252] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.924258] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x236c2f0) 00:25:35.926 [2024-11-26 04:37:14.924268] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.926 [2024-11-26 04:37:14.924288] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c5860, cid 7, qid 0 00:25:35.926 [2024-11-26 04:37:14.924443] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.926 [2024-11-26 04:37:14.924456] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.926 [2024-11-26 04:37:14.924462] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.924468] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c5860) on tqpair=0x236c2f0 00:25:35.926 [2024-11-26 04:37:14.924511] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:25:35.926 [2024-11-26 04:37:14.924532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:35.926 [2024-11-26 04:37:14.924544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:35.926 [2024-11-26 04:37:14.924553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:35.926 [2024-11-26 04:37:14.924562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:35.926 [2024-11-26 04:37:14.924575] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.924583] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.924589] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x236c2f0) 00:25:35.926 [2024-11-26 04:37:14.924615] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.926 [2024-11-26 04:37:14.924637] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c52e0, cid 3, qid 0 00:25:35.926 [2024-11-26 04:37:14.924804] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.926 [2024-11-26 04:37:14.924820] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.926 [2024-11-26 04:37:14.924831] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.924838] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c52e0) on tqpair=0x236c2f0 00:25:35.926 [2024-11-26 04:37:14.924850] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.924858] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.924864] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x236c2f0) 00:25:35.926 [2024-11-26 04:37:14.924874] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.926 [2024-11-26 04:37:14.924899] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c52e0, cid 3, qid 0 00:25:35.926 [2024-11-26 04:37:14.925009] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.926 [2024-11-26 04:37:14.925021] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.926 [2024-11-26 04:37:14.925027] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.925033] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c52e0) on tqpair=0x236c2f0 00:25:35.926 [2024-11-26 04:37:14.925042] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:25:35.926 [2024-11-26 04:37:14.925049] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:25:35.926 [2024-11-26 04:37:14.925064] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.925073] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.925079] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x236c2f0) 00:25:35.926 [2024-11-26 04:37:14.925089] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.926 [2024-11-26 04:37:14.925109] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c52e0, cid 3, qid 0 00:25:35.926 [2024-11-26 04:37:14.925209] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.926 [2024-11-26 04:37:14.925223] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.926 [2024-11-26 04:37:14.925229] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.925236] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c52e0) on tqpair=0x236c2f0 00:25:35.926 [2024-11-26 04:37:14.925253] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.925262] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.925268] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x236c2f0) 00:25:35.926 [2024-11-26 04:37:14.925278] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.926 [2024-11-26 04:37:14.925297] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c52e0, cid 3, qid 0 00:25:35.926 [2024-11-26 04:37:14.925397] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.926 [2024-11-26 04:37:14.925412] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.926 [2024-11-26 04:37:14.925419] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.925425] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c52e0) on tqpair=0x236c2f0 00:25:35.926 [2024-11-26 04:37:14.925442] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.925451] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.925457] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x236c2f0) 00:25:35.926 [2024-11-26 04:37:14.925467] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.926 [2024-11-26 04:37:14.925486] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c52e0, cid 3, qid 0 00:25:35.926 [2024-11-26 04:37:14.925575] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.926 [2024-11-26 04:37:14.925587] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.926 [2024-11-26 04:37:14.925594] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.925600] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c52e0) on tqpair=0x236c2f0 00:25:35.926 [2024-11-26 04:37:14.925617] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.925626] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.926 [2024-11-26 04:37:14.925632] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x236c2f0) 00:25:35.926 [2024-11-26 04:37:14.925642] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.926 [2024-11-26 04:37:14.925661] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c52e0, cid 3, qid 0 00:25:35.926 [2024-11-26 04:37:14.929700] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.926 [2024-11-26 04:37:14.929722] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.927 [2024-11-26 04:37:14.929731] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.927 [2024-11-26 04:37:14.929738] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c52e0) on tqpair=0x236c2f0 00:25:35.927 [2024-11-26 04:37:14.929759] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:35.927 [2024-11-26 04:37:14.929768] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:35.927 [2024-11-26 04:37:14.929774] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x236c2f0) 00:25:35.927 [2024-11-26 04:37:14.929784] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.927 [2024-11-26 04:37:14.929805] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23c52e0, cid 3, qid 0 00:25:35.927 [2024-11-26 04:37:14.929951] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:35.927 [2024-11-26 04:37:14.929963] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:35.927 [2024-11-26 04:37:14.929970] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:35.927 [2024-11-26 04:37:14.929976] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23c52e0) on tqpair=0x236c2f0 00:25:35.927 [2024-11-26 04:37:14.929990] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:25:35.927 0 Kelvin (-273 Celsius) 00:25:35.927 Available Spare: 0% 00:25:35.927 Available Spare Threshold: 0% 00:25:35.927 Life Percentage Used: 0% 00:25:35.927 Data Units Read: 0 00:25:35.927 Data Units Written: 0 00:25:35.927 Host Read Commands: 0 00:25:35.927 Host Write Commands: 0 00:25:35.927 Controller Busy Time: 0 minutes 00:25:35.927 Power Cycles: 0 00:25:35.927 Power On Hours: 0 hours 00:25:35.927 Unsafe Shutdowns: 0 00:25:35.927 Unrecoverable Media Errors: 0 00:25:35.927 Lifetime Error Log Entries: 0 00:25:35.927 Warning Temperature Time: 0 minutes 00:25:35.927 Critical Temperature Time: 0 minutes 00:25:35.927 00:25:35.927 Number of Queues 00:25:35.927 ================ 00:25:35.927 Number of I/O Submission Queues: 127 00:25:35.927 Number of I/O Completion Queues: 127 00:25:35.927 00:25:35.927 Active Namespaces 00:25:35.927 ================= 00:25:35.927 Namespace ID:1 00:25:35.927 Error Recovery Timeout: Unlimited 00:25:35.927 Command Set Identifier: NVM (00h) 00:25:35.927 Deallocate: Supported 00:25:35.927 Deallocated/Unwritten Error: Not Supported 00:25:35.927 Deallocated Read Value: Unknown 00:25:35.927 Deallocate in Write Zeroes: Not Supported 00:25:35.927 Deallocated Guard Field: 0xFFFF 00:25:35.927 Flush: Supported 00:25:35.927 Reservation: Supported 00:25:35.927 Namespace Sharing Capabilities: Multiple Controllers 00:25:35.927 Size (in LBAs): 131072 (0GiB) 00:25:35.927 Capacity (in LBAs): 131072 (0GiB) 00:25:35.927 Utilization (in LBAs): 131072 (0GiB) 00:25:35.927 NGUID: ABCDEF0123456789ABCDEF0123456789 00:25:35.927 EUI64: ABCDEF0123456789 00:25:35.927 UUID: f1f372ee-e97b-4dfa-bf48-c170c7d41d71 00:25:35.927 Thin Provisioning: Not Supported 00:25:35.927 Per-NS Atomic Units: Yes 00:25:35.927 Atomic Boundary Size (Normal): 0 00:25:35.927 Atomic Boundary Size (PFail): 0 00:25:35.927 Atomic Boundary Offset: 0 00:25:35.927 Maximum Single Source Range Length: 65535 00:25:35.927 Maximum Copy Length: 65535 00:25:35.927 Maximum Source Range Count: 1 00:25:35.927 NGUID/EUI64 Never Reused: No 00:25:35.927 Namespace Write Protected: No 00:25:35.927 Number of LBA Formats: 1 00:25:35.927 Current LBA Format: LBA Format #00 00:25:35.927 LBA Format #00: Data Size: 512 Metadata Size: 0 00:25:35.927 00:25:35.927 04:37:14 -- host/identify.sh@51 -- # sync 00:25:35.927 04:37:14 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:35.927 04:37:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.927 04:37:14 -- common/autotest_common.sh@10 -- # set +x 00:25:35.927 04:37:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.927 04:37:14 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:25:35.927 04:37:14 -- host/identify.sh@56 -- # nvmftestfini 00:25:35.927 04:37:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:35.927 04:37:14 -- nvmf/common.sh@116 -- # sync 00:25:35.927 04:37:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:35.927 04:37:14 -- nvmf/common.sh@119 -- # set +e 00:25:35.927 04:37:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:35.927 04:37:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:35.927 rmmod nvme_tcp 00:25:35.927 rmmod nvme_fabrics 00:25:35.927 rmmod nvme_keyring 00:25:35.927 04:37:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:35.927 04:37:14 -- nvmf/common.sh@123 -- # set -e 00:25:35.927 04:37:14 -- nvmf/common.sh@124 -- # return 0 00:25:35.927 04:37:14 -- nvmf/common.sh@477 -- # '[' -n 2999763 ']' 00:25:35.927 04:37:14 -- nvmf/common.sh@478 -- # killprocess 2999763 00:25:35.927 04:37:14 -- common/autotest_common.sh@936 -- # '[' -z 2999763 ']' 00:25:35.927 04:37:14 -- common/autotest_common.sh@940 -- # kill -0 2999763 00:25:35.927 04:37:15 -- common/autotest_common.sh@941 -- # uname 00:25:35.927 04:37:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:35.927 04:37:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2999763 00:25:35.927 04:37:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:35.927 04:37:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:35.927 04:37:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2999763' 00:25:35.927 killing process with pid 2999763 00:25:35.927 04:37:15 -- common/autotest_common.sh@955 -- # kill 2999763 00:25:35.927 [2024-11-26 04:37:15.044031] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:35.927 04:37:15 -- common/autotest_common.sh@960 -- # wait 2999763 00:25:36.186 04:37:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:36.186 04:37:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:36.186 04:37:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:36.186 04:37:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:36.186 04:37:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:36.186 04:37:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:36.186 04:37:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:36.186 04:37:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:38.722 04:37:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:38.722 00:25:38.722 real 0m6.173s 00:25:38.722 user 0m7.700s 00:25:38.722 sys 0m1.894s 00:25:38.723 04:37:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:38.723 04:37:17 -- common/autotest_common.sh@10 -- # set +x 00:25:38.723 ************************************ 00:25:38.723 END TEST nvmf_identify 00:25:38.723 ************************************ 00:25:38.723 04:37:17 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:38.723 04:37:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:38.723 04:37:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:38.723 04:37:17 -- common/autotest_common.sh@10 -- # set +x 00:25:38.723 ************************************ 00:25:38.723 START TEST nvmf_perf 00:25:38.723 ************************************ 00:25:38.723 04:37:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:38.723 * Looking for test storage... 00:25:38.723 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:38.723 04:37:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:38.723 04:37:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:38.723 04:37:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:38.723 04:37:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:38.723 04:37:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:38.723 04:37:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:38.723 04:37:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:38.723 04:37:17 -- scripts/common.sh@335 -- # IFS=.-: 00:25:38.723 04:37:17 -- scripts/common.sh@335 -- # read -ra ver1 00:25:38.723 04:37:17 -- scripts/common.sh@336 -- # IFS=.-: 00:25:38.723 04:37:17 -- scripts/common.sh@336 -- # read -ra ver2 00:25:38.723 04:37:17 -- scripts/common.sh@337 -- # local 'op=<' 00:25:38.723 04:37:17 -- scripts/common.sh@339 -- # ver1_l=2 00:25:38.723 04:37:17 -- scripts/common.sh@340 -- # ver2_l=1 00:25:38.723 04:37:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:38.723 04:37:17 -- scripts/common.sh@343 -- # case "$op" in 00:25:38.723 04:37:17 -- scripts/common.sh@344 -- # : 1 00:25:38.723 04:37:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:38.723 04:37:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:38.723 04:37:17 -- scripts/common.sh@364 -- # decimal 1 00:25:38.723 04:37:17 -- scripts/common.sh@352 -- # local d=1 00:25:38.723 04:37:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:38.723 04:37:17 -- scripts/common.sh@354 -- # echo 1 00:25:38.723 04:37:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:38.723 04:37:17 -- scripts/common.sh@365 -- # decimal 2 00:25:38.723 04:37:17 -- scripts/common.sh@352 -- # local d=2 00:25:38.723 04:37:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:38.723 04:37:17 -- scripts/common.sh@354 -- # echo 2 00:25:38.723 04:37:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:38.723 04:37:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:38.723 04:37:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:38.723 04:37:17 -- scripts/common.sh@367 -- # return 0 00:25:38.723 04:37:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:38.723 04:37:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:38.723 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:38.723 --rc genhtml_branch_coverage=1 00:25:38.723 --rc genhtml_function_coverage=1 00:25:38.723 --rc genhtml_legend=1 00:25:38.723 --rc geninfo_all_blocks=1 00:25:38.723 --rc geninfo_unexecuted_blocks=1 00:25:38.723 00:25:38.723 ' 00:25:38.723 04:37:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:38.723 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:38.723 --rc genhtml_branch_coverage=1 00:25:38.723 --rc genhtml_function_coverage=1 00:25:38.723 --rc genhtml_legend=1 00:25:38.723 --rc geninfo_all_blocks=1 00:25:38.723 --rc geninfo_unexecuted_blocks=1 00:25:38.723 00:25:38.723 ' 00:25:38.723 04:37:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:38.723 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:38.723 --rc genhtml_branch_coverage=1 00:25:38.723 --rc genhtml_function_coverage=1 00:25:38.723 --rc genhtml_legend=1 00:25:38.723 --rc geninfo_all_blocks=1 00:25:38.723 --rc geninfo_unexecuted_blocks=1 00:25:38.723 00:25:38.723 ' 00:25:38.723 04:37:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:38.723 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:38.723 --rc genhtml_branch_coverage=1 00:25:38.723 --rc genhtml_function_coverage=1 00:25:38.723 --rc genhtml_legend=1 00:25:38.723 --rc geninfo_all_blocks=1 00:25:38.723 --rc geninfo_unexecuted_blocks=1 00:25:38.723 00:25:38.723 ' 00:25:38.723 04:37:17 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:38.723 04:37:17 -- nvmf/common.sh@7 -- # uname -s 00:25:38.723 04:37:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:38.723 04:37:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:38.723 04:37:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:38.723 04:37:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:38.723 04:37:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:38.723 04:37:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:38.723 04:37:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:38.723 04:37:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:38.723 04:37:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:38.723 04:37:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:38.723 04:37:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:38.723 04:37:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:38.723 04:37:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:38.723 04:37:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:38.723 04:37:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:38.723 04:37:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:38.723 04:37:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:38.723 04:37:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:38.723 04:37:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:38.723 04:37:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.723 04:37:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.723 04:37:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.723 04:37:17 -- paths/export.sh@5 -- # export PATH 00:25:38.723 04:37:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.723 04:37:17 -- nvmf/common.sh@46 -- # : 0 00:25:38.723 04:37:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:38.723 04:37:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:38.723 04:37:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:38.723 04:37:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:38.723 04:37:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:38.723 04:37:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:38.723 04:37:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:38.723 04:37:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:38.723 04:37:17 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:25:38.723 04:37:17 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:25:38.723 04:37:17 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:38.723 04:37:17 -- host/perf.sh@17 -- # nvmftestinit 00:25:38.723 04:37:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:38.723 04:37:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:38.723 04:37:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:38.723 04:37:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:38.723 04:37:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:38.723 04:37:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:38.723 04:37:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:38.723 04:37:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:38.723 04:37:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:38.723 04:37:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:38.723 04:37:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:38.723 04:37:17 -- common/autotest_common.sh@10 -- # set +x 00:25:40.628 04:37:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:40.628 04:37:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:40.628 04:37:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:40.628 04:37:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:40.628 04:37:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:40.628 04:37:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:40.628 04:37:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:40.628 04:37:19 -- nvmf/common.sh@294 -- # net_devs=() 00:25:40.628 04:37:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:40.628 04:37:19 -- nvmf/common.sh@295 -- # e810=() 00:25:40.628 04:37:19 -- nvmf/common.sh@295 -- # local -ga e810 00:25:40.628 04:37:19 -- nvmf/common.sh@296 -- # x722=() 00:25:40.628 04:37:19 -- nvmf/common.sh@296 -- # local -ga x722 00:25:40.628 04:37:19 -- nvmf/common.sh@297 -- # mlx=() 00:25:40.628 04:37:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:40.628 04:37:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:40.628 04:37:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:40.628 04:37:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:40.628 04:37:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:40.628 04:37:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:40.628 04:37:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:40.628 04:37:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:40.628 04:37:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:40.628 04:37:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:40.628 04:37:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:40.628 04:37:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:40.628 04:37:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:40.628 04:37:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:40.628 04:37:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:40.628 04:37:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:40.628 04:37:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:40.628 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:40.628 04:37:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:40.628 04:37:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:40.628 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:40.628 04:37:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:40.628 04:37:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:40.628 04:37:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:40.628 04:37:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:40.628 04:37:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:40.628 04:37:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:40.628 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:40.628 04:37:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:40.628 04:37:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:40.628 04:37:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:40.628 04:37:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:40.628 04:37:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:40.628 04:37:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:40.628 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:40.628 04:37:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:40.628 04:37:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:40.628 04:37:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:40.628 04:37:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:40.628 04:37:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:40.628 04:37:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:40.628 04:37:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:40.628 04:37:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:40.628 04:37:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:40.629 04:37:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:40.629 04:37:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:40.629 04:37:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:40.629 04:37:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:40.629 04:37:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:40.629 04:37:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:40.629 04:37:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:40.629 04:37:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:40.629 04:37:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:40.629 04:37:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:40.629 04:37:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:40.629 04:37:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:40.629 04:37:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:40.629 04:37:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:40.629 04:37:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:40.629 04:37:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:40.629 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:40.629 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:25:40.629 00:25:40.629 --- 10.0.0.2 ping statistics --- 00:25:40.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:40.629 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:25:40.629 04:37:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:40.629 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:40.629 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.196 ms 00:25:40.629 00:25:40.629 --- 10.0.0.1 ping statistics --- 00:25:40.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:40.629 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:25:40.629 04:37:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:40.629 04:37:19 -- nvmf/common.sh@410 -- # return 0 00:25:40.629 04:37:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:40.629 04:37:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:40.629 04:37:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:40.629 04:37:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:40.629 04:37:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:40.629 04:37:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:40.629 04:37:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:40.629 04:37:19 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:25:40.629 04:37:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:40.629 04:37:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:40.629 04:37:19 -- common/autotest_common.sh@10 -- # set +x 00:25:40.629 04:37:19 -- nvmf/common.sh@469 -- # nvmfpid=3001876 00:25:40.629 04:37:19 -- nvmf/common.sh@470 -- # waitforlisten 3001876 00:25:40.629 04:37:19 -- common/autotest_common.sh@829 -- # '[' -z 3001876 ']' 00:25:40.629 04:37:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:40.629 04:37:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:40.629 04:37:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:40.629 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:40.629 04:37:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:40.629 04:37:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:40.629 04:37:19 -- common/autotest_common.sh@10 -- # set +x 00:25:40.629 [2024-11-26 04:37:19.675556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:40.629 [2024-11-26 04:37:19.675633] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:40.629 EAL: No free 2048 kB hugepages reported on node 1 00:25:40.629 [2024-11-26 04:37:19.745327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:40.629 [2024-11-26 04:37:19.836507] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:40.629 [2024-11-26 04:37:19.836718] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:40.629 [2024-11-26 04:37:19.836740] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:40.629 [2024-11-26 04:37:19.836755] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:40.629 [2024-11-26 04:37:19.836814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:40.629 [2024-11-26 04:37:19.836885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:40.629 [2024-11-26 04:37:19.836985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:40.629 [2024-11-26 04:37:19.836988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:41.565 04:37:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:41.565 04:37:20 -- common/autotest_common.sh@862 -- # return 0 00:25:41.565 04:37:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:41.565 04:37:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:41.565 04:37:20 -- common/autotest_common.sh@10 -- # set +x 00:25:41.565 04:37:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:41.565 04:37:20 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:41.565 04:37:20 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:25:44.858 04:37:23 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:25:44.858 04:37:23 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:25:44.858 04:37:24 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:25:44.858 04:37:24 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:25:45.116 04:37:24 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:25:45.116 04:37:24 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:25:45.116 04:37:24 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:25:45.116 04:37:24 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:25:45.116 04:37:24 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:25:45.374 [2024-11-26 04:37:24.568869] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:45.374 04:37:24 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:45.633 04:37:24 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:45.633 04:37:24 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:45.893 04:37:25 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:45.893 04:37:25 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:25:46.151 04:37:25 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:46.409 [2024-11-26 04:37:25.592757] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:46.409 04:37:25 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:46.667 04:37:25 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:25:46.667 04:37:25 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:46.667 04:37:25 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:25:46.668 04:37:25 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:48.046 Initializing NVMe Controllers 00:25:48.046 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:25:48.046 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:25:48.046 Initialization complete. Launching workers. 00:25:48.046 ======================================================== 00:25:48.046 Latency(us) 00:25:48.046 Device Information : IOPS MiB/s Average min max 00:25:48.046 PCIE (0000:88:00.0) NSID 1 from core 0: 86469.46 337.77 369.71 16.90 4308.71 00:25:48.046 ======================================================== 00:25:48.046 Total : 86469.46 337.77 369.71 16.90 4308.71 00:25:48.046 00:25:48.046 04:37:27 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:48.046 EAL: No free 2048 kB hugepages reported on node 1 00:25:49.424 Initializing NVMe Controllers 00:25:49.424 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:49.424 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:49.424 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:49.424 Initialization complete. Launching workers. 00:25:49.424 ======================================================== 00:25:49.424 Latency(us) 00:25:49.424 Device Information : IOPS MiB/s Average min max 00:25:49.424 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 108.61 0.42 9572.35 162.04 45827.30 00:25:49.424 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 56.80 0.22 17745.01 7954.85 48877.09 00:25:49.424 ======================================================== 00:25:49.424 Total : 165.41 0.65 12378.62 162.04 48877.09 00:25:49.424 00:25:49.424 04:37:28 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:49.424 EAL: No free 2048 kB hugepages reported on node 1 00:25:50.800 Initializing NVMe Controllers 00:25:50.800 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:50.800 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:50.800 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:50.800 Initialization complete. Launching workers. 00:25:50.800 ======================================================== 00:25:50.800 Latency(us) 00:25:50.800 Device Information : IOPS MiB/s Average min max 00:25:50.800 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8442.98 32.98 3791.17 639.03 10612.07 00:25:50.800 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3873.31 15.13 8274.91 5562.75 16290.72 00:25:50.800 ======================================================== 00:25:50.800 Total : 12316.30 48.11 5201.25 639.03 16290.72 00:25:50.800 00:25:50.800 04:37:29 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:25:50.800 04:37:29 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:25:50.800 04:37:29 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:50.800 EAL: No free 2048 kB hugepages reported on node 1 00:25:53.337 Initializing NVMe Controllers 00:25:53.337 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:53.337 Controller IO queue size 128, less than required. 00:25:53.337 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:53.337 Controller IO queue size 128, less than required. 00:25:53.337 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:53.337 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:53.337 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:53.337 Initialization complete. Launching workers. 00:25:53.337 ======================================================== 00:25:53.337 Latency(us) 00:25:53.337 Device Information : IOPS MiB/s Average min max 00:25:53.337 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1688.23 422.06 77256.58 48409.00 114375.00 00:25:53.337 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 579.91 144.98 230860.43 96060.45 391592.50 00:25:53.337 ======================================================== 00:25:53.337 Total : 2268.14 567.03 116529.33 48409.00 391592.50 00:25:53.337 00:25:53.337 04:37:32 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:25:53.337 EAL: No free 2048 kB hugepages reported on node 1 00:25:53.337 No valid NVMe controllers or AIO or URING devices found 00:25:53.337 Initializing NVMe Controllers 00:25:53.337 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:53.337 Controller IO queue size 128, less than required. 00:25:53.337 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:53.337 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:25:53.337 Controller IO queue size 128, less than required. 00:25:53.337 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:53.337 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:25:53.337 WARNING: Some requested NVMe devices were skipped 00:25:53.337 04:37:32 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:25:53.337 EAL: No free 2048 kB hugepages reported on node 1 00:25:55.870 Initializing NVMe Controllers 00:25:55.870 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:55.870 Controller IO queue size 128, less than required. 00:25:55.870 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:55.870 Controller IO queue size 128, less than required. 00:25:55.870 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:55.870 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:55.870 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:55.870 Initialization complete. Launching workers. 00:25:55.870 00:25:55.870 ==================== 00:25:55.870 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:25:55.870 TCP transport: 00:25:55.870 polls: 13171 00:25:55.870 idle_polls: 9463 00:25:55.870 sock_completions: 3708 00:25:55.870 nvme_completions: 5742 00:25:55.870 submitted_requests: 8839 00:25:55.870 queued_requests: 1 00:25:55.870 00:25:55.870 ==================== 00:25:55.870 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:25:55.870 TCP transport: 00:25:55.870 polls: 10568 00:25:55.870 idle_polls: 6543 00:25:55.870 sock_completions: 4025 00:25:55.870 nvme_completions: 5893 00:25:55.870 submitted_requests: 8993 00:25:55.870 queued_requests: 1 00:25:55.870 ======================================================== 00:25:55.870 Latency(us) 00:25:55.870 Device Information : IOPS MiB/s Average min max 00:25:55.870 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1497.27 374.32 86994.72 51671.00 158269.25 00:25:55.870 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1535.23 383.81 84143.42 42916.17 127619.33 00:25:55.870 ======================================================== 00:25:55.870 Total : 3032.50 758.12 85551.23 42916.17 158269.25 00:25:55.870 00:25:55.870 04:37:34 -- host/perf.sh@66 -- # sync 00:25:55.870 04:37:34 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:56.129 04:37:35 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:25:56.129 04:37:35 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:25:56.129 04:37:35 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:25:59.419 04:37:38 -- host/perf.sh@72 -- # ls_guid=c543fa31-8fcf-495a-9754-3943d86e6678 00:25:59.419 04:37:38 -- host/perf.sh@73 -- # get_lvs_free_mb c543fa31-8fcf-495a-9754-3943d86e6678 00:25:59.419 04:37:38 -- common/autotest_common.sh@1353 -- # local lvs_uuid=c543fa31-8fcf-495a-9754-3943d86e6678 00:25:59.419 04:37:38 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:59.419 04:37:38 -- common/autotest_common.sh@1355 -- # local fc 00:25:59.419 04:37:38 -- common/autotest_common.sh@1356 -- # local cs 00:25:59.419 04:37:38 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:59.419 04:37:38 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:59.419 { 00:25:59.419 "uuid": "c543fa31-8fcf-495a-9754-3943d86e6678", 00:25:59.419 "name": "lvs_0", 00:25:59.419 "base_bdev": "Nvme0n1", 00:25:59.419 "total_data_clusters": 238234, 00:25:59.419 "free_clusters": 238234, 00:25:59.419 "block_size": 512, 00:25:59.419 "cluster_size": 4194304 00:25:59.419 } 00:25:59.419 ]' 00:25:59.419 04:37:38 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="c543fa31-8fcf-495a-9754-3943d86e6678") .free_clusters' 00:25:59.677 04:37:38 -- common/autotest_common.sh@1358 -- # fc=238234 00:25:59.677 04:37:38 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="c543fa31-8fcf-495a-9754-3943d86e6678") .cluster_size' 00:25:59.677 04:37:38 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:59.677 04:37:38 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:25:59.677 04:37:38 -- common/autotest_common.sh@1363 -- # echo 952936 00:25:59.677 952936 00:25:59.677 04:37:38 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:25:59.677 04:37:38 -- host/perf.sh@78 -- # free_mb=20480 00:25:59.677 04:37:38 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c543fa31-8fcf-495a-9754-3943d86e6678 lbd_0 20480 00:26:00.245 04:37:39 -- host/perf.sh@80 -- # lb_guid=37d344bc-24e5-4d47-9c97-a87e4e292e61 00:26:00.245 04:37:39 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 37d344bc-24e5-4d47-9c97-a87e4e292e61 lvs_n_0 00:26:01.209 04:37:40 -- host/perf.sh@83 -- # ls_nested_guid=8d6daf21-c391-45e5-be16-c59cf0f01349 00:26:01.209 04:37:40 -- host/perf.sh@84 -- # get_lvs_free_mb 8d6daf21-c391-45e5-be16-c59cf0f01349 00:26:01.209 04:37:40 -- common/autotest_common.sh@1353 -- # local lvs_uuid=8d6daf21-c391-45e5-be16-c59cf0f01349 00:26:01.209 04:37:40 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:01.209 04:37:40 -- common/autotest_common.sh@1355 -- # local fc 00:26:01.209 04:37:40 -- common/autotest_common.sh@1356 -- # local cs 00:26:01.209 04:37:40 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:01.209 04:37:40 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:01.209 { 00:26:01.209 "uuid": "c543fa31-8fcf-495a-9754-3943d86e6678", 00:26:01.209 "name": "lvs_0", 00:26:01.209 "base_bdev": "Nvme0n1", 00:26:01.209 "total_data_clusters": 238234, 00:26:01.209 "free_clusters": 233114, 00:26:01.209 "block_size": 512, 00:26:01.209 "cluster_size": 4194304 00:26:01.209 }, 00:26:01.209 { 00:26:01.209 "uuid": "8d6daf21-c391-45e5-be16-c59cf0f01349", 00:26:01.209 "name": "lvs_n_0", 00:26:01.209 "base_bdev": "37d344bc-24e5-4d47-9c97-a87e4e292e61", 00:26:01.209 "total_data_clusters": 5114, 00:26:01.209 "free_clusters": 5114, 00:26:01.209 "block_size": 512, 00:26:01.209 "cluster_size": 4194304 00:26:01.209 } 00:26:01.209 ]' 00:26:01.209 04:37:40 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="8d6daf21-c391-45e5-be16-c59cf0f01349") .free_clusters' 00:26:01.209 04:37:40 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:01.209 04:37:40 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="8d6daf21-c391-45e5-be16-c59cf0f01349") .cluster_size' 00:26:01.209 04:37:40 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:01.209 04:37:40 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:01.209 04:37:40 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:01.209 20456 00:26:01.209 04:37:40 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:01.209 04:37:40 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 8d6daf21-c391-45e5-be16-c59cf0f01349 lbd_nest_0 20456 00:26:01.494 04:37:40 -- host/perf.sh@88 -- # lb_nested_guid=c15226bf-a4c6-4f5f-8151-4602b2d3df6d 00:26:01.494 04:37:40 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:01.753 04:37:40 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:01.753 04:37:40 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 c15226bf-a4c6-4f5f-8151-4602b2d3df6d 00:26:02.011 04:37:41 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:02.270 04:37:41 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:02.270 04:37:41 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:02.270 04:37:41 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:02.271 04:37:41 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:02.271 04:37:41 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:02.271 EAL: No free 2048 kB hugepages reported on node 1 00:26:14.484 Initializing NVMe Controllers 00:26:14.484 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:14.484 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:14.484 Initialization complete. Launching workers. 00:26:14.484 ======================================================== 00:26:14.484 Latency(us) 00:26:14.484 Device Information : IOPS MiB/s Average min max 00:26:14.484 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 49.68 0.02 20145.66 187.23 45766.27 00:26:14.484 ======================================================== 00:26:14.484 Total : 49.68 0.02 20145.66 187.23 45766.27 00:26:14.484 00:26:14.484 04:37:51 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:14.484 04:37:51 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:14.484 EAL: No free 2048 kB hugepages reported on node 1 00:26:24.467 Initializing NVMe Controllers 00:26:24.467 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:24.467 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:24.467 Initialization complete. Launching workers. 00:26:24.467 ======================================================== 00:26:24.467 Latency(us) 00:26:24.467 Device Information : IOPS MiB/s Average min max 00:26:24.467 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 77.00 9.62 13006.64 5025.06 50876.40 00:26:24.467 ======================================================== 00:26:24.467 Total : 77.00 9.62 13006.64 5025.06 50876.40 00:26:24.467 00:26:24.467 04:38:02 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:24.467 04:38:02 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:24.467 04:38:02 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:24.467 EAL: No free 2048 kB hugepages reported on node 1 00:26:34.449 Initializing NVMe Controllers 00:26:34.449 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:34.449 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:34.449 Initialization complete. Launching workers. 00:26:34.449 ======================================================== 00:26:34.449 Latency(us) 00:26:34.449 Device Information : IOPS MiB/s Average min max 00:26:34.449 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7516.40 3.67 4266.99 322.02 43021.96 00:26:34.449 ======================================================== 00:26:34.449 Total : 7516.40 3.67 4266.99 322.02 43021.96 00:26:34.449 00:26:34.449 04:38:12 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:34.449 04:38:12 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:34.449 EAL: No free 2048 kB hugepages reported on node 1 00:26:44.436 Initializing NVMe Controllers 00:26:44.436 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:44.436 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:44.436 Initialization complete. Launching workers. 00:26:44.436 ======================================================== 00:26:44.436 Latency(us) 00:26:44.436 Device Information : IOPS MiB/s Average min max 00:26:44.436 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3758.15 469.77 8519.14 697.79 52316.61 00:26:44.436 ======================================================== 00:26:44.436 Total : 3758.15 469.77 8519.14 697.79 52316.61 00:26:44.436 00:26:44.436 04:38:22 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:44.436 04:38:22 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:44.436 04:38:22 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:44.436 EAL: No free 2048 kB hugepages reported on node 1 00:26:54.413 Initializing NVMe Controllers 00:26:54.413 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:54.413 Controller IO queue size 128, less than required. 00:26:54.413 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:54.413 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:54.413 Initialization complete. Launching workers. 00:26:54.413 ======================================================== 00:26:54.413 Latency(us) 00:26:54.413 Device Information : IOPS MiB/s Average min max 00:26:54.413 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12076.05 5.90 10601.51 1804.46 51434.44 00:26:54.413 ======================================================== 00:26:54.413 Total : 12076.05 5.90 10601.51 1804.46 51434.44 00:26:54.413 00:26:54.413 04:38:33 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:54.413 04:38:33 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:54.413 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.620 Initializing NVMe Controllers 00:27:06.620 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:06.620 Controller IO queue size 128, less than required. 00:27:06.620 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:06.620 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:06.620 Initialization complete. Launching workers. 00:27:06.620 ======================================================== 00:27:06.620 Latency(us) 00:27:06.620 Device Information : IOPS MiB/s Average min max 00:27:06.620 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1194.10 149.26 107977.39 22958.78 230545.11 00:27:06.620 ======================================================== 00:27:06.620 Total : 1194.10 149.26 107977.39 22958.78 230545.11 00:27:06.620 00:27:06.620 04:38:43 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:06.620 04:38:43 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c15226bf-a4c6-4f5f-8151-4602b2d3df6d 00:27:06.620 04:38:44 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:06.620 04:38:44 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 37d344bc-24e5-4d47-9c97-a87e4e292e61 00:27:06.620 04:38:45 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:06.620 04:38:45 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:06.620 04:38:45 -- host/perf.sh@114 -- # nvmftestfini 00:27:06.620 04:38:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:06.620 04:38:45 -- nvmf/common.sh@116 -- # sync 00:27:06.620 04:38:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:06.620 04:38:45 -- nvmf/common.sh@119 -- # set +e 00:27:06.620 04:38:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:06.620 04:38:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:06.620 rmmod nvme_tcp 00:27:06.620 rmmod nvme_fabrics 00:27:06.620 rmmod nvme_keyring 00:27:06.620 04:38:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:06.620 04:38:45 -- nvmf/common.sh@123 -- # set -e 00:27:06.620 04:38:45 -- nvmf/common.sh@124 -- # return 0 00:27:06.620 04:38:45 -- nvmf/common.sh@477 -- # '[' -n 3001876 ']' 00:27:06.620 04:38:45 -- nvmf/common.sh@478 -- # killprocess 3001876 00:27:06.620 04:38:45 -- common/autotest_common.sh@936 -- # '[' -z 3001876 ']' 00:27:06.620 04:38:45 -- common/autotest_common.sh@940 -- # kill -0 3001876 00:27:06.620 04:38:45 -- common/autotest_common.sh@941 -- # uname 00:27:06.620 04:38:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:06.620 04:38:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3001876 00:27:06.620 04:38:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:06.620 04:38:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:06.620 04:38:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3001876' 00:27:06.620 killing process with pid 3001876 00:27:06.620 04:38:45 -- common/autotest_common.sh@955 -- # kill 3001876 00:27:06.620 04:38:45 -- common/autotest_common.sh@960 -- # wait 3001876 00:27:08.527 04:38:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:08.527 04:38:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:08.527 04:38:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:08.527 04:38:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:08.527 04:38:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:08.527 04:38:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:08.527 04:38:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:08.527 04:38:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:10.435 04:38:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:10.435 00:27:10.435 real 1m31.901s 00:27:10.435 user 5m37.230s 00:27:10.435 sys 0m16.642s 00:27:10.435 04:38:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:10.435 04:38:49 -- common/autotest_common.sh@10 -- # set +x 00:27:10.435 ************************************ 00:27:10.435 END TEST nvmf_perf 00:27:10.435 ************************************ 00:27:10.435 04:38:49 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:10.435 04:38:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:10.435 04:38:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:10.435 04:38:49 -- common/autotest_common.sh@10 -- # set +x 00:27:10.435 ************************************ 00:27:10.435 START TEST nvmf_fio_host 00:27:10.435 ************************************ 00:27:10.435 04:38:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:10.435 * Looking for test storage... 00:27:10.435 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:10.435 04:38:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:10.435 04:38:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:10.435 04:38:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:10.435 04:38:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:10.435 04:38:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:10.435 04:38:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:10.435 04:38:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:10.435 04:38:49 -- scripts/common.sh@335 -- # IFS=.-: 00:27:10.435 04:38:49 -- scripts/common.sh@335 -- # read -ra ver1 00:27:10.435 04:38:49 -- scripts/common.sh@336 -- # IFS=.-: 00:27:10.435 04:38:49 -- scripts/common.sh@336 -- # read -ra ver2 00:27:10.435 04:38:49 -- scripts/common.sh@337 -- # local 'op=<' 00:27:10.435 04:38:49 -- scripts/common.sh@339 -- # ver1_l=2 00:27:10.435 04:38:49 -- scripts/common.sh@340 -- # ver2_l=1 00:27:10.435 04:38:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:10.435 04:38:49 -- scripts/common.sh@343 -- # case "$op" in 00:27:10.435 04:38:49 -- scripts/common.sh@344 -- # : 1 00:27:10.435 04:38:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:10.435 04:38:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:10.436 04:38:49 -- scripts/common.sh@364 -- # decimal 1 00:27:10.436 04:38:49 -- scripts/common.sh@352 -- # local d=1 00:27:10.436 04:38:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:10.436 04:38:49 -- scripts/common.sh@354 -- # echo 1 00:27:10.436 04:38:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:10.436 04:38:49 -- scripts/common.sh@365 -- # decimal 2 00:27:10.436 04:38:49 -- scripts/common.sh@352 -- # local d=2 00:27:10.436 04:38:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:10.436 04:38:49 -- scripts/common.sh@354 -- # echo 2 00:27:10.436 04:38:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:10.436 04:38:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:10.436 04:38:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:10.436 04:38:49 -- scripts/common.sh@367 -- # return 0 00:27:10.436 04:38:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:10.436 04:38:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:10.436 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:10.436 --rc genhtml_branch_coverage=1 00:27:10.436 --rc genhtml_function_coverage=1 00:27:10.436 --rc genhtml_legend=1 00:27:10.436 --rc geninfo_all_blocks=1 00:27:10.436 --rc geninfo_unexecuted_blocks=1 00:27:10.436 00:27:10.436 ' 00:27:10.436 04:38:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:10.436 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:10.436 --rc genhtml_branch_coverage=1 00:27:10.436 --rc genhtml_function_coverage=1 00:27:10.436 --rc genhtml_legend=1 00:27:10.436 --rc geninfo_all_blocks=1 00:27:10.436 --rc geninfo_unexecuted_blocks=1 00:27:10.436 00:27:10.436 ' 00:27:10.436 04:38:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:10.436 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:10.436 --rc genhtml_branch_coverage=1 00:27:10.436 --rc genhtml_function_coverage=1 00:27:10.436 --rc genhtml_legend=1 00:27:10.436 --rc geninfo_all_blocks=1 00:27:10.436 --rc geninfo_unexecuted_blocks=1 00:27:10.436 00:27:10.436 ' 00:27:10.436 04:38:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:10.436 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:10.436 --rc genhtml_branch_coverage=1 00:27:10.436 --rc genhtml_function_coverage=1 00:27:10.436 --rc genhtml_legend=1 00:27:10.436 --rc geninfo_all_blocks=1 00:27:10.436 --rc geninfo_unexecuted_blocks=1 00:27:10.436 00:27:10.436 ' 00:27:10.436 04:38:49 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:10.436 04:38:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:10.436 04:38:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:10.436 04:38:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:10.436 04:38:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:10.436 04:38:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:10.436 04:38:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:10.436 04:38:49 -- paths/export.sh@5 -- # export PATH 00:27:10.436 04:38:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:10.436 04:38:49 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:10.436 04:38:49 -- nvmf/common.sh@7 -- # uname -s 00:27:10.436 04:38:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:10.436 04:38:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:10.436 04:38:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:10.436 04:38:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:10.436 04:38:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:10.436 04:38:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:10.436 04:38:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:10.436 04:38:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:10.436 04:38:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:10.436 04:38:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:10.436 04:38:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:10.436 04:38:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:10.436 04:38:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:10.436 04:38:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:10.436 04:38:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:10.436 04:38:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:10.436 04:38:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:10.436 04:38:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:10.436 04:38:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:10.436 04:38:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:10.436 04:38:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:10.436 04:38:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:10.436 04:38:49 -- paths/export.sh@5 -- # export PATH 00:27:10.436 04:38:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:10.436 04:38:49 -- nvmf/common.sh@46 -- # : 0 00:27:10.436 04:38:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:10.436 04:38:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:10.436 04:38:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:10.436 04:38:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:10.436 04:38:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:10.436 04:38:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:10.436 04:38:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:10.436 04:38:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:10.436 04:38:49 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:10.436 04:38:49 -- host/fio.sh@14 -- # nvmftestinit 00:27:10.436 04:38:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:10.436 04:38:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:10.436 04:38:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:10.436 04:38:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:10.436 04:38:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:10.436 04:38:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:10.436 04:38:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:10.436 04:38:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:10.436 04:38:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:10.436 04:38:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:10.436 04:38:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:10.436 04:38:49 -- common/autotest_common.sh@10 -- # set +x 00:27:12.378 04:38:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:12.378 04:38:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:12.378 04:38:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:12.378 04:38:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:12.378 04:38:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:12.378 04:38:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:12.378 04:38:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:12.378 04:38:51 -- nvmf/common.sh@294 -- # net_devs=() 00:27:12.378 04:38:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:12.378 04:38:51 -- nvmf/common.sh@295 -- # e810=() 00:27:12.378 04:38:51 -- nvmf/common.sh@295 -- # local -ga e810 00:27:12.378 04:38:51 -- nvmf/common.sh@296 -- # x722=() 00:27:12.378 04:38:51 -- nvmf/common.sh@296 -- # local -ga x722 00:27:12.378 04:38:51 -- nvmf/common.sh@297 -- # mlx=() 00:27:12.378 04:38:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:12.378 04:38:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:12.378 04:38:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:12.378 04:38:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:12.378 04:38:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:12.378 04:38:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:12.378 04:38:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:12.378 04:38:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:12.378 04:38:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:12.378 04:38:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:12.378 04:38:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:12.378 04:38:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:12.378 04:38:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:12.378 04:38:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:12.378 04:38:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:12.378 04:38:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:12.378 04:38:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:12.378 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:12.378 04:38:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:12.378 04:38:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:12.378 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:12.378 04:38:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:12.378 04:38:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:12.378 04:38:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:12.378 04:38:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:12.378 04:38:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:12.378 04:38:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:12.378 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:12.378 04:38:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:12.378 04:38:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:12.378 04:38:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:12.378 04:38:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:12.378 04:38:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:12.378 04:38:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:12.378 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:12.378 04:38:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:12.378 04:38:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:12.378 04:38:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:12.378 04:38:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:12.378 04:38:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:12.378 04:38:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:12.378 04:38:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:12.378 04:38:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:12.378 04:38:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:12.378 04:38:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:12.378 04:38:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:12.378 04:38:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:12.378 04:38:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:12.378 04:38:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:12.378 04:38:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:12.378 04:38:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:12.378 04:38:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:12.378 04:38:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:12.378 04:38:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:12.378 04:38:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:12.378 04:38:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:12.378 04:38:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:12.378 04:38:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:12.378 04:38:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:12.378 04:38:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:12.378 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:12.378 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:27:12.378 00:27:12.378 --- 10.0.0.2 ping statistics --- 00:27:12.378 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:12.378 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:27:12.378 04:38:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:12.378 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:12.378 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.175 ms 00:27:12.379 00:27:12.379 --- 10.0.0.1 ping statistics --- 00:27:12.379 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:12.379 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:27:12.379 04:38:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:12.379 04:38:51 -- nvmf/common.sh@410 -- # return 0 00:27:12.379 04:38:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:12.379 04:38:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:12.379 04:38:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:12.379 04:38:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:12.379 04:38:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:12.379 04:38:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:12.379 04:38:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:12.379 04:38:51 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:12.379 04:38:51 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:12.379 04:38:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:12.379 04:38:51 -- common/autotest_common.sh@10 -- # set +x 00:27:12.379 04:38:51 -- host/fio.sh@24 -- # nvmfpid=3014334 00:27:12.379 04:38:51 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:12.379 04:38:51 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:12.379 04:38:51 -- host/fio.sh@28 -- # waitforlisten 3014334 00:27:12.379 04:38:51 -- common/autotest_common.sh@829 -- # '[' -z 3014334 ']' 00:27:12.379 04:38:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:12.379 04:38:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:12.379 04:38:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:12.379 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:12.379 04:38:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:12.379 04:38:51 -- common/autotest_common.sh@10 -- # set +x 00:27:12.379 [2024-11-26 04:38:51.559613] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:12.379 [2024-11-26 04:38:51.559709] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:12.379 EAL: No free 2048 kB hugepages reported on node 1 00:27:12.638 [2024-11-26 04:38:51.634424] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:12.638 [2024-11-26 04:38:51.727750] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:12.638 [2024-11-26 04:38:51.727918] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:12.638 [2024-11-26 04:38:51.727939] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:12.638 [2024-11-26 04:38:51.727955] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:12.639 [2024-11-26 04:38:51.728066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:12.639 [2024-11-26 04:38:51.728142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:12.639 [2024-11-26 04:38:51.728236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:12.639 [2024-11-26 04:38:51.728239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:13.574 04:38:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:13.574 04:38:52 -- common/autotest_common.sh@862 -- # return 0 00:27:13.574 04:38:52 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:13.574 [2024-11-26 04:38:52.758035] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:13.574 04:38:52 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:13.574 04:38:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:13.574 04:38:52 -- common/autotest_common.sh@10 -- # set +x 00:27:13.834 04:38:52 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:13.834 Malloc1 00:27:14.094 04:38:53 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:14.094 04:38:53 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:14.352 04:38:53 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:14.610 [2024-11-26 04:38:53.793444] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:14.610 04:38:53 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:14.869 04:38:54 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:14.869 04:38:54 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:14.869 04:38:54 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:14.869 04:38:54 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:14.869 04:38:54 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:14.869 04:38:54 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:14.869 04:38:54 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:14.869 04:38:54 -- common/autotest_common.sh@1330 -- # shift 00:27:14.869 04:38:54 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:14.869 04:38:54 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:14.869 04:38:54 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:14.869 04:38:54 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:14.869 04:38:54 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:15.127 04:38:54 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:15.127 04:38:54 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:15.127 04:38:54 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:15.127 04:38:54 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:15.127 04:38:54 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:15.127 04:38:54 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:15.127 04:38:54 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:15.127 04:38:54 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:15.127 04:38:54 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:15.127 04:38:54 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:15.127 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:15.127 fio-3.35 00:27:15.127 Starting 1 thread 00:27:15.127 EAL: No free 2048 kB hugepages reported on node 1 00:27:17.656 00:27:17.656 test: (groupid=0, jobs=1): err= 0: pid=3014830: Tue Nov 26 04:38:56 2024 00:27:17.656 read: IOPS=9261, BW=36.2MiB/s (37.9MB/s)(72.6MiB/2006msec) 00:27:17.656 slat (nsec): min=1877, max=159562, avg=2491.51, stdev=1848.60 00:27:17.656 clat (usec): min=2533, max=13010, avg=7626.67, stdev=588.99 00:27:17.656 lat (usec): min=2560, max=13012, avg=7629.16, stdev=588.87 00:27:17.656 clat percentiles (usec): 00:27:17.656 | 1.00th=[ 6259], 5.00th=[ 6718], 10.00th=[ 6915], 20.00th=[ 7177], 00:27:17.656 | 30.00th=[ 7373], 40.00th=[ 7504], 50.00th=[ 7635], 60.00th=[ 7767], 00:27:17.656 | 70.00th=[ 7898], 80.00th=[ 8094], 90.00th=[ 8291], 95.00th=[ 8586], 00:27:17.656 | 99.00th=[ 8979], 99.50th=[ 9110], 99.90th=[11076], 99.95th=[12256], 00:27:17.656 | 99.99th=[12911] 00:27:17.656 bw ( KiB/s): min=36072, max=37640, per=99.92%, avg=37016.00, stdev=668.31, samples=4 00:27:17.656 iops : min= 9018, max= 9410, avg=9254.00, stdev=167.08, samples=4 00:27:17.656 write: IOPS=9265, BW=36.2MiB/s (38.0MB/s)(72.6MiB/2006msec); 0 zone resets 00:27:17.656 slat (nsec): min=1970, max=127917, avg=2574.76, stdev=1424.59 00:27:17.656 clat (usec): min=1393, max=11278, avg=6147.66, stdev=501.40 00:27:17.656 lat (usec): min=1402, max=11281, avg=6150.24, stdev=501.33 00:27:17.656 clat percentiles (usec): 00:27:17.656 | 1.00th=[ 5014], 5.00th=[ 5407], 10.00th=[ 5604], 20.00th=[ 5800], 00:27:17.656 | 30.00th=[ 5932], 40.00th=[ 6063], 50.00th=[ 6128], 60.00th=[ 6259], 00:27:17.656 | 70.00th=[ 6390], 80.00th=[ 6521], 90.00th=[ 6718], 95.00th=[ 6915], 00:27:17.656 | 99.00th=[ 7242], 99.50th=[ 7373], 99.90th=[ 9634], 99.95th=[10814], 00:27:17.656 | 99.99th=[11207] 00:27:17.656 bw ( KiB/s): min=36800, max=37248, per=100.00%, avg=37062.00, stdev=200.20, samples=4 00:27:17.656 iops : min= 9200, max= 9312, avg=9265.50, stdev=50.05, samples=4 00:27:17.656 lat (msec) : 2=0.02%, 4=0.12%, 10=99.74%, 20=0.12% 00:27:17.656 cpu : usr=58.35%, sys=38.35%, ctx=96, majf=0, minf=41 00:27:17.656 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:17.656 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:17.656 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:17.656 issued rwts: total=18579,18587,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:17.656 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:17.656 00:27:17.656 Run status group 0 (all jobs): 00:27:17.656 READ: bw=36.2MiB/s (37.9MB/s), 36.2MiB/s-36.2MiB/s (37.9MB/s-37.9MB/s), io=72.6MiB (76.1MB), run=2006-2006msec 00:27:17.656 WRITE: bw=36.2MiB/s (38.0MB/s), 36.2MiB/s-36.2MiB/s (38.0MB/s-38.0MB/s), io=72.6MiB (76.1MB), run=2006-2006msec 00:27:17.656 04:38:56 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:17.657 04:38:56 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:17.657 04:38:56 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:17.657 04:38:56 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:17.657 04:38:56 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:17.657 04:38:56 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:17.657 04:38:56 -- common/autotest_common.sh@1330 -- # shift 00:27:17.657 04:38:56 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:17.657 04:38:56 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:17.657 04:38:56 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:17.657 04:38:56 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:17.657 04:38:56 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:17.657 04:38:56 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:17.657 04:38:56 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:17.657 04:38:56 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:17.657 04:38:56 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:17.657 04:38:56 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:17.657 04:38:56 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:17.657 04:38:56 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:17.657 04:38:56 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:17.657 04:38:56 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:17.657 04:38:56 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:17.657 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:17.657 fio-3.35 00:27:17.657 Starting 1 thread 00:27:17.914 EAL: No free 2048 kB hugepages reported on node 1 00:27:20.442 00:27:20.442 test: (groupid=0, jobs=1): err= 0: pid=3015167: Tue Nov 26 04:38:59 2024 00:27:20.442 read: IOPS=8568, BW=134MiB/s (140MB/s)(269MiB/2006msec) 00:27:20.442 slat (nsec): min=2806, max=92674, avg=3667.77, stdev=1956.03 00:27:20.442 clat (usec): min=1673, max=15578, avg=8705.84, stdev=1974.48 00:27:20.442 lat (usec): min=1677, max=15581, avg=8709.51, stdev=1974.52 00:27:20.442 clat percentiles (usec): 00:27:20.442 | 1.00th=[ 4621], 5.00th=[ 5407], 10.00th=[ 6128], 20.00th=[ 6980], 00:27:20.442 | 30.00th=[ 7635], 40.00th=[ 8160], 50.00th=[ 8717], 60.00th=[ 9241], 00:27:20.442 | 70.00th=[ 9765], 80.00th=[10290], 90.00th=[11207], 95.00th=[11994], 00:27:20.442 | 99.00th=[13698], 99.50th=[14091], 99.90th=[14746], 99.95th=[15139], 00:27:20.442 | 99.99th=[15401] 00:27:20.442 bw ( KiB/s): min=61888, max=80000, per=51.52%, avg=70640.00, stdev=8812.44, samples=4 00:27:20.442 iops : min= 3868, max= 5000, avg=4415.00, stdev=550.78, samples=4 00:27:20.442 write: IOPS=5037, BW=78.7MiB/s (82.5MB/s)(144MiB/1826msec); 0 zone resets 00:27:20.442 slat (usec): min=30, max=123, avg=34.12, stdev= 5.99 00:27:20.442 clat (usec): min=3815, max=20508, avg=10893.05, stdev=2018.05 00:27:20.442 lat (usec): min=3869, max=20539, avg=10927.17, stdev=2018.24 00:27:20.442 clat percentiles (usec): 00:27:20.442 | 1.00th=[ 7308], 5.00th=[ 8094], 10.00th=[ 8717], 20.00th=[ 9241], 00:27:20.442 | 30.00th=[ 9634], 40.00th=[10028], 50.00th=[10552], 60.00th=[11076], 00:27:20.442 | 70.00th=[11731], 80.00th=[12518], 90.00th=[13829], 95.00th=[14615], 00:27:20.442 | 99.00th=[16319], 99.50th=[17171], 99.90th=[17957], 99.95th=[20317], 00:27:20.442 | 99.99th=[20579] 00:27:20.442 bw ( KiB/s): min=64480, max=82816, per=90.96%, avg=73312.00, stdev=9115.04, samples=4 00:27:20.442 iops : min= 4030, max= 5176, avg=4582.00, stdev=569.69, samples=4 00:27:20.442 lat (msec) : 2=0.03%, 4=0.21%, 10=62.33%, 20=37.40%, 50=0.03% 00:27:20.442 cpu : usr=76.11%, sys=21.90%, ctx=27, majf=0, minf=67 00:27:20.442 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:27:20.442 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:20.442 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:20.442 issued rwts: total=17189,9198,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:20.442 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:20.442 00:27:20.442 Run status group 0 (all jobs): 00:27:20.442 READ: bw=134MiB/s (140MB/s), 134MiB/s-134MiB/s (140MB/s-140MB/s), io=269MiB (282MB), run=2006-2006msec 00:27:20.442 WRITE: bw=78.7MiB/s (82.5MB/s), 78.7MiB/s-78.7MiB/s (82.5MB/s-82.5MB/s), io=144MiB (151MB), run=1826-1826msec 00:27:20.442 04:38:59 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:20.442 04:38:59 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:20.442 04:38:59 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:20.442 04:38:59 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:20.442 04:38:59 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:20.442 04:38:59 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:20.442 04:38:59 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:20.442 04:38:59 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:20.442 04:38:59 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:20.442 04:38:59 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:20.442 04:38:59 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:20.442 04:38:59 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:23.732 Nvme0n1 00:27:23.732 04:39:02 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:26.266 04:39:05 -- host/fio.sh@53 -- # ls_guid=90c3dd0b-0eea-4d49-b050-7edbb47c5ae9 00:27:26.266 04:39:05 -- host/fio.sh@54 -- # get_lvs_free_mb 90c3dd0b-0eea-4d49-b050-7edbb47c5ae9 00:27:26.266 04:39:05 -- common/autotest_common.sh@1353 -- # local lvs_uuid=90c3dd0b-0eea-4d49-b050-7edbb47c5ae9 00:27:26.266 04:39:05 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:26.266 04:39:05 -- common/autotest_common.sh@1355 -- # local fc 00:27:26.266 04:39:05 -- common/autotest_common.sh@1356 -- # local cs 00:27:26.266 04:39:05 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:26.525 04:39:05 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:26.525 { 00:27:26.525 "uuid": "90c3dd0b-0eea-4d49-b050-7edbb47c5ae9", 00:27:26.525 "name": "lvs_0", 00:27:26.525 "base_bdev": "Nvme0n1", 00:27:26.525 "total_data_clusters": 930, 00:27:26.525 "free_clusters": 930, 00:27:26.525 "block_size": 512, 00:27:26.525 "cluster_size": 1073741824 00:27:26.525 } 00:27:26.525 ]' 00:27:26.525 04:39:05 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="90c3dd0b-0eea-4d49-b050-7edbb47c5ae9") .free_clusters' 00:27:26.783 04:39:05 -- common/autotest_common.sh@1358 -- # fc=930 00:27:26.783 04:39:05 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="90c3dd0b-0eea-4d49-b050-7edbb47c5ae9") .cluster_size' 00:27:26.783 04:39:05 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:27:26.783 04:39:05 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:27:26.783 04:39:05 -- common/autotest_common.sh@1363 -- # echo 952320 00:27:26.783 952320 00:27:26.783 04:39:05 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:27.041 638fee91-1184-4747-a495-ac6f11c3de67 00:27:27.041 04:39:06 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:27.299 04:39:06 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:27.558 04:39:06 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:28.124 04:39:07 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:28.124 04:39:07 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:28.124 04:39:07 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:28.124 04:39:07 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:28.124 04:39:07 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:28.124 04:39:07 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:28.124 04:39:07 -- common/autotest_common.sh@1330 -- # shift 00:27:28.124 04:39:07 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:28.124 04:39:07 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:28.124 04:39:07 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:28.124 04:39:07 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:28.124 04:39:07 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:28.124 04:39:07 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:28.124 04:39:07 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:28.124 04:39:07 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:28.124 04:39:07 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:28.124 04:39:07 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:28.124 04:39:07 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:28.124 04:39:07 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:28.124 04:39:07 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:28.124 04:39:07 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:28.124 04:39:07 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:28.124 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:28.124 fio-3.35 00:27:28.124 Starting 1 thread 00:27:28.124 EAL: No free 2048 kB hugepages reported on node 1 00:27:30.655 00:27:30.655 test: (groupid=0, jobs=1): err= 0: pid=3016879: Tue Nov 26 04:39:09 2024 00:27:30.655 read: IOPS=6188, BW=24.2MiB/s (25.3MB/s)(48.5MiB/2008msec) 00:27:30.655 slat (nsec): min=1913, max=144208, avg=2670.94, stdev=2409.16 00:27:30.655 clat (usec): min=1087, max=171070, avg=11347.33, stdev=11480.15 00:27:30.655 lat (usec): min=1091, max=171085, avg=11350.01, stdev=11480.41 00:27:30.655 clat percentiles (msec): 00:27:30.655 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 10], 20.00th=[ 10], 00:27:30.655 | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:27:30.655 | 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 12], 00:27:30.655 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:27:30.655 | 99.99th=[ 171] 00:27:30.655 bw ( KiB/s): min=17168, max=27520, per=99.87%, avg=24722.00, stdev=5040.45, samples=4 00:27:30.655 iops : min= 4292, max= 6880, avg=6180.50, stdev=1260.11, samples=4 00:27:30.655 write: IOPS=6176, BW=24.1MiB/s (25.3MB/s)(48.4MiB/2008msec); 0 zone resets 00:27:30.655 slat (usec): min=2, max=113, avg= 2.78, stdev= 2.03 00:27:30.655 clat (usec): min=332, max=169263, avg=9187.97, stdev=10772.92 00:27:30.655 lat (usec): min=335, max=169269, avg=9190.74, stdev=10773.20 00:27:30.655 clat percentiles (msec): 00:27:30.655 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:27:30.655 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:27:30.655 | 70.00th=[ 9], 80.00th=[ 10], 90.00th=[ 10], 95.00th=[ 10], 00:27:30.655 | 99.00th=[ 11], 99.50th=[ 16], 99.90th=[ 169], 99.95th=[ 169], 00:27:30.655 | 99.99th=[ 169] 00:27:30.655 bw ( KiB/s): min=18216, max=26880, per=99.90%, avg=24682.00, stdev=4310.79, samples=4 00:27:30.655 iops : min= 4554, max= 6720, avg=6170.50, stdev=1077.70, samples=4 00:27:30.655 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:27:30.655 lat (msec) : 2=0.03%, 4=0.14%, 10=62.73%, 20=36.56%, 250=0.52% 00:27:30.655 cpu : usr=51.02%, sys=46.49%, ctx=126, majf=0, minf=41 00:27:30.655 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:30.655 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:30.655 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:30.655 issued rwts: total=12426,12403,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:30.655 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:30.655 00:27:30.655 Run status group 0 (all jobs): 00:27:30.655 READ: bw=24.2MiB/s (25.3MB/s), 24.2MiB/s-24.2MiB/s (25.3MB/s-25.3MB/s), io=48.5MiB (50.9MB), run=2008-2008msec 00:27:30.655 WRITE: bw=24.1MiB/s (25.3MB/s), 24.1MiB/s-24.1MiB/s (25.3MB/s-25.3MB/s), io=48.4MiB (50.8MB), run=2008-2008msec 00:27:30.655 04:39:09 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:30.913 04:39:09 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:27:32.289 04:39:11 -- host/fio.sh@64 -- # ls_nested_guid=751ce204-c6f6-48a5-aff1-0c415d2b2e01 00:27:32.289 04:39:11 -- host/fio.sh@65 -- # get_lvs_free_mb 751ce204-c6f6-48a5-aff1-0c415d2b2e01 00:27:32.289 04:39:11 -- common/autotest_common.sh@1353 -- # local lvs_uuid=751ce204-c6f6-48a5-aff1-0c415d2b2e01 00:27:32.289 04:39:11 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:32.289 04:39:11 -- common/autotest_common.sh@1355 -- # local fc 00:27:32.289 04:39:11 -- common/autotest_common.sh@1356 -- # local cs 00:27:32.289 04:39:11 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:32.289 04:39:11 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:32.289 { 00:27:32.289 "uuid": "90c3dd0b-0eea-4d49-b050-7edbb47c5ae9", 00:27:32.289 "name": "lvs_0", 00:27:32.289 "base_bdev": "Nvme0n1", 00:27:32.289 "total_data_clusters": 930, 00:27:32.289 "free_clusters": 0, 00:27:32.289 "block_size": 512, 00:27:32.289 "cluster_size": 1073741824 00:27:32.289 }, 00:27:32.289 { 00:27:32.289 "uuid": "751ce204-c6f6-48a5-aff1-0c415d2b2e01", 00:27:32.289 "name": "lvs_n_0", 00:27:32.289 "base_bdev": "638fee91-1184-4747-a495-ac6f11c3de67", 00:27:32.289 "total_data_clusters": 237847, 00:27:32.289 "free_clusters": 237847, 00:27:32.289 "block_size": 512, 00:27:32.289 "cluster_size": 4194304 00:27:32.289 } 00:27:32.289 ]' 00:27:32.289 04:39:11 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="751ce204-c6f6-48a5-aff1-0c415d2b2e01") .free_clusters' 00:27:32.289 04:39:11 -- common/autotest_common.sh@1358 -- # fc=237847 00:27:32.289 04:39:11 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="751ce204-c6f6-48a5-aff1-0c415d2b2e01") .cluster_size' 00:27:32.289 04:39:11 -- common/autotest_common.sh@1359 -- # cs=4194304 00:27:32.289 04:39:11 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:27:32.289 04:39:11 -- common/autotest_common.sh@1363 -- # echo 951388 00:27:32.289 951388 00:27:32.289 04:39:11 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:27:33.223 78f5594f-a706-4140-9f4b-da1b5640ec01 00:27:33.223 04:39:12 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:27:33.223 04:39:12 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:27:33.480 04:39:12 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:27:33.738 04:39:12 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:33.738 04:39:12 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:33.738 04:39:12 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:33.738 04:39:12 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:33.738 04:39:12 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:33.738 04:39:12 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:33.738 04:39:12 -- common/autotest_common.sh@1330 -- # shift 00:27:33.738 04:39:12 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:33.738 04:39:12 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:33.738 04:39:12 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:33.738 04:39:12 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:33.738 04:39:12 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:33.738 04:39:12 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:33.738 04:39:12 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:33.738 04:39:12 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:33.738 04:39:12 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:33.738 04:39:12 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:33.738 04:39:12 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:33.738 04:39:12 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:33.738 04:39:12 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:33.738 04:39:12 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:33.738 04:39:12 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:33.997 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:33.997 fio-3.35 00:27:33.997 Starting 1 thread 00:27:33.997 EAL: No free 2048 kB hugepages reported on node 1 00:27:36.525 00:27:36.525 test: (groupid=0, jobs=1): err= 0: pid=3017981: Tue Nov 26 04:39:15 2024 00:27:36.525 read: IOPS=6003, BW=23.5MiB/s (24.6MB/s)(47.1MiB/2007msec) 00:27:36.525 slat (nsec): min=1892, max=192927, avg=2487.71, stdev=2514.60 00:27:36.525 clat (usec): min=4556, max=18492, avg=11742.15, stdev=1029.29 00:27:36.525 lat (usec): min=4566, max=18494, avg=11744.64, stdev=1029.19 00:27:36.525 clat percentiles (usec): 00:27:36.525 | 1.00th=[ 9241], 5.00th=[10159], 10.00th=[10552], 20.00th=[10945], 00:27:36.525 | 30.00th=[11207], 40.00th=[11469], 50.00th=[11731], 60.00th=[11994], 00:27:36.525 | 70.00th=[12256], 80.00th=[12518], 90.00th=[13042], 95.00th=[13304], 00:27:36.525 | 99.00th=[14091], 99.50th=[14353], 99.90th=[18220], 99.95th=[18220], 00:27:36.525 | 99.99th=[18482] 00:27:36.525 bw ( KiB/s): min=22520, max=24472, per=99.70%, avg=23942.00, stdev=949.51, samples=4 00:27:36.525 iops : min= 5630, max= 6118, avg=5985.50, stdev=237.38, samples=4 00:27:36.525 write: IOPS=5984, BW=23.4MiB/s (24.5MB/s)(46.9MiB/2007msec); 0 zone resets 00:27:36.525 slat (nsec): min=1999, max=135894, avg=2587.20, stdev=1782.15 00:27:36.525 clat (usec): min=2188, max=15679, avg=9408.68, stdev=859.02 00:27:36.525 lat (usec): min=2194, max=15681, avg=9411.27, stdev=859.01 00:27:36.525 clat percentiles (usec): 00:27:36.525 | 1.00th=[ 7373], 5.00th=[ 8029], 10.00th=[ 8356], 20.00th=[ 8717], 00:27:36.525 | 30.00th=[ 8979], 40.00th=[ 9241], 50.00th=[ 9372], 60.00th=[ 9634], 00:27:36.525 | 70.00th=[ 9765], 80.00th=[10028], 90.00th=[10421], 95.00th=[10683], 00:27:36.525 | 99.00th=[11338], 99.50th=[11469], 99.90th=[14091], 99.95th=[14353], 00:27:36.525 | 99.99th=[15664] 00:27:36.525 bw ( KiB/s): min=23440, max=24192, per=99.94%, avg=23924.00, stdev=340.51, samples=4 00:27:36.525 iops : min= 5860, max= 6048, avg=5981.00, stdev=85.13, samples=4 00:27:36.525 lat (msec) : 4=0.04%, 10=40.39%, 20=59.57% 00:27:36.525 cpu : usr=59.47%, sys=38.24%, ctx=129, majf=0, minf=41 00:27:36.525 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:36.525 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:36.525 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:36.525 issued rwts: total=12049,12011,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:36.525 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:36.525 00:27:36.525 Run status group 0 (all jobs): 00:27:36.525 READ: bw=23.5MiB/s (24.6MB/s), 23.5MiB/s-23.5MiB/s (24.6MB/s-24.6MB/s), io=47.1MiB (49.4MB), run=2007-2007msec 00:27:36.525 WRITE: bw=23.4MiB/s (24.5MB/s), 23.4MiB/s-23.4MiB/s (24.5MB/s-24.5MB/s), io=46.9MiB (49.2MB), run=2007-2007msec 00:27:36.525 04:39:15 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:27:36.525 04:39:15 -- host/fio.sh@74 -- # sync 00:27:36.525 04:39:15 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:27:40.875 04:39:19 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:40.876 04:39:19 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:27:44.163 04:39:22 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:44.163 04:39:22 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:27:46.068 04:39:24 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:27:46.068 04:39:24 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:27:46.068 04:39:24 -- host/fio.sh@86 -- # nvmftestfini 00:27:46.068 04:39:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:46.068 04:39:24 -- nvmf/common.sh@116 -- # sync 00:27:46.068 04:39:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:46.068 04:39:24 -- nvmf/common.sh@119 -- # set +e 00:27:46.068 04:39:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:46.068 04:39:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:46.068 rmmod nvme_tcp 00:27:46.068 rmmod nvme_fabrics 00:27:46.068 rmmod nvme_keyring 00:27:46.068 04:39:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:46.068 04:39:24 -- nvmf/common.sh@123 -- # set -e 00:27:46.068 04:39:24 -- nvmf/common.sh@124 -- # return 0 00:27:46.068 04:39:24 -- nvmf/common.sh@477 -- # '[' -n 3014334 ']' 00:27:46.068 04:39:24 -- nvmf/common.sh@478 -- # killprocess 3014334 00:27:46.068 04:39:24 -- common/autotest_common.sh@936 -- # '[' -z 3014334 ']' 00:27:46.068 04:39:24 -- common/autotest_common.sh@940 -- # kill -0 3014334 00:27:46.068 04:39:24 -- common/autotest_common.sh@941 -- # uname 00:27:46.068 04:39:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:46.068 04:39:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3014334 00:27:46.068 04:39:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:46.068 04:39:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:46.068 04:39:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3014334' 00:27:46.068 killing process with pid 3014334 00:27:46.068 04:39:24 -- common/autotest_common.sh@955 -- # kill 3014334 00:27:46.068 04:39:24 -- common/autotest_common.sh@960 -- # wait 3014334 00:27:46.068 04:39:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:46.068 04:39:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:46.068 04:39:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:46.068 04:39:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:46.068 04:39:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:46.068 04:39:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:46.068 04:39:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:46.068 04:39:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:48.602 04:39:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:48.602 00:27:48.602 real 0m37.980s 00:27:48.602 user 2m25.458s 00:27:48.602 sys 0m7.288s 00:27:48.602 04:39:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:48.602 04:39:27 -- common/autotest_common.sh@10 -- # set +x 00:27:48.602 ************************************ 00:27:48.602 END TEST nvmf_fio_host 00:27:48.602 ************************************ 00:27:48.602 04:39:27 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:48.602 04:39:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:48.602 04:39:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:48.602 04:39:27 -- common/autotest_common.sh@10 -- # set +x 00:27:48.602 ************************************ 00:27:48.602 START TEST nvmf_failover 00:27:48.602 ************************************ 00:27:48.602 04:39:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:48.602 * Looking for test storage... 00:27:48.602 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:48.602 04:39:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:48.602 04:39:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:48.602 04:39:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:48.602 04:39:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:48.602 04:39:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:48.602 04:39:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:48.602 04:39:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:48.602 04:39:27 -- scripts/common.sh@335 -- # IFS=.-: 00:27:48.602 04:39:27 -- scripts/common.sh@335 -- # read -ra ver1 00:27:48.602 04:39:27 -- scripts/common.sh@336 -- # IFS=.-: 00:27:48.602 04:39:27 -- scripts/common.sh@336 -- # read -ra ver2 00:27:48.602 04:39:27 -- scripts/common.sh@337 -- # local 'op=<' 00:27:48.602 04:39:27 -- scripts/common.sh@339 -- # ver1_l=2 00:27:48.602 04:39:27 -- scripts/common.sh@340 -- # ver2_l=1 00:27:48.602 04:39:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:48.602 04:39:27 -- scripts/common.sh@343 -- # case "$op" in 00:27:48.602 04:39:27 -- scripts/common.sh@344 -- # : 1 00:27:48.602 04:39:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:48.602 04:39:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:48.602 04:39:27 -- scripts/common.sh@364 -- # decimal 1 00:27:48.602 04:39:27 -- scripts/common.sh@352 -- # local d=1 00:27:48.603 04:39:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:48.603 04:39:27 -- scripts/common.sh@354 -- # echo 1 00:27:48.603 04:39:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:48.603 04:39:27 -- scripts/common.sh@365 -- # decimal 2 00:27:48.603 04:39:27 -- scripts/common.sh@352 -- # local d=2 00:27:48.603 04:39:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:48.603 04:39:27 -- scripts/common.sh@354 -- # echo 2 00:27:48.603 04:39:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:48.603 04:39:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:48.603 04:39:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:48.603 04:39:27 -- scripts/common.sh@367 -- # return 0 00:27:48.603 04:39:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:48.603 04:39:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:48.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:48.603 --rc genhtml_branch_coverage=1 00:27:48.603 --rc genhtml_function_coverage=1 00:27:48.603 --rc genhtml_legend=1 00:27:48.603 --rc geninfo_all_blocks=1 00:27:48.603 --rc geninfo_unexecuted_blocks=1 00:27:48.603 00:27:48.603 ' 00:27:48.603 04:39:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:48.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:48.603 --rc genhtml_branch_coverage=1 00:27:48.603 --rc genhtml_function_coverage=1 00:27:48.603 --rc genhtml_legend=1 00:27:48.603 --rc geninfo_all_blocks=1 00:27:48.603 --rc geninfo_unexecuted_blocks=1 00:27:48.603 00:27:48.603 ' 00:27:48.603 04:39:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:48.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:48.603 --rc genhtml_branch_coverage=1 00:27:48.603 --rc genhtml_function_coverage=1 00:27:48.603 --rc genhtml_legend=1 00:27:48.603 --rc geninfo_all_blocks=1 00:27:48.603 --rc geninfo_unexecuted_blocks=1 00:27:48.603 00:27:48.603 ' 00:27:48.603 04:39:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:48.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:48.603 --rc genhtml_branch_coverage=1 00:27:48.603 --rc genhtml_function_coverage=1 00:27:48.603 --rc genhtml_legend=1 00:27:48.603 --rc geninfo_all_blocks=1 00:27:48.603 --rc geninfo_unexecuted_blocks=1 00:27:48.603 00:27:48.603 ' 00:27:48.603 04:39:27 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:48.603 04:39:27 -- nvmf/common.sh@7 -- # uname -s 00:27:48.603 04:39:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:48.603 04:39:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:48.603 04:39:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:48.603 04:39:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:48.603 04:39:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:48.603 04:39:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:48.603 04:39:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:48.603 04:39:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:48.603 04:39:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:48.603 04:39:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:48.603 04:39:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:48.603 04:39:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:48.603 04:39:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:48.603 04:39:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:48.603 04:39:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:48.603 04:39:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:48.603 04:39:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:48.603 04:39:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:48.603 04:39:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:48.603 04:39:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.603 04:39:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.603 04:39:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.603 04:39:27 -- paths/export.sh@5 -- # export PATH 00:27:48.603 04:39:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.603 04:39:27 -- nvmf/common.sh@46 -- # : 0 00:27:48.603 04:39:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:48.603 04:39:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:48.603 04:39:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:48.603 04:39:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:48.603 04:39:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:48.603 04:39:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:48.603 04:39:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:48.603 04:39:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:48.603 04:39:27 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:48.603 04:39:27 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:48.603 04:39:27 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:48.603 04:39:27 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:27:48.603 04:39:27 -- host/failover.sh@18 -- # nvmftestinit 00:27:48.603 04:39:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:48.603 04:39:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:48.603 04:39:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:48.603 04:39:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:48.603 04:39:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:48.603 04:39:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:48.603 04:39:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:48.603 04:39:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:48.603 04:39:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:48.603 04:39:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:48.603 04:39:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:48.603 04:39:27 -- common/autotest_common.sh@10 -- # set +x 00:27:50.508 04:39:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:50.508 04:39:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:50.508 04:39:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:50.508 04:39:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:50.508 04:39:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:50.508 04:39:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:50.508 04:39:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:50.508 04:39:29 -- nvmf/common.sh@294 -- # net_devs=() 00:27:50.508 04:39:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:50.508 04:39:29 -- nvmf/common.sh@295 -- # e810=() 00:27:50.508 04:39:29 -- nvmf/common.sh@295 -- # local -ga e810 00:27:50.508 04:39:29 -- nvmf/common.sh@296 -- # x722=() 00:27:50.508 04:39:29 -- nvmf/common.sh@296 -- # local -ga x722 00:27:50.508 04:39:29 -- nvmf/common.sh@297 -- # mlx=() 00:27:50.508 04:39:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:50.508 04:39:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:50.508 04:39:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:50.508 04:39:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:50.508 04:39:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:50.508 04:39:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:50.508 04:39:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:50.508 04:39:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:50.508 04:39:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:50.508 04:39:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:50.508 04:39:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:50.508 04:39:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:50.508 04:39:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:50.508 04:39:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:50.508 04:39:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:50.508 04:39:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:50.508 04:39:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:50.508 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:50.508 04:39:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:50.508 04:39:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:50.508 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:50.508 04:39:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:50.508 04:39:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:50.508 04:39:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:50.508 04:39:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:50.508 04:39:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:50.508 04:39:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:50.508 04:39:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:50.508 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:50.508 04:39:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:50.508 04:39:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:50.508 04:39:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:50.508 04:39:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:50.508 04:39:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:50.508 04:39:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:50.508 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:50.508 04:39:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:50.508 04:39:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:50.509 04:39:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:50.509 04:39:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:50.509 04:39:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:50.509 04:39:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:50.509 04:39:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:50.509 04:39:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:50.509 04:39:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:50.509 04:39:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:50.509 04:39:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:50.509 04:39:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:50.509 04:39:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:50.509 04:39:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:50.509 04:39:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:50.509 04:39:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:50.509 04:39:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:50.509 04:39:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:50.509 04:39:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:50.509 04:39:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:50.509 04:39:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:50.509 04:39:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:50.509 04:39:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:50.509 04:39:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:50.509 04:39:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:50.509 04:39:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:50.509 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:50.509 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:27:50.509 00:27:50.509 --- 10.0.0.2 ping statistics --- 00:27:50.509 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:50.509 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:27:50.509 04:39:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:50.509 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:50.509 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.200 ms 00:27:50.509 00:27:50.509 --- 10.0.0.1 ping statistics --- 00:27:50.509 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:50.509 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:27:50.509 04:39:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:50.509 04:39:29 -- nvmf/common.sh@410 -- # return 0 00:27:50.509 04:39:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:50.509 04:39:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:50.509 04:39:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:50.509 04:39:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:50.509 04:39:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:50.509 04:39:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:50.509 04:39:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:50.509 04:39:29 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:27:50.509 04:39:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:50.509 04:39:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:50.509 04:39:29 -- common/autotest_common.sh@10 -- # set +x 00:27:50.509 04:39:29 -- nvmf/common.sh@469 -- # nvmfpid=3021305 00:27:50.509 04:39:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:50.509 04:39:29 -- nvmf/common.sh@470 -- # waitforlisten 3021305 00:27:50.509 04:39:29 -- common/autotest_common.sh@829 -- # '[' -z 3021305 ']' 00:27:50.509 04:39:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:50.509 04:39:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:50.509 04:39:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:50.509 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:50.509 04:39:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:50.509 04:39:29 -- common/autotest_common.sh@10 -- # set +x 00:27:50.509 [2024-11-26 04:39:29.708018] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:50.509 [2024-11-26 04:39:29.708106] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:50.767 EAL: No free 2048 kB hugepages reported on node 1 00:27:50.767 [2024-11-26 04:39:29.780491] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:50.767 [2024-11-26 04:39:29.872641] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:50.767 [2024-11-26 04:39:29.872824] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:50.767 [2024-11-26 04:39:29.872842] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:50.767 [2024-11-26 04:39:29.872855] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:50.767 [2024-11-26 04:39:29.872985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:50.767 [2024-11-26 04:39:29.873077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:50.767 [2024-11-26 04:39:29.873079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:51.701 04:39:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:51.701 04:39:30 -- common/autotest_common.sh@862 -- # return 0 00:27:51.701 04:39:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:51.701 04:39:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:51.701 04:39:30 -- common/autotest_common.sh@10 -- # set +x 00:27:51.701 04:39:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:51.701 04:39:30 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:51.959 [2024-11-26 04:39:30.954609] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:51.959 04:39:30 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:27:52.217 Malloc0 00:27:52.217 04:39:31 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:52.475 04:39:31 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:52.732 04:39:31 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:52.990 [2024-11-26 04:39:31.999513] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:52.990 04:39:32 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:27:53.247 [2024-11-26 04:39:32.264256] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:27:53.247 04:39:32 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:27:53.506 [2024-11-26 04:39:32.509089] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:27:53.506 04:39:32 -- host/failover.sh@31 -- # bdevperf_pid=3021725 00:27:53.506 04:39:32 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:27:53.506 04:39:32 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:53.506 04:39:32 -- host/failover.sh@34 -- # waitforlisten 3021725 /var/tmp/bdevperf.sock 00:27:53.506 04:39:32 -- common/autotest_common.sh@829 -- # '[' -z 3021725 ']' 00:27:53.506 04:39:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:27:53.506 04:39:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:53.506 04:39:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:27:53.506 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:27:53.506 04:39:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:53.506 04:39:32 -- common/autotest_common.sh@10 -- # set +x 00:27:54.441 04:39:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:54.441 04:39:33 -- common/autotest_common.sh@862 -- # return 0 00:27:54.441 04:39:33 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:54.699 NVMe0n1 00:27:54.699 04:39:33 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:55.269 00:27:55.269 04:39:34 -- host/failover.sh@39 -- # run_test_pid=3021880 00:27:55.269 04:39:34 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:27:55.269 04:39:34 -- host/failover.sh@41 -- # sleep 1 00:27:56.206 04:39:35 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:56.464 [2024-11-26 04:39:35.462530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.464 [2024-11-26 04:39:35.462842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.462854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.462867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.462879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.462891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.462903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.462916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.462928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.462940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.462953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.462965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.462986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.462999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 [2024-11-26 04:39:35.463191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c6180 is same with the state(5) to be set 00:27:56.465 04:39:35 -- host/failover.sh@45 -- # sleep 3 00:27:59.753 04:39:38 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:59.753 00:28:00.011 04:39:38 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:00.011 [2024-11-26 04:39:39.214772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.011 [2024-11-26 04:39:39.214841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.011 [2024-11-26 04:39:39.214865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.011 [2024-11-26 04:39:39.214878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.214890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.214902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.214913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.214926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.214955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.214969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.214980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.214992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.012 [2024-11-26 04:39:39.215246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c7530 is same with the state(5) to be set 00:28:00.269 04:39:39 -- host/failover.sh@50 -- # sleep 3 00:28:03.560 04:39:42 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:03.560 [2024-11-26 04:39:42.500293] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:03.560 04:39:42 -- host/failover.sh@55 -- # sleep 1 00:28:04.496 04:39:43 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:04.756 [2024-11-26 04:39:43.807828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.807910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.807926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.807938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.807950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.807963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.807976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.807989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.756 [2024-11-26 04:39:43.808182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 [2024-11-26 04:39:43.808417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x157d5e0 is same with the state(5) to be set 00:28:04.757 04:39:43 -- host/failover.sh@59 -- # wait 3021880 00:28:11.334 0 00:28:11.334 04:39:49 -- host/failover.sh@61 -- # killprocess 3021725 00:28:11.334 04:39:49 -- common/autotest_common.sh@936 -- # '[' -z 3021725 ']' 00:28:11.334 04:39:49 -- common/autotest_common.sh@940 -- # kill -0 3021725 00:28:11.334 04:39:49 -- common/autotest_common.sh@941 -- # uname 00:28:11.334 04:39:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:11.334 04:39:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3021725 00:28:11.334 04:39:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:11.334 04:39:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:11.334 04:39:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3021725' 00:28:11.334 killing process with pid 3021725 00:28:11.334 04:39:49 -- common/autotest_common.sh@955 -- # kill 3021725 00:28:11.334 04:39:49 -- common/autotest_common.sh@960 -- # wait 3021725 00:28:11.334 04:39:49 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:11.334 [2024-11-26 04:39:32.567855] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:11.334 [2024-11-26 04:39:32.567948] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3021725 ] 00:28:11.334 EAL: No free 2048 kB hugepages reported on node 1 00:28:11.334 [2024-11-26 04:39:32.626313] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:11.334 [2024-11-26 04:39:32.710410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:11.334 Running I/O for 15 seconds... 00:28:11.334 [2024-11-26 04:39:35.463297] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.334 [2024-11-26 04:39:35.463338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463356] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.334 [2024-11-26 04:39:35.463371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463385] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.334 [2024-11-26 04:39:35.463399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463412] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.334 [2024-11-26 04:39:35.463426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f5600 is same with the state(5) to be set 00:28:11.334 [2024-11-26 04:39:35.463501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:114536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:114552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:114560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:114568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:114576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:114600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:114608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:114624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:115192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:115200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:115216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:114632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:114640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:114648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.463965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:114656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.463978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.464008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:114672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.464021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.464035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:114696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.464048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.464078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:114704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.464091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.464105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:114720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.464118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.464136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:115240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.464151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.464165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:115248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.334 [2024-11-26 04:39:35.464178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.334 [2024-11-26 04:39:35.464192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:115256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:114728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:114752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:114760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:114776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:114792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:114800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:114808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:114856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:115272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:115296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:114888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:114896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:114904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:114912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:114936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:114960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:114976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:114992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:115304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.464785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:115312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.464814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:115320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.464843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:115328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.464872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:115336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.464910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:115344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.464938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:115352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.464967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.464982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:115360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.465021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:115368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.465050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:115376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.465077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:115384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.465105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:115392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.465133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:115400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.465160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:115408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.465188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:115416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.465216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:115424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.465243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:115432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.465275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:115440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.465303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:115448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.465331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:115456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.335 [2024-11-26 04:39:35.465358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.335 [2024-11-26 04:39:35.465373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:115464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.335 [2024-11-26 04:39:35.465386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:115472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:115480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:115488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.465467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:115496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:115504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.465522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:115512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.465549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:115520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.465576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:115528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:115536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.465635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:115544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:115552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.465730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:115560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:115568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:115576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:115584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:115000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:115016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:115024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:115048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.465974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:115096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.465988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:115104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.466041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:115120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.466073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:115136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.466101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:115592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.466128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:115600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.466156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:115608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.466183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:115616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.466211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:115624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.466238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:115632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.466272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:115640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.466301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:115648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.466329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:115656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.466356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:115664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.466383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:115672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.466417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:115680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.466445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:115688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.466473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:115696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.466500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:115704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.336 [2024-11-26 04:39:35.466529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:115712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.336 [2024-11-26 04:39:35.466556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.336 [2024-11-26 04:39:35.466571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:115720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.466584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:115728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.337 [2024-11-26 04:39:35.466611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:115736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.466638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:115744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.337 [2024-11-26 04:39:35.466666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:115752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.466719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:115760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.466753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:115768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.466783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:115776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.466815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:115784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.337 [2024-11-26 04:39:35.466844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:115792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.466872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:115800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.337 [2024-11-26 04:39:35.466900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:115808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.337 [2024-11-26 04:39:35.466928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:115816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.466956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.466970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:115824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.466988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:115832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.337 [2024-11-26 04:39:35.467032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:115840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.337 [2024-11-26 04:39:35.467059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:115848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.337 [2024-11-26 04:39:35.467086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:115856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.337 [2024-11-26 04:39:35.467114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:115864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.467140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:115872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.337 [2024-11-26 04:39:35.467171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:115176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.467199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:115184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.467232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:115208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.467261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:115224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.467287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:115232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.467315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:115264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.467343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:115280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:35.467370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x814c70 is same with the state(5) to be set 00:28:11.337 [2024-11-26 04:39:35.467399] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:11.337 [2024-11-26 04:39:35.467410] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:11.337 [2024-11-26 04:39:35.467421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:115288 len:8 PRP1 0x0 PRP2 0x0 00:28:11.337 [2024-11-26 04:39:35.467433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:35.467489] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x814c70 was disconnected and freed. reset controller. 00:28:11.337 [2024-11-26 04:39:35.467513] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:11.337 [2024-11-26 04:39:35.467529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:11.337 [2024-11-26 04:39:35.469889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:11.337 [2024-11-26 04:39:35.469926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7f5600 (9): Bad file descriptor 00:28:11.337 [2024-11-26 04:39:35.622247] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:11.337 [2024-11-26 04:39:39.215385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:28080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:39.215433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:39.215462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:28088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:39.215479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:39.215495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:28096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:39.215509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:39.215524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:28112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:39.215538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:39.215553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:27408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:39.215566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:39.215581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:39.215595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:39.215630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:27432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:39.215643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:39.215658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:27440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.337 [2024-11-26 04:39:39.215692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.337 [2024-11-26 04:39:39.215710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:27456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.215723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.215753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:27464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.215766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.215780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:27496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.215793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.215808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:27504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.215820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.215835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:28128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.215847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.215866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:28160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.215880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.215895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:28232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.215908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.215922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:27512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.215935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.215949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.215973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.215987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:27536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:27568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:27584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:27592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:28240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:28256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.338 [2024-11-26 04:39:39.216208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:28264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.338 [2024-11-26 04:39:39.216269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:27672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:27696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:27704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:27720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:27816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:27840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:27856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:28288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:28296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:28304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:28312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.338 [2024-11-26 04:39:39.216622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:28320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.338 [2024-11-26 04:39:39.216648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.338 [2024-11-26 04:39:39.216662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.338 [2024-11-26 04:39:39.216675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.216711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:28336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.216727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.216741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:28344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.216755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.216769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:28352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.216782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.216796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.216809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.216824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:28368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.216837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.216851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:28376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.216864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.216878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.339 [2024-11-26 04:39:39.216892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.216906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:28392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.216919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.216934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.339 [2024-11-26 04:39:39.216947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.216967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:28408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.216981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:28416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.339 [2024-11-26 04:39:39.217023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:28432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:27928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:27960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:28008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:28016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:28024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.339 [2024-11-26 04:39:39.217318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:28448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:28456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:28464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.339 [2024-11-26 04:39:39.217399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:28472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.339 [2024-11-26 04:39:39.217426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:28480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:28488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:28496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.339 [2024-11-26 04:39:39.217505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:28504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.339 [2024-11-26 04:39:39.217532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:28512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.339 [2024-11-26 04:39:39.217559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:28528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.339 [2024-11-26 04:39:39.217613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:28536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:28544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.339 [2024-11-26 04:39:39.217690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:28552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:28560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.339 [2024-11-26 04:39:39.217767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:28568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.339 [2024-11-26 04:39:39.217824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.339 [2024-11-26 04:39:39.217839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.217852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.217867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:28592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.217880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.217895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.217908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.217923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:28608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.217936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.217951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.217965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.217995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:28624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.218009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:28632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.218036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:28640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.218080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:28648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.218112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:28656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:28664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.218165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:28688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:28696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.218272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:28704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:28712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.218325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:28720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.218353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.218421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:28744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:28752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.218480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:28760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.218507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:28768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:28776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:28784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.340 [2024-11-26 04:39:39.218588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:28808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:28816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:28072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:28152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.218972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.218985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.219016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:28176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.340 [2024-11-26 04:39:39.219029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.340 [2024-11-26 04:39:39.219043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:39.219056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:39.219070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:28192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:39.219084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:39.219098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:28200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:39.219111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:39.219125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:28208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:39.219138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:39.219152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:28216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:39.219165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:39.219180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:28224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:39.219196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:39.219210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x801a90 is same with the state(5) to be set 00:28:11.341 [2024-11-26 04:39:39.219226] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:11.341 [2024-11-26 04:39:39.219236] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:11.341 [2024-11-26 04:39:39.219248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:28248 len:8 PRP1 0x0 PRP2 0x0 00:28:11.341 [2024-11-26 04:39:39.219260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:39.219316] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x801a90 was disconnected and freed. reset controller. 00:28:11.341 [2024-11-26 04:39:39.219334] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:11.341 [2024-11-26 04:39:39.219380] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.341 [2024-11-26 04:39:39.219399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:39.219414] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.341 [2024-11-26 04:39:39.219427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:39.219441] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.341 [2024-11-26 04:39:39.219453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:39.219467] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.341 [2024-11-26 04:39:39.219480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:39.219492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:11.341 [2024-11-26 04:39:39.219544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7f5600 (9): Bad file descriptor 00:28:11.341 [2024-11-26 04:39:39.221789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:11.341 [2024-11-26 04:39:39.330197] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:11.341 [2024-11-26 04:39:43.807938] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.341 [2024-11-26 04:39:43.807982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808000] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.341 [2024-11-26 04:39:43.808015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808030] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.341 [2024-11-26 04:39:43.808043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808058] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.341 [2024-11-26 04:39:43.808071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f5600 is same with the state(5) to be set 00:28:11.341 [2024-11-26 04:39:43.808561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:16792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:16816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:16832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:16848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:16856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:16104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:16136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:16160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:16184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:16216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:16224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:16272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.808974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:16280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.808994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.809009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:16304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.809037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.809052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:16328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.809065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.809078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:16344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.809091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.809105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:16368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.809117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.809131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:16376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.809144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.809158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.809171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.809185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:16432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.809198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.341 [2024-11-26 04:39:43.809213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:16448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.341 [2024-11-26 04:39:43.809226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:16872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:16888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:16896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:16912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:16936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:16952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:16968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:16992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:17008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:17024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:17048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.342 [2024-11-26 04:39:43.809606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:17056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.342 [2024-11-26 04:39:43.809633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:17064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.342 [2024-11-26 04:39:43.809658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:16488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:16504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:16520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:16528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:16560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:16584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:16592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:17072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:17080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.809971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.809986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:17088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.810000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:17096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.342 [2024-11-26 04:39:43.810043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:17104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.810069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:17112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.810099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:17120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.342 [2024-11-26 04:39:43.810126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:17128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.342 [2024-11-26 04:39:43.810153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:17136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.342 [2024-11-26 04:39:43.810179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:17144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.342 [2024-11-26 04:39:43.810207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:17152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.342 [2024-11-26 04:39:43.810234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:17160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.342 [2024-11-26 04:39:43.810260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:17168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.810287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:17176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.342 [2024-11-26 04:39:43.810314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:17184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.810340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:17192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.342 [2024-11-26 04:39:43.810367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.342 [2024-11-26 04:39:43.810381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:17200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.342 [2024-11-26 04:39:43.810394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:17208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.810423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:17216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.810453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:17224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.810481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.810508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:17240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.810533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:17248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.810560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:17256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.810587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:17264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.810614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:17272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.810641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:17280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.810667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:17288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.810721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:17296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.810754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:17304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.810782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:17312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.810809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.810841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:16608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.810870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.810897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.810924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:16640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.810963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.810977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:16648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.810990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:16656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.811031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:16672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.811058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:17320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.811085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:17328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.811111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:17336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.811137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:17344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.811164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:17352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.811194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:17360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.811221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.811248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:17376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.811275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:17384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.811301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:17392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.811329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.811355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:17408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.343 [2024-11-26 04:39:43.811382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.343 [2024-11-26 04:39:43.811396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:17416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.343 [2024-11-26 04:39:43.811408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:17424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:16688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:16696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:16704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:16736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:16744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:16752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:16768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:17432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.344 [2024-11-26 04:39:43.811708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:17440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:17448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.344 [2024-11-26 04:39:43.811785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:17456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.344 [2024-11-26 04:39:43.811813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:17464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.344 [2024-11-26 04:39:43.811840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.344 [2024-11-26 04:39:43.811869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:17480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:16784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:16800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.811958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.811972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:16808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:16824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:16864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:16904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:16920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:16928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:16960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:16976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:16984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:17000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:17016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.344 [2024-11-26 04:39:43.812373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x816c50 is same with the state(5) to be set 00:28:11.344 [2024-11-26 04:39:43.812403] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:11.344 [2024-11-26 04:39:43.812414] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:11.344 [2024-11-26 04:39:43.812426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17040 len:8 PRP1 0x0 PRP2 0x0 00:28:11.344 [2024-11-26 04:39:43.812438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.344 [2024-11-26 04:39:43.812512] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x816c50 was disconnected and freed. reset controller. 00:28:11.344 [2024-11-26 04:39:43.812532] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:11.344 [2024-11-26 04:39:43.812546] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:11.344 [2024-11-26 04:39:43.814672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:11.344 [2024-11-26 04:39:43.814737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7f5600 (9): Bad file descriptor 00:28:11.344 [2024-11-26 04:39:43.927921] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:11.344 00:28:11.344 Latency(us) 00:28:11.344 [2024-11-26T03:39:50.570Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:11.344 [2024-11-26T03:39:50.570Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:11.344 Verification LBA range: start 0x0 length 0x4000 00:28:11.344 NVMe0n1 : 15.01 12447.54 48.62 1479.16 0.00 9174.12 546.13 14466.47 00:28:11.344 [2024-11-26T03:39:50.570Z] =================================================================================================================== 00:28:11.344 [2024-11-26T03:39:50.570Z] Total : 12447.54 48.62 1479.16 0.00 9174.12 546.13 14466.47 00:28:11.344 Received shutdown signal, test time was about 15.000000 seconds 00:28:11.344 00:28:11.344 Latency(us) 00:28:11.344 [2024-11-26T03:39:50.570Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:11.344 [2024-11-26T03:39:50.571Z] =================================================================================================================== 00:28:11.345 [2024-11-26T03:39:50.571Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:11.345 04:39:49 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:11.345 04:39:49 -- host/failover.sh@65 -- # count=3 00:28:11.345 04:39:49 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:11.345 04:39:49 -- host/failover.sh@73 -- # bdevperf_pid=3023768 00:28:11.345 04:39:49 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:11.345 04:39:49 -- host/failover.sh@75 -- # waitforlisten 3023768 /var/tmp/bdevperf.sock 00:28:11.345 04:39:49 -- common/autotest_common.sh@829 -- # '[' -z 3023768 ']' 00:28:11.345 04:39:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:11.345 04:39:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:11.345 04:39:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:11.345 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:11.345 04:39:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:11.345 04:39:49 -- common/autotest_common.sh@10 -- # set +x 00:28:11.603 04:39:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:11.603 04:39:50 -- common/autotest_common.sh@862 -- # return 0 00:28:11.603 04:39:50 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:11.861 [2024-11-26 04:39:50.882963] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:11.861 04:39:50 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:12.120 [2024-11-26 04:39:51.127583] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:12.120 04:39:51 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:12.378 NVMe0n1 00:28:12.378 04:39:51 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:12.944 00:28:12.944 04:39:51 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:13.202 00:28:13.202 04:39:52 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:13.202 04:39:52 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:13.461 04:39:52 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:13.721 04:39:52 -- host/failover.sh@87 -- # sleep 3 00:28:17.010 04:39:55 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:17.010 04:39:55 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:17.010 04:39:56 -- host/failover.sh@90 -- # run_test_pid=3024593 00:28:17.010 04:39:56 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:17.010 04:39:56 -- host/failover.sh@92 -- # wait 3024593 00:28:18.392 0 00:28:18.392 04:39:57 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:18.392 [2024-11-26 04:39:49.701447] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:18.392 [2024-11-26 04:39:49.701538] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3023768 ] 00:28:18.392 EAL: No free 2048 kB hugepages reported on node 1 00:28:18.392 [2024-11-26 04:39:49.759612] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:18.392 [2024-11-26 04:39:49.840888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:18.392 [2024-11-26 04:39:52.894836] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:18.392 [2024-11-26 04:39:52.894918] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:18.392 [2024-11-26 04:39:52.894941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:18.392 [2024-11-26 04:39:52.894959] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:18.392 [2024-11-26 04:39:52.894974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:18.392 [2024-11-26 04:39:52.895012] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:18.392 [2024-11-26 04:39:52.895026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:18.392 [2024-11-26 04:39:52.895040] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:18.392 [2024-11-26 04:39:52.895053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:18.392 [2024-11-26 04:39:52.895066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:18.392 [2024-11-26 04:39:52.895101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:18.392 [2024-11-26 04:39:52.895142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e42600 (9): Bad file descriptor 00:28:18.392 [2024-11-26 04:39:52.902045] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:18.392 Running I/O for 1 seconds... 00:28:18.392 00:28:18.392 Latency(us) 00:28:18.392 [2024-11-26T03:39:57.618Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:18.392 [2024-11-26T03:39:57.618Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:18.392 Verification LBA range: start 0x0 length 0x4000 00:28:18.392 NVMe0n1 : 1.01 12661.63 49.46 0.00 0.00 10063.10 1104.40 16408.27 00:28:18.392 [2024-11-26T03:39:57.618Z] =================================================================================================================== 00:28:18.392 [2024-11-26T03:39:57.618Z] Total : 12661.63 49.46 0.00 0.00 10063.10 1104.40 16408.27 00:28:18.392 04:39:57 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:18.392 04:39:57 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:18.392 04:39:57 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:18.652 04:39:57 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:18.652 04:39:57 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:18.910 04:39:58 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:19.170 04:39:58 -- host/failover.sh@101 -- # sleep 3 00:28:22.473 04:40:01 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:22.473 04:40:01 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:22.473 04:40:01 -- host/failover.sh@108 -- # killprocess 3023768 00:28:22.473 04:40:01 -- common/autotest_common.sh@936 -- # '[' -z 3023768 ']' 00:28:22.473 04:40:01 -- common/autotest_common.sh@940 -- # kill -0 3023768 00:28:22.473 04:40:01 -- common/autotest_common.sh@941 -- # uname 00:28:22.473 04:40:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:22.473 04:40:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3023768 00:28:22.473 04:40:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:22.473 04:40:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:22.473 04:40:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3023768' 00:28:22.473 killing process with pid 3023768 00:28:22.473 04:40:01 -- common/autotest_common.sh@955 -- # kill 3023768 00:28:22.473 04:40:01 -- common/autotest_common.sh@960 -- # wait 3023768 00:28:22.733 04:40:01 -- host/failover.sh@110 -- # sync 00:28:22.733 04:40:01 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:22.993 04:40:02 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:22.994 04:40:02 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:22.994 04:40:02 -- host/failover.sh@116 -- # nvmftestfini 00:28:22.994 04:40:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:22.994 04:40:02 -- nvmf/common.sh@116 -- # sync 00:28:22.994 04:40:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:22.994 04:40:02 -- nvmf/common.sh@119 -- # set +e 00:28:22.994 04:40:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:22.994 04:40:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:22.994 rmmod nvme_tcp 00:28:22.994 rmmod nvme_fabrics 00:28:22.994 rmmod nvme_keyring 00:28:22.994 04:40:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:22.994 04:40:02 -- nvmf/common.sh@123 -- # set -e 00:28:22.994 04:40:02 -- nvmf/common.sh@124 -- # return 0 00:28:22.994 04:40:02 -- nvmf/common.sh@477 -- # '[' -n 3021305 ']' 00:28:22.994 04:40:02 -- nvmf/common.sh@478 -- # killprocess 3021305 00:28:22.994 04:40:02 -- common/autotest_common.sh@936 -- # '[' -z 3021305 ']' 00:28:22.994 04:40:02 -- common/autotest_common.sh@940 -- # kill -0 3021305 00:28:22.994 04:40:02 -- common/autotest_common.sh@941 -- # uname 00:28:22.994 04:40:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:22.994 04:40:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3021305 00:28:22.994 04:40:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:22.994 04:40:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:22.994 04:40:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3021305' 00:28:22.994 killing process with pid 3021305 00:28:22.994 04:40:02 -- common/autotest_common.sh@955 -- # kill 3021305 00:28:22.994 04:40:02 -- common/autotest_common.sh@960 -- # wait 3021305 00:28:23.253 04:40:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:23.253 04:40:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:23.253 04:40:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:23.253 04:40:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:23.253 04:40:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:23.253 04:40:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:23.253 04:40:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:23.253 04:40:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:25.801 04:40:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:25.801 00:28:25.801 real 0m37.205s 00:28:25.801 user 2m10.268s 00:28:25.801 sys 0m6.625s 00:28:25.801 04:40:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:25.801 04:40:04 -- common/autotest_common.sh@10 -- # set +x 00:28:25.801 ************************************ 00:28:25.801 END TEST nvmf_failover 00:28:25.801 ************************************ 00:28:25.801 04:40:04 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:25.801 04:40:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:25.801 04:40:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:25.801 04:40:04 -- common/autotest_common.sh@10 -- # set +x 00:28:25.801 ************************************ 00:28:25.801 START TEST nvmf_discovery 00:28:25.801 ************************************ 00:28:25.801 04:40:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:25.801 * Looking for test storage... 00:28:25.801 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:25.801 04:40:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:25.801 04:40:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:25.801 04:40:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:25.801 04:40:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:25.801 04:40:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:25.801 04:40:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:25.801 04:40:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:25.801 04:40:04 -- scripts/common.sh@335 -- # IFS=.-: 00:28:25.801 04:40:04 -- scripts/common.sh@335 -- # read -ra ver1 00:28:25.801 04:40:04 -- scripts/common.sh@336 -- # IFS=.-: 00:28:25.801 04:40:04 -- scripts/common.sh@336 -- # read -ra ver2 00:28:25.801 04:40:04 -- scripts/common.sh@337 -- # local 'op=<' 00:28:25.801 04:40:04 -- scripts/common.sh@339 -- # ver1_l=2 00:28:25.801 04:40:04 -- scripts/common.sh@340 -- # ver2_l=1 00:28:25.801 04:40:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:25.801 04:40:04 -- scripts/common.sh@343 -- # case "$op" in 00:28:25.801 04:40:04 -- scripts/common.sh@344 -- # : 1 00:28:25.801 04:40:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:25.801 04:40:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:25.801 04:40:04 -- scripts/common.sh@364 -- # decimal 1 00:28:25.801 04:40:04 -- scripts/common.sh@352 -- # local d=1 00:28:25.801 04:40:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:25.801 04:40:04 -- scripts/common.sh@354 -- # echo 1 00:28:25.801 04:40:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:25.801 04:40:04 -- scripts/common.sh@365 -- # decimal 2 00:28:25.801 04:40:04 -- scripts/common.sh@352 -- # local d=2 00:28:25.801 04:40:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:25.801 04:40:04 -- scripts/common.sh@354 -- # echo 2 00:28:25.801 04:40:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:25.801 04:40:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:25.801 04:40:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:25.801 04:40:04 -- scripts/common.sh@367 -- # return 0 00:28:25.801 04:40:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:25.801 04:40:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:25.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:25.801 --rc genhtml_branch_coverage=1 00:28:25.801 --rc genhtml_function_coverage=1 00:28:25.801 --rc genhtml_legend=1 00:28:25.801 --rc geninfo_all_blocks=1 00:28:25.801 --rc geninfo_unexecuted_blocks=1 00:28:25.801 00:28:25.801 ' 00:28:25.801 04:40:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:25.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:25.801 --rc genhtml_branch_coverage=1 00:28:25.801 --rc genhtml_function_coverage=1 00:28:25.801 --rc genhtml_legend=1 00:28:25.801 --rc geninfo_all_blocks=1 00:28:25.801 --rc geninfo_unexecuted_blocks=1 00:28:25.801 00:28:25.801 ' 00:28:25.801 04:40:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:25.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:25.801 --rc genhtml_branch_coverage=1 00:28:25.801 --rc genhtml_function_coverage=1 00:28:25.801 --rc genhtml_legend=1 00:28:25.801 --rc geninfo_all_blocks=1 00:28:25.801 --rc geninfo_unexecuted_blocks=1 00:28:25.801 00:28:25.801 ' 00:28:25.801 04:40:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:25.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:25.801 --rc genhtml_branch_coverage=1 00:28:25.801 --rc genhtml_function_coverage=1 00:28:25.801 --rc genhtml_legend=1 00:28:25.801 --rc geninfo_all_blocks=1 00:28:25.801 --rc geninfo_unexecuted_blocks=1 00:28:25.801 00:28:25.801 ' 00:28:25.801 04:40:04 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:25.801 04:40:04 -- nvmf/common.sh@7 -- # uname -s 00:28:25.801 04:40:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:25.801 04:40:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:25.801 04:40:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:25.801 04:40:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:25.801 04:40:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:25.801 04:40:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:25.801 04:40:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:25.801 04:40:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:25.801 04:40:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:25.801 04:40:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:25.801 04:40:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:25.801 04:40:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:25.801 04:40:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:25.801 04:40:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:25.801 04:40:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:25.801 04:40:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:25.801 04:40:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:25.801 04:40:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:25.801 04:40:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:25.801 04:40:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:25.802 04:40:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:25.802 04:40:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:25.802 04:40:04 -- paths/export.sh@5 -- # export PATH 00:28:25.802 04:40:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:25.802 04:40:04 -- nvmf/common.sh@46 -- # : 0 00:28:25.802 04:40:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:25.802 04:40:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:25.802 04:40:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:25.802 04:40:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:25.802 04:40:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:25.802 04:40:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:25.802 04:40:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:25.802 04:40:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:25.802 04:40:04 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:25.802 04:40:04 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:25.802 04:40:04 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:25.802 04:40:04 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:25.802 04:40:04 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:25.802 04:40:04 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:25.802 04:40:04 -- host/discovery.sh@25 -- # nvmftestinit 00:28:25.802 04:40:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:25.802 04:40:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:25.802 04:40:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:25.802 04:40:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:25.802 04:40:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:25.802 04:40:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:25.802 04:40:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:25.802 04:40:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:25.802 04:40:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:25.802 04:40:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:25.802 04:40:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:25.802 04:40:04 -- common/autotest_common.sh@10 -- # set +x 00:28:27.710 04:40:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:27.710 04:40:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:27.710 04:40:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:27.710 04:40:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:27.710 04:40:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:27.710 04:40:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:27.710 04:40:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:27.710 04:40:06 -- nvmf/common.sh@294 -- # net_devs=() 00:28:27.710 04:40:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:27.710 04:40:06 -- nvmf/common.sh@295 -- # e810=() 00:28:27.710 04:40:06 -- nvmf/common.sh@295 -- # local -ga e810 00:28:27.710 04:40:06 -- nvmf/common.sh@296 -- # x722=() 00:28:27.710 04:40:06 -- nvmf/common.sh@296 -- # local -ga x722 00:28:27.710 04:40:06 -- nvmf/common.sh@297 -- # mlx=() 00:28:27.710 04:40:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:27.710 04:40:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:27.710 04:40:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:27.710 04:40:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:27.710 04:40:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:27.710 04:40:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:27.710 04:40:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:27.710 04:40:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:27.710 04:40:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:27.710 04:40:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:27.710 04:40:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:27.710 04:40:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:27.710 04:40:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:27.710 04:40:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:27.710 04:40:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:27.710 04:40:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:27.710 04:40:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:27.710 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:27.710 04:40:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:27.710 04:40:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:27.710 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:27.710 04:40:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:27.710 04:40:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:27.710 04:40:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:27.710 04:40:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:27.710 04:40:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:27.710 04:40:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:27.710 04:40:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:27.710 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:27.710 04:40:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:27.710 04:40:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:27.711 04:40:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:27.711 04:40:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:27.711 04:40:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:27.711 04:40:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:27.711 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:27.711 04:40:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:27.711 04:40:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:27.711 04:40:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:27.711 04:40:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:27.711 04:40:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:27.711 04:40:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:27.711 04:40:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:27.711 04:40:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:27.711 04:40:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:27.711 04:40:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:27.711 04:40:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:27.711 04:40:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:27.711 04:40:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:27.711 04:40:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:27.711 04:40:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:27.711 04:40:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:27.711 04:40:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:27.711 04:40:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:27.711 04:40:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:27.711 04:40:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:27.711 04:40:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:27.711 04:40:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:27.711 04:40:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:27.711 04:40:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:27.711 04:40:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:27.711 04:40:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:27.711 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:27.711 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.256 ms 00:28:27.711 00:28:27.711 --- 10.0.0.2 ping statistics --- 00:28:27.711 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:27.711 rtt min/avg/max/mdev = 0.256/0.256/0.256/0.000 ms 00:28:27.711 04:40:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:27.711 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:27.711 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:28:27.711 00:28:27.711 --- 10.0.0.1 ping statistics --- 00:28:27.711 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:27.711 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:28:27.711 04:40:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:27.711 04:40:06 -- nvmf/common.sh@410 -- # return 0 00:28:27.711 04:40:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:27.711 04:40:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:27.711 04:40:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:27.711 04:40:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:27.711 04:40:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:27.711 04:40:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:27.711 04:40:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:27.711 04:40:06 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:27.711 04:40:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:27.711 04:40:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:27.711 04:40:06 -- common/autotest_common.sh@10 -- # set +x 00:28:27.711 04:40:06 -- nvmf/common.sh@469 -- # nvmfpid=3027228 00:28:27.711 04:40:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:27.711 04:40:06 -- nvmf/common.sh@470 -- # waitforlisten 3027228 00:28:27.711 04:40:06 -- common/autotest_common.sh@829 -- # '[' -z 3027228 ']' 00:28:27.711 04:40:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:27.711 04:40:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:27.711 04:40:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:27.711 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:27.711 04:40:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:27.711 04:40:06 -- common/autotest_common.sh@10 -- # set +x 00:28:27.711 [2024-11-26 04:40:06.902824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:27.711 [2024-11-26 04:40:06.902897] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:27.970 EAL: No free 2048 kB hugepages reported on node 1 00:28:27.970 [2024-11-26 04:40:06.972525] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:27.970 [2024-11-26 04:40:07.064921] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:27.970 [2024-11-26 04:40:07.065078] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:27.970 [2024-11-26 04:40:07.065097] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:27.970 [2024-11-26 04:40:07.065121] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:27.970 [2024-11-26 04:40:07.065148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:28.907 04:40:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:28.907 04:40:07 -- common/autotest_common.sh@862 -- # return 0 00:28:28.907 04:40:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:28.907 04:40:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:28.907 04:40:07 -- common/autotest_common.sh@10 -- # set +x 00:28:28.907 04:40:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:28.907 04:40:07 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:28.907 04:40:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.907 04:40:07 -- common/autotest_common.sh@10 -- # set +x 00:28:28.907 [2024-11-26 04:40:07.897462] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:28.907 04:40:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.907 04:40:07 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:28:28.907 04:40:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.907 04:40:07 -- common/autotest_common.sh@10 -- # set +x 00:28:28.907 [2024-11-26 04:40:07.905697] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:28.907 04:40:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.907 04:40:07 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:28:28.907 04:40:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.907 04:40:07 -- common/autotest_common.sh@10 -- # set +x 00:28:28.907 null0 00:28:28.907 04:40:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.907 04:40:07 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:28:28.907 04:40:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.907 04:40:07 -- common/autotest_common.sh@10 -- # set +x 00:28:28.907 null1 00:28:28.907 04:40:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.907 04:40:07 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:28:28.907 04:40:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.907 04:40:07 -- common/autotest_common.sh@10 -- # set +x 00:28:28.907 04:40:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.907 04:40:07 -- host/discovery.sh@45 -- # hostpid=3027380 00:28:28.907 04:40:07 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:28:28.907 04:40:07 -- host/discovery.sh@46 -- # waitforlisten 3027380 /tmp/host.sock 00:28:28.907 04:40:07 -- common/autotest_common.sh@829 -- # '[' -z 3027380 ']' 00:28:28.907 04:40:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:28.907 04:40:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:28.907 04:40:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:28.907 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:28.907 04:40:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:28.907 04:40:07 -- common/autotest_common.sh@10 -- # set +x 00:28:28.907 [2024-11-26 04:40:07.974646] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:28.907 [2024-11-26 04:40:07.974736] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3027380 ] 00:28:28.907 EAL: No free 2048 kB hugepages reported on node 1 00:28:28.907 [2024-11-26 04:40:08.033979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:28.907 [2024-11-26 04:40:08.122779] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:28.907 [2024-11-26 04:40:08.122942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:29.845 04:40:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:29.845 04:40:08 -- common/autotest_common.sh@862 -- # return 0 00:28:29.845 04:40:08 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:29.845 04:40:08 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:28:29.845 04:40:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:29.845 04:40:08 -- common/autotest_common.sh@10 -- # set +x 00:28:29.845 04:40:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:29.845 04:40:08 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:28:29.845 04:40:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:29.845 04:40:08 -- common/autotest_common.sh@10 -- # set +x 00:28:29.845 04:40:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:29.845 04:40:08 -- host/discovery.sh@72 -- # notify_id=0 00:28:29.845 04:40:08 -- host/discovery.sh@78 -- # get_subsystem_names 00:28:29.845 04:40:08 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:29.845 04:40:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:29.845 04:40:08 -- common/autotest_common.sh@10 -- # set +x 00:28:29.845 04:40:08 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:29.845 04:40:08 -- host/discovery.sh@59 -- # sort 00:28:29.845 04:40:08 -- host/discovery.sh@59 -- # xargs 00:28:29.845 04:40:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:29.845 04:40:09 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:28:29.845 04:40:09 -- host/discovery.sh@79 -- # get_bdev_list 00:28:29.845 04:40:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:29.845 04:40:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:29.845 04:40:09 -- common/autotest_common.sh@10 -- # set +x 00:28:29.845 04:40:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:29.845 04:40:09 -- host/discovery.sh@55 -- # sort 00:28:29.845 04:40:09 -- host/discovery.sh@55 -- # xargs 00:28:29.845 04:40:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:29.845 04:40:09 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:28:29.845 04:40:09 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:28:29.845 04:40:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:29.845 04:40:09 -- common/autotest_common.sh@10 -- # set +x 00:28:30.104 04:40:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.104 04:40:09 -- host/discovery.sh@82 -- # get_subsystem_names 00:28:30.104 04:40:09 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:30.104 04:40:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.104 04:40:09 -- common/autotest_common.sh@10 -- # set +x 00:28:30.104 04:40:09 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:30.104 04:40:09 -- host/discovery.sh@59 -- # sort 00:28:30.104 04:40:09 -- host/discovery.sh@59 -- # xargs 00:28:30.104 04:40:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.104 04:40:09 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:28:30.104 04:40:09 -- host/discovery.sh@83 -- # get_bdev_list 00:28:30.104 04:40:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:30.104 04:40:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.104 04:40:09 -- common/autotest_common.sh@10 -- # set +x 00:28:30.104 04:40:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:30.104 04:40:09 -- host/discovery.sh@55 -- # sort 00:28:30.104 04:40:09 -- host/discovery.sh@55 -- # xargs 00:28:30.104 04:40:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.104 04:40:09 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:28:30.104 04:40:09 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:28:30.104 04:40:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.104 04:40:09 -- common/autotest_common.sh@10 -- # set +x 00:28:30.104 04:40:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.104 04:40:09 -- host/discovery.sh@86 -- # get_subsystem_names 00:28:30.104 04:40:09 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:30.104 04:40:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.104 04:40:09 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:30.104 04:40:09 -- common/autotest_common.sh@10 -- # set +x 00:28:30.104 04:40:09 -- host/discovery.sh@59 -- # sort 00:28:30.104 04:40:09 -- host/discovery.sh@59 -- # xargs 00:28:30.104 04:40:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.104 04:40:09 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:28:30.104 04:40:09 -- host/discovery.sh@87 -- # get_bdev_list 00:28:30.104 04:40:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:30.104 04:40:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.104 04:40:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:30.104 04:40:09 -- common/autotest_common.sh@10 -- # set +x 00:28:30.104 04:40:09 -- host/discovery.sh@55 -- # sort 00:28:30.105 04:40:09 -- host/discovery.sh@55 -- # xargs 00:28:30.105 04:40:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.105 04:40:09 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:28:30.105 04:40:09 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:30.105 04:40:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.105 04:40:09 -- common/autotest_common.sh@10 -- # set +x 00:28:30.105 [2024-11-26 04:40:09.249382] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:30.105 04:40:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.105 04:40:09 -- host/discovery.sh@92 -- # get_subsystem_names 00:28:30.105 04:40:09 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:30.105 04:40:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.105 04:40:09 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:30.105 04:40:09 -- common/autotest_common.sh@10 -- # set +x 00:28:30.105 04:40:09 -- host/discovery.sh@59 -- # sort 00:28:30.105 04:40:09 -- host/discovery.sh@59 -- # xargs 00:28:30.105 04:40:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.105 04:40:09 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:28:30.105 04:40:09 -- host/discovery.sh@93 -- # get_bdev_list 00:28:30.105 04:40:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:30.105 04:40:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:30.105 04:40:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.105 04:40:09 -- host/discovery.sh@55 -- # sort 00:28:30.105 04:40:09 -- common/autotest_common.sh@10 -- # set +x 00:28:30.105 04:40:09 -- host/discovery.sh@55 -- # xargs 00:28:30.105 04:40:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.363 04:40:09 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:28:30.363 04:40:09 -- host/discovery.sh@94 -- # get_notification_count 00:28:30.363 04:40:09 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:30.363 04:40:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.363 04:40:09 -- host/discovery.sh@74 -- # jq '. | length' 00:28:30.363 04:40:09 -- common/autotest_common.sh@10 -- # set +x 00:28:30.363 04:40:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.363 04:40:09 -- host/discovery.sh@74 -- # notification_count=0 00:28:30.363 04:40:09 -- host/discovery.sh@75 -- # notify_id=0 00:28:30.363 04:40:09 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:28:30.363 04:40:09 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:28:30.363 04:40:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.363 04:40:09 -- common/autotest_common.sh@10 -- # set +x 00:28:30.363 04:40:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.363 04:40:09 -- host/discovery.sh@100 -- # sleep 1 00:28:30.935 [2024-11-26 04:40:09.996711] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:30.935 [2024-11-26 04:40:09.996759] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:30.935 [2024-11-26 04:40:09.996782] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:30.935 [2024-11-26 04:40:10.084073] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:31.195 [2024-11-26 04:40:10.189060] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:31.195 [2024-11-26 04:40:10.189090] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:31.195 04:40:10 -- host/discovery.sh@101 -- # get_subsystem_names 00:28:31.195 04:40:10 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:31.195 04:40:10 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:31.195 04:40:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:31.195 04:40:10 -- common/autotest_common.sh@10 -- # set +x 00:28:31.195 04:40:10 -- host/discovery.sh@59 -- # sort 00:28:31.195 04:40:10 -- host/discovery.sh@59 -- # xargs 00:28:31.195 04:40:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:31.195 04:40:10 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:31.454 04:40:10 -- host/discovery.sh@102 -- # get_bdev_list 00:28:31.454 04:40:10 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:31.454 04:40:10 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:31.454 04:40:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:31.454 04:40:10 -- common/autotest_common.sh@10 -- # set +x 00:28:31.454 04:40:10 -- host/discovery.sh@55 -- # sort 00:28:31.454 04:40:10 -- host/discovery.sh@55 -- # xargs 00:28:31.454 04:40:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:31.454 04:40:10 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:28:31.454 04:40:10 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:28:31.454 04:40:10 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:31.454 04:40:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:31.454 04:40:10 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:31.454 04:40:10 -- common/autotest_common.sh@10 -- # set +x 00:28:31.454 04:40:10 -- host/discovery.sh@63 -- # sort -n 00:28:31.454 04:40:10 -- host/discovery.sh@63 -- # xargs 00:28:31.454 04:40:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:31.454 04:40:10 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:28:31.454 04:40:10 -- host/discovery.sh@104 -- # get_notification_count 00:28:31.454 04:40:10 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:31.454 04:40:10 -- host/discovery.sh@74 -- # jq '. | length' 00:28:31.454 04:40:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:31.454 04:40:10 -- common/autotest_common.sh@10 -- # set +x 00:28:31.454 04:40:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:31.454 04:40:10 -- host/discovery.sh@74 -- # notification_count=1 00:28:31.454 04:40:10 -- host/discovery.sh@75 -- # notify_id=1 00:28:31.454 04:40:10 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:28:31.454 04:40:10 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:28:31.454 04:40:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:31.454 04:40:10 -- common/autotest_common.sh@10 -- # set +x 00:28:31.454 04:40:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:31.454 04:40:10 -- host/discovery.sh@109 -- # sleep 1 00:28:32.388 04:40:11 -- host/discovery.sh@110 -- # get_bdev_list 00:28:32.389 04:40:11 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:32.389 04:40:11 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:32.389 04:40:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:32.389 04:40:11 -- common/autotest_common.sh@10 -- # set +x 00:28:32.389 04:40:11 -- host/discovery.sh@55 -- # sort 00:28:32.389 04:40:11 -- host/discovery.sh@55 -- # xargs 00:28:32.389 04:40:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:32.389 04:40:11 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:32.389 04:40:11 -- host/discovery.sh@111 -- # get_notification_count 00:28:32.389 04:40:11 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:28:32.389 04:40:11 -- host/discovery.sh@74 -- # jq '. | length' 00:28:32.389 04:40:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:32.389 04:40:11 -- common/autotest_common.sh@10 -- # set +x 00:28:32.389 04:40:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:32.647 04:40:11 -- host/discovery.sh@74 -- # notification_count=1 00:28:32.647 04:40:11 -- host/discovery.sh@75 -- # notify_id=2 00:28:32.647 04:40:11 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:28:32.647 04:40:11 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:28:32.647 04:40:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:32.647 04:40:11 -- common/autotest_common.sh@10 -- # set +x 00:28:32.647 [2024-11-26 04:40:11.628475] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:32.648 [2024-11-26 04:40:11.629588] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:32.648 [2024-11-26 04:40:11.629628] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:32.648 04:40:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:32.648 04:40:11 -- host/discovery.sh@117 -- # sleep 1 00:28:32.648 [2024-11-26 04:40:11.758073] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:28:32.648 [2024-11-26 04:40:11.862775] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:32.648 [2024-11-26 04:40:11.862797] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:32.648 [2024-11-26 04:40:11.862805] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:33.582 04:40:12 -- host/discovery.sh@118 -- # get_subsystem_names 00:28:33.582 04:40:12 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:33.582 04:40:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.582 04:40:12 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:33.582 04:40:12 -- common/autotest_common.sh@10 -- # set +x 00:28:33.582 04:40:12 -- host/discovery.sh@59 -- # sort 00:28:33.582 04:40:12 -- host/discovery.sh@59 -- # xargs 00:28:33.582 04:40:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.582 04:40:12 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:33.582 04:40:12 -- host/discovery.sh@119 -- # get_bdev_list 00:28:33.582 04:40:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:33.582 04:40:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:33.582 04:40:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.582 04:40:12 -- common/autotest_common.sh@10 -- # set +x 00:28:33.582 04:40:12 -- host/discovery.sh@55 -- # sort 00:28:33.582 04:40:12 -- host/discovery.sh@55 -- # xargs 00:28:33.582 04:40:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.582 04:40:12 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:33.582 04:40:12 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:28:33.582 04:40:12 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:33.582 04:40:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.582 04:40:12 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:33.582 04:40:12 -- common/autotest_common.sh@10 -- # set +x 00:28:33.582 04:40:12 -- host/discovery.sh@63 -- # sort -n 00:28:33.582 04:40:12 -- host/discovery.sh@63 -- # xargs 00:28:33.582 04:40:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.582 04:40:12 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:28:33.582 04:40:12 -- host/discovery.sh@121 -- # get_notification_count 00:28:33.582 04:40:12 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:33.582 04:40:12 -- host/discovery.sh@74 -- # jq '. | length' 00:28:33.582 04:40:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.582 04:40:12 -- common/autotest_common.sh@10 -- # set +x 00:28:33.582 04:40:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.582 04:40:12 -- host/discovery.sh@74 -- # notification_count=0 00:28:33.583 04:40:12 -- host/discovery.sh@75 -- # notify_id=2 00:28:33.583 04:40:12 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:28:33.583 04:40:12 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:33.583 04:40:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.583 04:40:12 -- common/autotest_common.sh@10 -- # set +x 00:28:33.583 [2024-11-26 04:40:12.792907] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:33.583 [2024-11-26 04:40:12.792937] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:33.583 [2024-11-26 04:40:12.793632] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.583 [2024-11-26 04:40:12.793663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.583 [2024-11-26 04:40:12.793698] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.583 [2024-11-26 04:40:12.793715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.583 [2024-11-26 04:40:12.793757] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.583 [2024-11-26 04:40:12.793770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.583 [2024-11-26 04:40:12.793785] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.583 [2024-11-26 04:40:12.793797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.583 [2024-11-26 04:40:12.793810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1afdb80 is same with the state(5) to be set 00:28:33.583 04:40:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.583 04:40:12 -- host/discovery.sh@127 -- # sleep 1 00:28:33.583 [2024-11-26 04:40:12.803633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1afdb80 (9): Bad file descriptor 00:28:33.857 [2024-11-26 04:40:12.813692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:33.857 [2024-11-26 04:40:12.813874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.857 [2024-11-26 04:40:12.814016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.857 [2024-11-26 04:40:12.814051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1afdb80 with addr=10.0.0.2, port=4420 00:28:33.857 [2024-11-26 04:40:12.814069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1afdb80 is same with the state(5) to be set 00:28:33.857 [2024-11-26 04:40:12.814092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1afdb80 (9): Bad file descriptor 00:28:33.857 [2024-11-26 04:40:12.814126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:33.857 [2024-11-26 04:40:12.814144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:33.857 [2024-11-26 04:40:12.814158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:33.857 [2024-11-26 04:40:12.814178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:33.857 [2024-11-26 04:40:12.823785] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:33.857 [2024-11-26 04:40:12.824045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.857 [2024-11-26 04:40:12.824205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.857 [2024-11-26 04:40:12.824234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1afdb80 with addr=10.0.0.2, port=4420 00:28:33.857 [2024-11-26 04:40:12.824252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1afdb80 is same with the state(5) to be set 00:28:33.857 [2024-11-26 04:40:12.824276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1afdb80 (9): Bad file descriptor 00:28:33.857 [2024-11-26 04:40:12.824327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:33.857 [2024-11-26 04:40:12.824349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:33.857 [2024-11-26 04:40:12.824364] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:33.857 [2024-11-26 04:40:12.824385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:33.857 [2024-11-26 04:40:12.833854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:33.857 [2024-11-26 04:40:12.834118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.857 [2024-11-26 04:40:12.834263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.857 [2024-11-26 04:40:12.834292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1afdb80 with addr=10.0.0.2, port=4420 00:28:33.857 [2024-11-26 04:40:12.834309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1afdb80 is same with the state(5) to be set 00:28:33.857 [2024-11-26 04:40:12.834333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1afdb80 (9): Bad file descriptor 00:28:33.857 [2024-11-26 04:40:12.834372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:33.857 [2024-11-26 04:40:12.834393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:33.857 [2024-11-26 04:40:12.834408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:33.857 [2024-11-26 04:40:12.834429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:33.857 [2024-11-26 04:40:12.843923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:33.857 [2024-11-26 04:40:12.844095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.857 [2024-11-26 04:40:12.844265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.857 [2024-11-26 04:40:12.844292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1afdb80 with addr=10.0.0.2, port=4420 00:28:33.857 [2024-11-26 04:40:12.844313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1afdb80 is same with the state(5) to be set 00:28:33.857 [2024-11-26 04:40:12.844337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1afdb80 (9): Bad file descriptor 00:28:33.857 [2024-11-26 04:40:12.844369] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:33.857 [2024-11-26 04:40:12.844387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:33.857 [2024-11-26 04:40:12.844401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:33.857 [2024-11-26 04:40:12.844437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:33.857 [2024-11-26 04:40:12.853994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:33.857 [2024-11-26 04:40:12.854198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.857 [2024-11-26 04:40:12.854313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.857 [2024-11-26 04:40:12.854342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1afdb80 with addr=10.0.0.2, port=4420 00:28:33.857 [2024-11-26 04:40:12.854360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1afdb80 is same with the state(5) to be set 00:28:33.857 [2024-11-26 04:40:12.854385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1afdb80 (9): Bad file descriptor 00:28:33.857 [2024-11-26 04:40:12.854408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:33.857 [2024-11-26 04:40:12.854423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:33.857 [2024-11-26 04:40:12.854438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:33.857 [2024-11-26 04:40:12.854458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:33.857 [2024-11-26 04:40:12.864066] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:33.857 [2024-11-26 04:40:12.864268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.857 [2024-11-26 04:40:12.864426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.857 [2024-11-26 04:40:12.864453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1afdb80 with addr=10.0.0.2, port=4420 00:28:33.857 [2024-11-26 04:40:12.864469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1afdb80 is same with the state(5) to be set 00:28:33.857 [2024-11-26 04:40:12.864491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1afdb80 (9): Bad file descriptor 00:28:33.857 [2024-11-26 04:40:12.864523] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:33.858 [2024-11-26 04:40:12.864555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:33.858 [2024-11-26 04:40:12.864569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:33.858 [2024-11-26 04:40:12.864617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:33.858 [2024-11-26 04:40:12.874142] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:33.858 [2024-11-26 04:40:12.874309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.858 [2024-11-26 04:40:12.874463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:33.858 [2024-11-26 04:40:12.874488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1afdb80 with addr=10.0.0.2, port=4420 00:28:33.858 [2024-11-26 04:40:12.874504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1afdb80 is same with the state(5) to be set 00:28:33.858 [2024-11-26 04:40:12.874530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1afdb80 (9): Bad file descriptor 00:28:33.858 [2024-11-26 04:40:12.874551] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:33.858 [2024-11-26 04:40:12.874565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:33.858 [2024-11-26 04:40:12.874578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:33.858 [2024-11-26 04:40:12.874595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:33.858 [2024-11-26 04:40:12.879643] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:28:33.858 [2024-11-26 04:40:12.879681] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:34.875 04:40:13 -- host/discovery.sh@128 -- # get_subsystem_names 00:28:34.875 04:40:13 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:34.875 04:40:13 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:34.875 04:40:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.875 04:40:13 -- common/autotest_common.sh@10 -- # set +x 00:28:34.875 04:40:13 -- host/discovery.sh@59 -- # sort 00:28:34.875 04:40:13 -- host/discovery.sh@59 -- # xargs 00:28:34.875 04:40:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.875 04:40:13 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:34.875 04:40:13 -- host/discovery.sh@129 -- # get_bdev_list 00:28:34.875 04:40:13 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:34.875 04:40:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.875 04:40:13 -- common/autotest_common.sh@10 -- # set +x 00:28:34.875 04:40:13 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:34.875 04:40:13 -- host/discovery.sh@55 -- # sort 00:28:34.875 04:40:13 -- host/discovery.sh@55 -- # xargs 00:28:34.875 04:40:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.875 04:40:13 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:34.875 04:40:13 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:28:34.875 04:40:13 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:34.875 04:40:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.875 04:40:13 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:34.875 04:40:13 -- common/autotest_common.sh@10 -- # set +x 00:28:34.875 04:40:13 -- host/discovery.sh@63 -- # sort -n 00:28:34.875 04:40:13 -- host/discovery.sh@63 -- # xargs 00:28:34.875 04:40:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.875 04:40:13 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:28:34.875 04:40:13 -- host/discovery.sh@131 -- # get_notification_count 00:28:34.875 04:40:13 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:34.875 04:40:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.875 04:40:13 -- host/discovery.sh@74 -- # jq '. | length' 00:28:34.875 04:40:13 -- common/autotest_common.sh@10 -- # set +x 00:28:34.875 04:40:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.875 04:40:13 -- host/discovery.sh@74 -- # notification_count=0 00:28:34.875 04:40:13 -- host/discovery.sh@75 -- # notify_id=2 00:28:34.875 04:40:13 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:28:34.875 04:40:13 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:28:34.875 04:40:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.875 04:40:13 -- common/autotest_common.sh@10 -- # set +x 00:28:34.875 04:40:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.875 04:40:13 -- host/discovery.sh@135 -- # sleep 1 00:28:35.810 04:40:14 -- host/discovery.sh@136 -- # get_subsystem_names 00:28:35.810 04:40:14 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:35.810 04:40:14 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:35.810 04:40:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.810 04:40:14 -- host/discovery.sh@59 -- # sort 00:28:35.810 04:40:14 -- common/autotest_common.sh@10 -- # set +x 00:28:35.810 04:40:14 -- host/discovery.sh@59 -- # xargs 00:28:35.810 04:40:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:35.810 04:40:15 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:28:35.810 04:40:15 -- host/discovery.sh@137 -- # get_bdev_list 00:28:35.810 04:40:15 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:35.810 04:40:15 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:35.810 04:40:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.810 04:40:15 -- common/autotest_common.sh@10 -- # set +x 00:28:35.810 04:40:15 -- host/discovery.sh@55 -- # sort 00:28:35.810 04:40:15 -- host/discovery.sh@55 -- # xargs 00:28:35.810 04:40:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.069 04:40:15 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:28:36.069 04:40:15 -- host/discovery.sh@138 -- # get_notification_count 00:28:36.069 04:40:15 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:36.069 04:40:15 -- host/discovery.sh@74 -- # jq '. | length' 00:28:36.069 04:40:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.069 04:40:15 -- common/autotest_common.sh@10 -- # set +x 00:28:36.069 04:40:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.069 04:40:15 -- host/discovery.sh@74 -- # notification_count=2 00:28:36.069 04:40:15 -- host/discovery.sh@75 -- # notify_id=4 00:28:36.069 04:40:15 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:28:36.069 04:40:15 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:36.069 04:40:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.069 04:40:15 -- common/autotest_common.sh@10 -- # set +x 00:28:37.008 [2024-11-26 04:40:16.152824] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:37.008 [2024-11-26 04:40:16.152859] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:37.008 [2024-11-26 04:40:16.152881] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:37.268 [2024-11-26 04:40:16.240204] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:28:37.268 [2024-11-26 04:40:16.348445] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:37.268 [2024-11-26 04:40:16.348492] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:37.268 04:40:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.268 04:40:16 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.268 04:40:16 -- common/autotest_common.sh@650 -- # local es=0 00:28:37.268 04:40:16 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.268 04:40:16 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:37.268 04:40:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:37.268 04:40:16 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:37.268 04:40:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:37.268 04:40:16 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.268 04:40:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.268 04:40:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.268 request: 00:28:37.268 { 00:28:37.268 "name": "nvme", 00:28:37.268 "trtype": "tcp", 00:28:37.268 "traddr": "10.0.0.2", 00:28:37.268 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:37.268 "adrfam": "ipv4", 00:28:37.268 "trsvcid": "8009", 00:28:37.268 "wait_for_attach": true, 00:28:37.268 "method": "bdev_nvme_start_discovery", 00:28:37.268 "req_id": 1 00:28:37.268 } 00:28:37.268 Got JSON-RPC error response 00:28:37.268 response: 00:28:37.268 { 00:28:37.268 "code": -17, 00:28:37.268 "message": "File exists" 00:28:37.268 } 00:28:37.268 04:40:16 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:37.268 04:40:16 -- common/autotest_common.sh@653 -- # es=1 00:28:37.268 04:40:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:37.268 04:40:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:37.268 04:40:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:37.268 04:40:16 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:28:37.268 04:40:16 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:37.268 04:40:16 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:37.268 04:40:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.268 04:40:16 -- host/discovery.sh@67 -- # sort 00:28:37.268 04:40:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.268 04:40:16 -- host/discovery.sh@67 -- # xargs 00:28:37.268 04:40:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.268 04:40:16 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:28:37.268 04:40:16 -- host/discovery.sh@147 -- # get_bdev_list 00:28:37.268 04:40:16 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:37.268 04:40:16 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:37.268 04:40:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.268 04:40:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.268 04:40:16 -- host/discovery.sh@55 -- # sort 00:28:37.268 04:40:16 -- host/discovery.sh@55 -- # xargs 00:28:37.268 04:40:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.268 04:40:16 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:37.268 04:40:16 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.268 04:40:16 -- common/autotest_common.sh@650 -- # local es=0 00:28:37.268 04:40:16 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.268 04:40:16 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:37.268 04:40:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:37.268 04:40:16 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:37.268 04:40:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:37.268 04:40:16 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.268 04:40:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.268 04:40:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.268 request: 00:28:37.268 { 00:28:37.268 "name": "nvme_second", 00:28:37.268 "trtype": "tcp", 00:28:37.268 "traddr": "10.0.0.2", 00:28:37.268 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:37.268 "adrfam": "ipv4", 00:28:37.268 "trsvcid": "8009", 00:28:37.268 "wait_for_attach": true, 00:28:37.268 "method": "bdev_nvme_start_discovery", 00:28:37.268 "req_id": 1 00:28:37.268 } 00:28:37.268 Got JSON-RPC error response 00:28:37.268 response: 00:28:37.268 { 00:28:37.268 "code": -17, 00:28:37.268 "message": "File exists" 00:28:37.268 } 00:28:37.268 04:40:16 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:37.268 04:40:16 -- common/autotest_common.sh@653 -- # es=1 00:28:37.268 04:40:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:37.268 04:40:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:37.268 04:40:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:37.268 04:40:16 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:28:37.268 04:40:16 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:37.268 04:40:16 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:37.268 04:40:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.268 04:40:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.268 04:40:16 -- host/discovery.sh@67 -- # sort 00:28:37.268 04:40:16 -- host/discovery.sh@67 -- # xargs 00:28:37.268 04:40:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.529 04:40:16 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:28:37.529 04:40:16 -- host/discovery.sh@153 -- # get_bdev_list 00:28:37.529 04:40:16 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:37.529 04:40:16 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:37.529 04:40:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.529 04:40:16 -- common/autotest_common.sh@10 -- # set +x 00:28:37.529 04:40:16 -- host/discovery.sh@55 -- # sort 00:28:37.529 04:40:16 -- host/discovery.sh@55 -- # xargs 00:28:37.529 04:40:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.529 04:40:16 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:37.529 04:40:16 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:37.529 04:40:16 -- common/autotest_common.sh@650 -- # local es=0 00:28:37.529 04:40:16 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:37.529 04:40:16 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:37.529 04:40:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:37.529 04:40:16 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:37.529 04:40:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:37.529 04:40:16 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:37.529 04:40:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.529 04:40:16 -- common/autotest_common.sh@10 -- # set +x 00:28:38.468 [2024-11-26 04:40:17.547927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.468 [2024-11-26 04:40:17.548122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.468 [2024-11-26 04:40:17.548154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b353c0 with addr=10.0.0.2, port=8010 00:28:38.468 [2024-11-26 04:40:17.548185] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:38.468 [2024-11-26 04:40:17.548201] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:38.468 [2024-11-26 04:40:17.548217] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:39.402 [2024-11-26 04:40:18.550255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:39.402 [2024-11-26 04:40:18.550419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:39.402 [2024-11-26 04:40:18.550449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b353c0 with addr=10.0.0.2, port=8010 00:28:39.402 [2024-11-26 04:40:18.550470] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:39.402 [2024-11-26 04:40:18.550485] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:39.402 [2024-11-26 04:40:18.550499] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:40.340 [2024-11-26 04:40:19.552525] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:28:40.340 request: 00:28:40.340 { 00:28:40.340 "name": "nvme_second", 00:28:40.340 "trtype": "tcp", 00:28:40.340 "traddr": "10.0.0.2", 00:28:40.340 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:40.340 "adrfam": "ipv4", 00:28:40.340 "trsvcid": "8010", 00:28:40.341 "attach_timeout_ms": 3000, 00:28:40.341 "method": "bdev_nvme_start_discovery", 00:28:40.341 "req_id": 1 00:28:40.341 } 00:28:40.341 Got JSON-RPC error response 00:28:40.341 response: 00:28:40.341 { 00:28:40.341 "code": -110, 00:28:40.341 "message": "Connection timed out" 00:28:40.341 } 00:28:40.341 04:40:19 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:40.341 04:40:19 -- common/autotest_common.sh@653 -- # es=1 00:28:40.341 04:40:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:40.341 04:40:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:40.341 04:40:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:40.341 04:40:19 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:28:40.341 04:40:19 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:40.341 04:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.341 04:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:40.341 04:40:19 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:40.341 04:40:19 -- host/discovery.sh@67 -- # sort 00:28:40.341 04:40:19 -- host/discovery.sh@67 -- # xargs 00:28:40.599 04:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.599 04:40:19 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:28:40.599 04:40:19 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:28:40.599 04:40:19 -- host/discovery.sh@162 -- # kill 3027380 00:28:40.599 04:40:19 -- host/discovery.sh@163 -- # nvmftestfini 00:28:40.599 04:40:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:40.599 04:40:19 -- nvmf/common.sh@116 -- # sync 00:28:40.599 04:40:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:40.599 04:40:19 -- nvmf/common.sh@119 -- # set +e 00:28:40.599 04:40:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:40.599 04:40:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:40.599 rmmod nvme_tcp 00:28:40.599 rmmod nvme_fabrics 00:28:40.599 rmmod nvme_keyring 00:28:40.599 04:40:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:40.599 04:40:19 -- nvmf/common.sh@123 -- # set -e 00:28:40.599 04:40:19 -- nvmf/common.sh@124 -- # return 0 00:28:40.599 04:40:19 -- nvmf/common.sh@477 -- # '[' -n 3027228 ']' 00:28:40.599 04:40:19 -- nvmf/common.sh@478 -- # killprocess 3027228 00:28:40.599 04:40:19 -- common/autotest_common.sh@936 -- # '[' -z 3027228 ']' 00:28:40.599 04:40:19 -- common/autotest_common.sh@940 -- # kill -0 3027228 00:28:40.599 04:40:19 -- common/autotest_common.sh@941 -- # uname 00:28:40.599 04:40:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:40.599 04:40:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3027228 00:28:40.599 04:40:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:40.599 04:40:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:40.599 04:40:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3027228' 00:28:40.599 killing process with pid 3027228 00:28:40.599 04:40:19 -- common/autotest_common.sh@955 -- # kill 3027228 00:28:40.599 04:40:19 -- common/autotest_common.sh@960 -- # wait 3027228 00:28:40.857 04:40:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:40.857 04:40:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:40.857 04:40:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:40.857 04:40:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:40.857 04:40:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:40.857 04:40:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:40.857 04:40:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:40.857 04:40:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:42.762 04:40:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:42.762 00:28:42.762 real 0m17.422s 00:28:42.762 user 0m26.866s 00:28:42.762 sys 0m2.970s 00:28:42.762 04:40:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:42.762 04:40:21 -- common/autotest_common.sh@10 -- # set +x 00:28:42.762 ************************************ 00:28:42.762 END TEST nvmf_discovery 00:28:42.762 ************************************ 00:28:43.020 04:40:21 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:43.021 04:40:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:43.021 04:40:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:43.021 04:40:21 -- common/autotest_common.sh@10 -- # set +x 00:28:43.021 ************************************ 00:28:43.021 START TEST nvmf_discovery_remove_ifc 00:28:43.021 ************************************ 00:28:43.021 04:40:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:43.021 * Looking for test storage... 00:28:43.021 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:43.021 04:40:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:43.021 04:40:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:43.021 04:40:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:43.021 04:40:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:43.021 04:40:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:43.021 04:40:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:43.021 04:40:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:43.021 04:40:22 -- scripts/common.sh@335 -- # IFS=.-: 00:28:43.021 04:40:22 -- scripts/common.sh@335 -- # read -ra ver1 00:28:43.021 04:40:22 -- scripts/common.sh@336 -- # IFS=.-: 00:28:43.021 04:40:22 -- scripts/common.sh@336 -- # read -ra ver2 00:28:43.021 04:40:22 -- scripts/common.sh@337 -- # local 'op=<' 00:28:43.021 04:40:22 -- scripts/common.sh@339 -- # ver1_l=2 00:28:43.021 04:40:22 -- scripts/common.sh@340 -- # ver2_l=1 00:28:43.021 04:40:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:43.021 04:40:22 -- scripts/common.sh@343 -- # case "$op" in 00:28:43.021 04:40:22 -- scripts/common.sh@344 -- # : 1 00:28:43.021 04:40:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:43.021 04:40:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:43.021 04:40:22 -- scripts/common.sh@364 -- # decimal 1 00:28:43.021 04:40:22 -- scripts/common.sh@352 -- # local d=1 00:28:43.021 04:40:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:43.021 04:40:22 -- scripts/common.sh@354 -- # echo 1 00:28:43.021 04:40:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:43.021 04:40:22 -- scripts/common.sh@365 -- # decimal 2 00:28:43.021 04:40:22 -- scripts/common.sh@352 -- # local d=2 00:28:43.021 04:40:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:43.021 04:40:22 -- scripts/common.sh@354 -- # echo 2 00:28:43.021 04:40:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:43.021 04:40:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:43.021 04:40:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:43.021 04:40:22 -- scripts/common.sh@367 -- # return 0 00:28:43.021 04:40:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:43.021 04:40:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:43.021 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:43.021 --rc genhtml_branch_coverage=1 00:28:43.021 --rc genhtml_function_coverage=1 00:28:43.021 --rc genhtml_legend=1 00:28:43.021 --rc geninfo_all_blocks=1 00:28:43.021 --rc geninfo_unexecuted_blocks=1 00:28:43.021 00:28:43.021 ' 00:28:43.021 04:40:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:43.021 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:43.021 --rc genhtml_branch_coverage=1 00:28:43.021 --rc genhtml_function_coverage=1 00:28:43.021 --rc genhtml_legend=1 00:28:43.021 --rc geninfo_all_blocks=1 00:28:43.021 --rc geninfo_unexecuted_blocks=1 00:28:43.021 00:28:43.021 ' 00:28:43.021 04:40:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:43.021 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:43.021 --rc genhtml_branch_coverage=1 00:28:43.021 --rc genhtml_function_coverage=1 00:28:43.021 --rc genhtml_legend=1 00:28:43.021 --rc geninfo_all_blocks=1 00:28:43.021 --rc geninfo_unexecuted_blocks=1 00:28:43.021 00:28:43.021 ' 00:28:43.021 04:40:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:43.021 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:43.021 --rc genhtml_branch_coverage=1 00:28:43.021 --rc genhtml_function_coverage=1 00:28:43.021 --rc genhtml_legend=1 00:28:43.021 --rc geninfo_all_blocks=1 00:28:43.021 --rc geninfo_unexecuted_blocks=1 00:28:43.021 00:28:43.021 ' 00:28:43.021 04:40:22 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:43.021 04:40:22 -- nvmf/common.sh@7 -- # uname -s 00:28:43.021 04:40:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:43.021 04:40:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:43.021 04:40:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:43.021 04:40:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:43.021 04:40:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:43.021 04:40:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:43.021 04:40:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:43.021 04:40:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:43.021 04:40:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:43.021 04:40:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:43.021 04:40:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:43.021 04:40:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:43.021 04:40:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:43.021 04:40:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:43.021 04:40:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:43.021 04:40:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:43.021 04:40:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:43.021 04:40:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:43.021 04:40:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:43.021 04:40:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:43.021 04:40:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:43.021 04:40:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:43.021 04:40:22 -- paths/export.sh@5 -- # export PATH 00:28:43.021 04:40:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:43.021 04:40:22 -- nvmf/common.sh@46 -- # : 0 00:28:43.021 04:40:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:43.021 04:40:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:43.021 04:40:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:43.021 04:40:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:43.021 04:40:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:43.021 04:40:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:43.021 04:40:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:43.021 04:40:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:43.021 04:40:22 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:28:43.021 04:40:22 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:28:43.022 04:40:22 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:28:43.022 04:40:22 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:28:43.022 04:40:22 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:28:43.022 04:40:22 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:28:43.022 04:40:22 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:28:43.022 04:40:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:43.022 04:40:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:43.022 04:40:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:43.022 04:40:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:43.022 04:40:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:43.022 04:40:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:43.022 04:40:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:43.022 04:40:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:43.022 04:40:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:43.022 04:40:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:43.022 04:40:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:43.022 04:40:22 -- common/autotest_common.sh@10 -- # set +x 00:28:44.931 04:40:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:44.931 04:40:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:44.931 04:40:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:44.931 04:40:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:44.931 04:40:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:44.931 04:40:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:44.931 04:40:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:44.931 04:40:24 -- nvmf/common.sh@294 -- # net_devs=() 00:28:44.931 04:40:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:44.931 04:40:24 -- nvmf/common.sh@295 -- # e810=() 00:28:44.931 04:40:24 -- nvmf/common.sh@295 -- # local -ga e810 00:28:44.931 04:40:24 -- nvmf/common.sh@296 -- # x722=() 00:28:44.931 04:40:24 -- nvmf/common.sh@296 -- # local -ga x722 00:28:44.931 04:40:24 -- nvmf/common.sh@297 -- # mlx=() 00:28:44.931 04:40:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:44.931 04:40:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:44.931 04:40:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:44.931 04:40:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:44.931 04:40:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:44.931 04:40:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:44.931 04:40:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:44.931 04:40:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:44.931 04:40:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:44.931 04:40:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:44.931 04:40:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:44.931 04:40:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:44.931 04:40:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:44.931 04:40:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:44.931 04:40:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:44.931 04:40:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:44.931 04:40:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:44.931 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:44.931 04:40:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:44.931 04:40:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:44.931 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:44.931 04:40:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:44.931 04:40:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:44.931 04:40:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:44.931 04:40:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:44.931 04:40:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:44.931 04:40:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:44.932 04:40:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:44.932 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:44.932 04:40:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:44.932 04:40:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:44.932 04:40:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:44.932 04:40:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:44.932 04:40:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:44.932 04:40:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:44.932 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:44.932 04:40:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:44.932 04:40:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:44.932 04:40:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:44.932 04:40:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:44.932 04:40:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:44.932 04:40:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:44.932 04:40:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:44.932 04:40:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:44.932 04:40:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:44.932 04:40:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:44.932 04:40:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:44.932 04:40:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:44.932 04:40:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:44.932 04:40:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:44.932 04:40:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:44.932 04:40:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:44.932 04:40:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:44.932 04:40:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:44.932 04:40:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:45.192 04:40:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:45.192 04:40:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:45.192 04:40:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:45.192 04:40:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:45.192 04:40:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:45.192 04:40:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:45.192 04:40:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:45.192 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:45.192 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:28:45.192 00:28:45.192 --- 10.0.0.2 ping statistics --- 00:28:45.192 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:45.192 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:28:45.192 04:40:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:45.192 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:45.192 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:28:45.192 00:28:45.192 --- 10.0.0.1 ping statistics --- 00:28:45.192 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:45.192 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:28:45.192 04:40:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:45.192 04:40:24 -- nvmf/common.sh@410 -- # return 0 00:28:45.192 04:40:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:45.192 04:40:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:45.192 04:40:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:45.192 04:40:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:45.192 04:40:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:45.192 04:40:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:45.192 04:40:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:45.192 04:40:24 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:28:45.192 04:40:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:45.192 04:40:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:45.192 04:40:24 -- common/autotest_common.sh@10 -- # set +x 00:28:45.192 04:40:24 -- nvmf/common.sh@469 -- # nvmfpid=3030977 00:28:45.192 04:40:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:45.192 04:40:24 -- nvmf/common.sh@470 -- # waitforlisten 3030977 00:28:45.192 04:40:24 -- common/autotest_common.sh@829 -- # '[' -z 3030977 ']' 00:28:45.192 04:40:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:45.192 04:40:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:45.192 04:40:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:45.192 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:45.192 04:40:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:45.192 04:40:24 -- common/autotest_common.sh@10 -- # set +x 00:28:45.192 [2024-11-26 04:40:24.304601] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:45.192 [2024-11-26 04:40:24.304703] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:45.192 EAL: No free 2048 kB hugepages reported on node 1 00:28:45.192 [2024-11-26 04:40:24.367110] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:45.452 [2024-11-26 04:40:24.452174] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:45.452 [2024-11-26 04:40:24.452333] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:45.452 [2024-11-26 04:40:24.452351] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:45.452 [2024-11-26 04:40:24.452363] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:45.452 [2024-11-26 04:40:24.452390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:46.391 04:40:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:46.391 04:40:25 -- common/autotest_common.sh@862 -- # return 0 00:28:46.391 04:40:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:46.391 04:40:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:46.391 04:40:25 -- common/autotest_common.sh@10 -- # set +x 00:28:46.391 04:40:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:46.391 04:40:25 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:28:46.391 04:40:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.391 04:40:25 -- common/autotest_common.sh@10 -- # set +x 00:28:46.391 [2024-11-26 04:40:25.356533] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:46.391 [2024-11-26 04:40:25.364766] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:46.391 null0 00:28:46.391 [2024-11-26 04:40:25.396634] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:46.391 04:40:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.391 04:40:25 -- host/discovery_remove_ifc.sh@59 -- # hostpid=3031142 00:28:46.391 04:40:25 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:28:46.391 04:40:25 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 3031142 /tmp/host.sock 00:28:46.391 04:40:25 -- common/autotest_common.sh@829 -- # '[' -z 3031142 ']' 00:28:46.391 04:40:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:46.391 04:40:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:46.391 04:40:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:46.391 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:46.391 04:40:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:46.391 04:40:25 -- common/autotest_common.sh@10 -- # set +x 00:28:46.391 [2024-11-26 04:40:25.459567] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:46.391 [2024-11-26 04:40:25.459641] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3031142 ] 00:28:46.391 EAL: No free 2048 kB hugepages reported on node 1 00:28:46.391 [2024-11-26 04:40:25.517010] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:46.391 [2024-11-26 04:40:25.601438] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:46.391 [2024-11-26 04:40:25.601604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:46.651 04:40:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:46.651 04:40:25 -- common/autotest_common.sh@862 -- # return 0 00:28:46.651 04:40:25 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:46.651 04:40:25 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:28:46.651 04:40:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.651 04:40:25 -- common/autotest_common.sh@10 -- # set +x 00:28:46.651 04:40:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.651 04:40:25 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:28:46.651 04:40:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.651 04:40:25 -- common/autotest_common.sh@10 -- # set +x 00:28:46.651 04:40:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.651 04:40:25 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:28:46.651 04:40:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.651 04:40:25 -- common/autotest_common.sh@10 -- # set +x 00:28:48.033 [2024-11-26 04:40:26.844844] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:48.033 [2024-11-26 04:40:26.844899] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:48.033 [2024-11-26 04:40:26.844922] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:48.033 [2024-11-26 04:40:26.931183] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:48.033 [2024-11-26 04:40:27.036186] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:28:48.033 [2024-11-26 04:40:27.036244] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:28:48.033 [2024-11-26 04:40:27.036289] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:28:48.033 [2024-11-26 04:40:27.036322] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:48.033 [2024-11-26 04:40:27.036365] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:48.033 04:40:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:48.033 04:40:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.033 04:40:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:48.033 [2024-11-26 04:40:27.042664] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x153b4b0 was disconnected and freed. delete nvme_qpair. 00:28:48.033 04:40:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:48.033 04:40:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:48.033 04:40:27 -- common/autotest_common.sh@10 -- # set +x 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:48.033 04:40:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:48.033 04:40:27 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:49.413 04:40:28 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:49.413 04:40:28 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:49.413 04:40:28 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:49.413 04:40:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.413 04:40:28 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:49.413 04:40:28 -- common/autotest_common.sh@10 -- # set +x 00:28:49.413 04:40:28 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:49.413 04:40:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:49.413 04:40:28 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:49.413 04:40:28 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:50.349 04:40:29 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:50.349 04:40:29 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:50.349 04:40:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.349 04:40:29 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:50.349 04:40:29 -- common/autotest_common.sh@10 -- # set +x 00:28:50.350 04:40:29 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:50.350 04:40:29 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:50.350 04:40:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.350 04:40:29 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:50.350 04:40:29 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:51.288 04:40:30 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:51.288 04:40:30 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:51.288 04:40:30 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:51.288 04:40:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:51.288 04:40:30 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:51.288 04:40:30 -- common/autotest_common.sh@10 -- # set +x 00:28:51.288 04:40:30 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:51.288 04:40:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:51.288 04:40:30 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:51.288 04:40:30 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:52.226 04:40:31 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:52.226 04:40:31 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:52.226 04:40:31 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:52.226 04:40:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.226 04:40:31 -- common/autotest_common.sh@10 -- # set +x 00:28:52.226 04:40:31 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:52.226 04:40:31 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:52.226 04:40:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.226 04:40:31 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:52.226 04:40:31 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:53.604 04:40:32 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:53.604 04:40:32 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:53.604 04:40:32 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:53.604 04:40:32 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:53.604 04:40:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:53.604 04:40:32 -- common/autotest_common.sh@10 -- # set +x 00:28:53.604 04:40:32 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:53.604 04:40:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:53.604 04:40:32 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:53.604 04:40:32 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:53.604 [2024-11-26 04:40:32.477737] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:28:53.604 [2024-11-26 04:40:32.477812] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:53.604 [2024-11-26 04:40:32.477832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:53.604 [2024-11-26 04:40:32.477848] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:53.604 [2024-11-26 04:40:32.477860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:53.604 [2024-11-26 04:40:32.477873] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:53.604 [2024-11-26 04:40:32.477886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:53.605 [2024-11-26 04:40:32.477899] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:53.605 [2024-11-26 04:40:32.477911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:53.605 [2024-11-26 04:40:32.477924] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:53.605 [2024-11-26 04:40:32.477938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:53.605 [2024-11-26 04:40:32.477959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1502790 is same with the state(5) to be set 00:28:53.605 [2024-11-26 04:40:32.487742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1502790 (9): Bad file descriptor 00:28:53.605 [2024-11-26 04:40:32.497792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:54.541 04:40:33 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:54.541 04:40:33 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:54.541 04:40:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.541 04:40:33 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:54.541 04:40:33 -- common/autotest_common.sh@10 -- # set +x 00:28:54.541 04:40:33 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:54.541 04:40:33 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:54.541 [2024-11-26 04:40:33.537724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:28:55.481 [2024-11-26 04:40:34.561730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:28:55.481 [2024-11-26 04:40:34.561792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1502790 with addr=10.0.0.2, port=4420 00:28:55.481 [2024-11-26 04:40:34.561821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1502790 is same with the state(5) to be set 00:28:55.481 [2024-11-26 04:40:34.561864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:55.481 [2024-11-26 04:40:34.561883] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:55.481 [2024-11-26 04:40:34.561898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:55.481 [2024-11-26 04:40:34.561914] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:28:55.481 [2024-11-26 04:40:34.562375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1502790 (9): Bad file descriptor 00:28:55.481 [2024-11-26 04:40:34.562419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:55.481 [2024-11-26 04:40:34.562468] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:28:55.481 [2024-11-26 04:40:34.562507] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.481 [2024-11-26 04:40:34.562531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.481 [2024-11-26 04:40:34.562550] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.481 [2024-11-26 04:40:34.562566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.481 [2024-11-26 04:40:34.562581] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.481 [2024-11-26 04:40:34.562596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.481 [2024-11-26 04:40:34.562611] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.481 [2024-11-26 04:40:34.562626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.481 [2024-11-26 04:40:34.562642] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.481 [2024-11-26 04:40:34.562658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.481 [2024-11-26 04:40:34.562672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:28:55.481 [2024-11-26 04:40:34.562861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1501c40 (9): Bad file descriptor 00:28:55.481 [2024-11-26 04:40:34.563878] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:28:55.481 [2024-11-26 04:40:34.563899] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:28:55.481 04:40:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.481 04:40:34 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:55.481 04:40:34 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:56.417 04:40:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:56.417 04:40:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:56.417 04:40:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:56.417 04:40:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.417 04:40:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:56.417 04:40:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:56.417 04:40:35 -- common/autotest_common.sh@10 -- # set +x 00:28:56.417 04:40:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.417 04:40:35 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:28:56.417 04:40:35 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:56.417 04:40:35 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:56.676 04:40:35 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:28:56.676 04:40:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:56.676 04:40:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:56.676 04:40:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:56.676 04:40:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.676 04:40:35 -- common/autotest_common.sh@10 -- # set +x 00:28:56.676 04:40:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:56.676 04:40:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:56.676 04:40:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.676 04:40:35 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:28:56.676 04:40:35 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:57.614 [2024-11-26 04:40:36.580315] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:57.614 [2024-11-26 04:40:36.580341] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:57.614 [2024-11-26 04:40:36.580366] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:57.614 [2024-11-26 04:40:36.666634] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:28:57.614 04:40:36 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:57.614 04:40:36 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.614 04:40:36 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:57.614 04:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.614 04:40:36 -- common/autotest_common.sh@10 -- # set +x 00:28:57.614 04:40:36 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:57.614 04:40:36 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:57.614 04:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.614 04:40:36 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:28:57.614 04:40:36 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:57.614 [2024-11-26 04:40:36.811777] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:28:57.614 [2024-11-26 04:40:36.811821] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:28:57.615 [2024-11-26 04:40:36.811851] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:28:57.615 [2024-11-26 04:40:36.811873] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:28:57.615 [2024-11-26 04:40:36.811885] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:57.615 [2024-11-26 04:40:36.818704] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x151fc20 was disconnected and freed. delete nvme_qpair. 00:28:58.550 04:40:37 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:58.550 04:40:37 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:58.550 04:40:37 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:58.550 04:40:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.550 04:40:37 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:58.550 04:40:37 -- common/autotest_common.sh@10 -- # set +x 00:28:58.550 04:40:37 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:58.550 04:40:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.809 04:40:37 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:28:58.809 04:40:37 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:28:58.809 04:40:37 -- host/discovery_remove_ifc.sh@90 -- # killprocess 3031142 00:28:58.809 04:40:37 -- common/autotest_common.sh@936 -- # '[' -z 3031142 ']' 00:28:58.809 04:40:37 -- common/autotest_common.sh@940 -- # kill -0 3031142 00:28:58.809 04:40:37 -- common/autotest_common.sh@941 -- # uname 00:28:58.809 04:40:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:58.809 04:40:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3031142 00:28:58.809 04:40:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:58.809 04:40:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:58.809 04:40:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3031142' 00:28:58.809 killing process with pid 3031142 00:28:58.809 04:40:37 -- common/autotest_common.sh@955 -- # kill 3031142 00:28:58.809 04:40:37 -- common/autotest_common.sh@960 -- # wait 3031142 00:28:58.809 04:40:38 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:28:59.069 04:40:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:59.070 04:40:38 -- nvmf/common.sh@116 -- # sync 00:28:59.070 04:40:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:59.070 04:40:38 -- nvmf/common.sh@119 -- # set +e 00:28:59.070 04:40:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:59.070 04:40:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:59.070 rmmod nvme_tcp 00:28:59.070 rmmod nvme_fabrics 00:28:59.070 rmmod nvme_keyring 00:28:59.070 04:40:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:59.070 04:40:38 -- nvmf/common.sh@123 -- # set -e 00:28:59.070 04:40:38 -- nvmf/common.sh@124 -- # return 0 00:28:59.070 04:40:38 -- nvmf/common.sh@477 -- # '[' -n 3030977 ']' 00:28:59.070 04:40:38 -- nvmf/common.sh@478 -- # killprocess 3030977 00:28:59.070 04:40:38 -- common/autotest_common.sh@936 -- # '[' -z 3030977 ']' 00:28:59.070 04:40:38 -- common/autotest_common.sh@940 -- # kill -0 3030977 00:28:59.070 04:40:38 -- common/autotest_common.sh@941 -- # uname 00:28:59.070 04:40:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:59.070 04:40:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3030977 00:28:59.070 04:40:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:59.070 04:40:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:59.070 04:40:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3030977' 00:28:59.070 killing process with pid 3030977 00:28:59.070 04:40:38 -- common/autotest_common.sh@955 -- # kill 3030977 00:28:59.070 04:40:38 -- common/autotest_common.sh@960 -- # wait 3030977 00:28:59.331 04:40:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:59.331 04:40:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:59.331 04:40:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:59.331 04:40:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:59.331 04:40:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:59.331 04:40:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:59.331 04:40:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:59.331 04:40:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:01.233 04:40:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:01.233 00:29:01.233 real 0m18.413s 00:29:01.233 user 0m25.627s 00:29:01.233 sys 0m2.834s 00:29:01.233 04:40:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:01.233 04:40:40 -- common/autotest_common.sh@10 -- # set +x 00:29:01.233 ************************************ 00:29:01.233 END TEST nvmf_discovery_remove_ifc 00:29:01.233 ************************************ 00:29:01.233 04:40:40 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:01.233 04:40:40 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:01.233 04:40:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:01.233 04:40:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:01.233 04:40:40 -- common/autotest_common.sh@10 -- # set +x 00:29:01.233 ************************************ 00:29:01.233 START TEST nvmf_digest 00:29:01.233 ************************************ 00:29:01.234 04:40:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:01.493 * Looking for test storage... 00:29:01.493 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:01.493 04:40:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:01.493 04:40:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:01.493 04:40:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:01.493 04:40:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:01.493 04:40:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:01.493 04:40:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:01.493 04:40:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:01.493 04:40:40 -- scripts/common.sh@335 -- # IFS=.-: 00:29:01.493 04:40:40 -- scripts/common.sh@335 -- # read -ra ver1 00:29:01.493 04:40:40 -- scripts/common.sh@336 -- # IFS=.-: 00:29:01.493 04:40:40 -- scripts/common.sh@336 -- # read -ra ver2 00:29:01.493 04:40:40 -- scripts/common.sh@337 -- # local 'op=<' 00:29:01.493 04:40:40 -- scripts/common.sh@339 -- # ver1_l=2 00:29:01.493 04:40:40 -- scripts/common.sh@340 -- # ver2_l=1 00:29:01.493 04:40:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:01.493 04:40:40 -- scripts/common.sh@343 -- # case "$op" in 00:29:01.493 04:40:40 -- scripts/common.sh@344 -- # : 1 00:29:01.493 04:40:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:01.493 04:40:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:01.493 04:40:40 -- scripts/common.sh@364 -- # decimal 1 00:29:01.493 04:40:40 -- scripts/common.sh@352 -- # local d=1 00:29:01.493 04:40:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:01.493 04:40:40 -- scripts/common.sh@354 -- # echo 1 00:29:01.493 04:40:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:01.493 04:40:40 -- scripts/common.sh@365 -- # decimal 2 00:29:01.493 04:40:40 -- scripts/common.sh@352 -- # local d=2 00:29:01.493 04:40:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:01.493 04:40:40 -- scripts/common.sh@354 -- # echo 2 00:29:01.493 04:40:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:01.493 04:40:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:01.493 04:40:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:01.493 04:40:40 -- scripts/common.sh@367 -- # return 0 00:29:01.493 04:40:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:01.493 04:40:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:01.493 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:01.493 --rc genhtml_branch_coverage=1 00:29:01.493 --rc genhtml_function_coverage=1 00:29:01.493 --rc genhtml_legend=1 00:29:01.493 --rc geninfo_all_blocks=1 00:29:01.493 --rc geninfo_unexecuted_blocks=1 00:29:01.493 00:29:01.493 ' 00:29:01.493 04:40:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:01.493 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:01.493 --rc genhtml_branch_coverage=1 00:29:01.493 --rc genhtml_function_coverage=1 00:29:01.493 --rc genhtml_legend=1 00:29:01.493 --rc geninfo_all_blocks=1 00:29:01.493 --rc geninfo_unexecuted_blocks=1 00:29:01.493 00:29:01.493 ' 00:29:01.493 04:40:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:01.493 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:01.493 --rc genhtml_branch_coverage=1 00:29:01.493 --rc genhtml_function_coverage=1 00:29:01.493 --rc genhtml_legend=1 00:29:01.493 --rc geninfo_all_blocks=1 00:29:01.493 --rc geninfo_unexecuted_blocks=1 00:29:01.493 00:29:01.493 ' 00:29:01.493 04:40:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:01.493 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:01.493 --rc genhtml_branch_coverage=1 00:29:01.493 --rc genhtml_function_coverage=1 00:29:01.493 --rc genhtml_legend=1 00:29:01.493 --rc geninfo_all_blocks=1 00:29:01.493 --rc geninfo_unexecuted_blocks=1 00:29:01.493 00:29:01.493 ' 00:29:01.493 04:40:40 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:01.493 04:40:40 -- nvmf/common.sh@7 -- # uname -s 00:29:01.493 04:40:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:01.493 04:40:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:01.493 04:40:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:01.493 04:40:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:01.493 04:40:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:01.493 04:40:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:01.493 04:40:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:01.493 04:40:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:01.493 04:40:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:01.493 04:40:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:01.493 04:40:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:01.493 04:40:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:01.493 04:40:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:01.493 04:40:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:01.493 04:40:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:01.493 04:40:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:01.493 04:40:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:01.493 04:40:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:01.493 04:40:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:01.493 04:40:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:01.493 04:40:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:01.493 04:40:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:01.493 04:40:40 -- paths/export.sh@5 -- # export PATH 00:29:01.493 04:40:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:01.493 04:40:40 -- nvmf/common.sh@46 -- # : 0 00:29:01.493 04:40:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:01.493 04:40:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:01.493 04:40:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:01.493 04:40:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:01.493 04:40:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:01.493 04:40:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:01.493 04:40:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:01.493 04:40:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:01.493 04:40:40 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:01.493 04:40:40 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:01.493 04:40:40 -- host/digest.sh@16 -- # runtime=2 00:29:01.493 04:40:40 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:01.493 04:40:40 -- host/digest.sh@132 -- # nvmftestinit 00:29:01.493 04:40:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:01.493 04:40:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:01.493 04:40:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:01.493 04:40:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:01.493 04:40:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:01.493 04:40:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:01.493 04:40:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:01.493 04:40:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:01.493 04:40:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:01.493 04:40:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:01.493 04:40:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:01.493 04:40:40 -- common/autotest_common.sh@10 -- # set +x 00:29:03.405 04:40:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:03.405 04:40:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:03.405 04:40:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:03.405 04:40:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:03.405 04:40:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:03.405 04:40:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:03.405 04:40:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:03.405 04:40:42 -- nvmf/common.sh@294 -- # net_devs=() 00:29:03.405 04:40:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:03.405 04:40:42 -- nvmf/common.sh@295 -- # e810=() 00:29:03.405 04:40:42 -- nvmf/common.sh@295 -- # local -ga e810 00:29:03.405 04:40:42 -- nvmf/common.sh@296 -- # x722=() 00:29:03.405 04:40:42 -- nvmf/common.sh@296 -- # local -ga x722 00:29:03.405 04:40:42 -- nvmf/common.sh@297 -- # mlx=() 00:29:03.405 04:40:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:03.405 04:40:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:03.405 04:40:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:03.405 04:40:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:03.405 04:40:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:03.405 04:40:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:03.405 04:40:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:03.405 04:40:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:03.405 04:40:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:03.405 04:40:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:03.405 04:40:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:03.405 04:40:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:03.405 04:40:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:03.405 04:40:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:03.405 04:40:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:03.405 04:40:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:03.405 04:40:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:03.405 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:03.405 04:40:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:03.405 04:40:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:03.405 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:03.405 04:40:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:03.405 04:40:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:03.405 04:40:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:03.405 04:40:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:03.405 04:40:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:03.405 04:40:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:03.406 04:40:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:03.406 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:03.406 04:40:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:03.406 04:40:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:03.406 04:40:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:03.406 04:40:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:03.406 04:40:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:03.406 04:40:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:03.406 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:03.406 04:40:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:03.406 04:40:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:03.406 04:40:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:03.406 04:40:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:03.406 04:40:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:03.406 04:40:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:03.406 04:40:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:03.406 04:40:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:03.406 04:40:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:03.406 04:40:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:03.406 04:40:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:03.406 04:40:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:03.406 04:40:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:03.406 04:40:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:03.406 04:40:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:03.406 04:40:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:03.406 04:40:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:03.406 04:40:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:03.406 04:40:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:03.406 04:40:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:03.406 04:40:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:03.406 04:40:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:03.406 04:40:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:03.406 04:40:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:03.406 04:40:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:03.406 04:40:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:03.406 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:03.406 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.326 ms 00:29:03.406 00:29:03.406 --- 10.0.0.2 ping statistics --- 00:29:03.406 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:03.406 rtt min/avg/max/mdev = 0.326/0.326/0.326/0.000 ms 00:29:03.406 04:40:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:03.406 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:03.406 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:29:03.406 00:29:03.406 --- 10.0.0.1 ping statistics --- 00:29:03.406 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:03.406 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:29:03.406 04:40:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:03.406 04:40:42 -- nvmf/common.sh@410 -- # return 0 00:29:03.406 04:40:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:03.406 04:40:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:03.406 04:40:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:03.406 04:40:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:03.406 04:40:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:03.406 04:40:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:03.406 04:40:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:03.700 04:40:42 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:03.700 04:40:42 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:03.700 04:40:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:03.700 04:40:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:03.700 04:40:42 -- common/autotest_common.sh@10 -- # set +x 00:29:03.700 ************************************ 00:29:03.700 START TEST nvmf_digest_clean 00:29:03.700 ************************************ 00:29:03.700 04:40:42 -- common/autotest_common.sh@1114 -- # run_digest 00:29:03.700 04:40:42 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:03.700 04:40:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:03.700 04:40:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:03.700 04:40:42 -- common/autotest_common.sh@10 -- # set +x 00:29:03.700 04:40:42 -- nvmf/common.sh@469 -- # nvmfpid=3034678 00:29:03.700 04:40:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:03.700 04:40:42 -- nvmf/common.sh@470 -- # waitforlisten 3034678 00:29:03.700 04:40:42 -- common/autotest_common.sh@829 -- # '[' -z 3034678 ']' 00:29:03.700 04:40:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:03.700 04:40:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:03.700 04:40:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:03.700 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:03.700 04:40:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:03.700 04:40:42 -- common/autotest_common.sh@10 -- # set +x 00:29:03.700 [2024-11-26 04:40:42.692264] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:03.700 [2024-11-26 04:40:42.692334] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:03.700 EAL: No free 2048 kB hugepages reported on node 1 00:29:03.700 [2024-11-26 04:40:42.754946] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:03.700 [2024-11-26 04:40:42.837143] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:03.700 [2024-11-26 04:40:42.837301] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:03.700 [2024-11-26 04:40:42.837317] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:03.700 [2024-11-26 04:40:42.837329] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:03.700 [2024-11-26 04:40:42.837354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:03.962 04:40:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:03.962 04:40:42 -- common/autotest_common.sh@862 -- # return 0 00:29:03.962 04:40:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:03.962 04:40:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:03.962 04:40:42 -- common/autotest_common.sh@10 -- # set +x 00:29:03.962 04:40:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:03.962 04:40:42 -- host/digest.sh@120 -- # common_target_config 00:29:03.962 04:40:42 -- host/digest.sh@43 -- # rpc_cmd 00:29:03.962 04:40:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.962 04:40:42 -- common/autotest_common.sh@10 -- # set +x 00:29:03.962 null0 00:29:03.962 [2024-11-26 04:40:43.052906] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:03.962 [2024-11-26 04:40:43.077129] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:03.962 04:40:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.962 04:40:43 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:03.962 04:40:43 -- host/digest.sh@77 -- # local rw bs qd 00:29:03.962 04:40:43 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:03.962 04:40:43 -- host/digest.sh@80 -- # rw=randread 00:29:03.962 04:40:43 -- host/digest.sh@80 -- # bs=4096 00:29:03.962 04:40:43 -- host/digest.sh@80 -- # qd=128 00:29:03.962 04:40:43 -- host/digest.sh@82 -- # bperfpid=3034704 00:29:03.962 04:40:43 -- host/digest.sh@83 -- # waitforlisten 3034704 /var/tmp/bperf.sock 00:29:03.962 04:40:43 -- common/autotest_common.sh@829 -- # '[' -z 3034704 ']' 00:29:03.962 04:40:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:03.962 04:40:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:03.962 04:40:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:03.962 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:03.962 04:40:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:03.962 04:40:43 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:03.962 04:40:43 -- common/autotest_common.sh@10 -- # set +x 00:29:03.962 [2024-11-26 04:40:43.123246] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:03.962 [2024-11-26 04:40:43.123329] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3034704 ] 00:29:03.962 EAL: No free 2048 kB hugepages reported on node 1 00:29:03.962 [2024-11-26 04:40:43.180585] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:04.220 [2024-11-26 04:40:43.267240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:04.220 04:40:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:04.220 04:40:43 -- common/autotest_common.sh@862 -- # return 0 00:29:04.220 04:40:43 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:04.220 04:40:43 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:04.220 04:40:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:04.480 04:40:43 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:04.480 04:40:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:05.046 nvme0n1 00:29:05.046 04:40:44 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:05.046 04:40:44 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:05.304 Running I/O for 2 seconds... 00:29:07.214 00:29:07.214 Latency(us) 00:29:07.214 [2024-11-26T03:40:46.440Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:07.214 [2024-11-26T03:40:46.440Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:07.214 nvme0n1 : 2.01 16648.32 65.03 0.00 0.00 7681.96 3495.25 19418.07 00:29:07.214 [2024-11-26T03:40:46.440Z] =================================================================================================================== 00:29:07.214 [2024-11-26T03:40:46.440Z] Total : 16648.32 65.03 0.00 0.00 7681.96 3495.25 19418.07 00:29:07.214 0 00:29:07.214 04:40:46 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:07.214 04:40:46 -- host/digest.sh@92 -- # get_accel_stats 00:29:07.214 04:40:46 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:07.214 04:40:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:07.214 04:40:46 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:07.214 | select(.opcode=="crc32c") 00:29:07.214 | "\(.module_name) \(.executed)"' 00:29:07.472 04:40:46 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:07.472 04:40:46 -- host/digest.sh@93 -- # exp_module=software 00:29:07.472 04:40:46 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:07.472 04:40:46 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:07.472 04:40:46 -- host/digest.sh@97 -- # killprocess 3034704 00:29:07.472 04:40:46 -- common/autotest_common.sh@936 -- # '[' -z 3034704 ']' 00:29:07.472 04:40:46 -- common/autotest_common.sh@940 -- # kill -0 3034704 00:29:07.472 04:40:46 -- common/autotest_common.sh@941 -- # uname 00:29:07.472 04:40:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:07.472 04:40:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3034704 00:29:07.472 04:40:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:07.472 04:40:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:07.472 04:40:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3034704' 00:29:07.472 killing process with pid 3034704 00:29:07.472 04:40:46 -- common/autotest_common.sh@955 -- # kill 3034704 00:29:07.472 Received shutdown signal, test time was about 2.000000 seconds 00:29:07.472 00:29:07.472 Latency(us) 00:29:07.472 [2024-11-26T03:40:46.698Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:07.472 [2024-11-26T03:40:46.698Z] =================================================================================================================== 00:29:07.472 [2024-11-26T03:40:46.698Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:07.472 04:40:46 -- common/autotest_common.sh@960 -- # wait 3034704 00:29:07.731 04:40:46 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:07.731 04:40:46 -- host/digest.sh@77 -- # local rw bs qd 00:29:07.731 04:40:46 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:07.731 04:40:46 -- host/digest.sh@80 -- # rw=randread 00:29:07.731 04:40:46 -- host/digest.sh@80 -- # bs=131072 00:29:07.731 04:40:46 -- host/digest.sh@80 -- # qd=16 00:29:07.731 04:40:46 -- host/digest.sh@82 -- # bperfpid=3035194 00:29:07.731 04:40:46 -- host/digest.sh@83 -- # waitforlisten 3035194 /var/tmp/bperf.sock 00:29:07.731 04:40:46 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:07.731 04:40:46 -- common/autotest_common.sh@829 -- # '[' -z 3035194 ']' 00:29:07.731 04:40:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:07.731 04:40:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:07.731 04:40:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:07.731 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:07.731 04:40:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:07.731 04:40:46 -- common/autotest_common.sh@10 -- # set +x 00:29:07.731 [2024-11-26 04:40:46.874628] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:07.731 [2024-11-26 04:40:46.874755] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3035194 ] 00:29:07.731 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:07.731 Zero copy mechanism will not be used. 00:29:07.731 EAL: No free 2048 kB hugepages reported on node 1 00:29:07.731 [2024-11-26 04:40:46.934889] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:07.989 [2024-11-26 04:40:47.019085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:07.989 04:40:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:07.989 04:40:47 -- common/autotest_common.sh@862 -- # return 0 00:29:07.989 04:40:47 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:07.989 04:40:47 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:07.989 04:40:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:08.247 04:40:47 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:08.247 04:40:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:08.816 nvme0n1 00:29:08.816 04:40:47 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:08.816 04:40:47 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:08.816 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:08.816 Zero copy mechanism will not be used. 00:29:08.816 Running I/O for 2 seconds... 00:29:10.720 00:29:10.720 Latency(us) 00:29:10.720 [2024-11-26T03:40:49.946Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:10.720 [2024-11-26T03:40:49.946Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:10.720 nvme0n1 : 2.00 3501.03 437.63 0.00 0.00 4565.60 1019.45 9175.04 00:29:10.720 [2024-11-26T03:40:49.946Z] =================================================================================================================== 00:29:10.720 [2024-11-26T03:40:49.946Z] Total : 3501.03 437.63 0.00 0.00 4565.60 1019.45 9175.04 00:29:10.720 0 00:29:10.721 04:40:49 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:10.721 04:40:49 -- host/digest.sh@92 -- # get_accel_stats 00:29:10.721 04:40:49 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:10.721 04:40:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:10.721 04:40:49 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:10.721 | select(.opcode=="crc32c") 00:29:10.721 | "\(.module_name) \(.executed)"' 00:29:10.978 04:40:50 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:10.979 04:40:50 -- host/digest.sh@93 -- # exp_module=software 00:29:10.979 04:40:50 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:10.979 04:40:50 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:10.979 04:40:50 -- host/digest.sh@97 -- # killprocess 3035194 00:29:10.979 04:40:50 -- common/autotest_common.sh@936 -- # '[' -z 3035194 ']' 00:29:10.979 04:40:50 -- common/autotest_common.sh@940 -- # kill -0 3035194 00:29:10.979 04:40:50 -- common/autotest_common.sh@941 -- # uname 00:29:10.979 04:40:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:10.979 04:40:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3035194 00:29:10.979 04:40:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:10.979 04:40:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:10.979 04:40:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3035194' 00:29:10.979 killing process with pid 3035194 00:29:10.979 04:40:50 -- common/autotest_common.sh@955 -- # kill 3035194 00:29:10.979 Received shutdown signal, test time was about 2.000000 seconds 00:29:10.979 00:29:10.979 Latency(us) 00:29:10.979 [2024-11-26T03:40:50.205Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:10.979 [2024-11-26T03:40:50.205Z] =================================================================================================================== 00:29:10.979 [2024-11-26T03:40:50.205Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:10.979 04:40:50 -- common/autotest_common.sh@960 -- # wait 3035194 00:29:11.237 04:40:50 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:11.237 04:40:50 -- host/digest.sh@77 -- # local rw bs qd 00:29:11.237 04:40:50 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:11.237 04:40:50 -- host/digest.sh@80 -- # rw=randwrite 00:29:11.237 04:40:50 -- host/digest.sh@80 -- # bs=4096 00:29:11.237 04:40:50 -- host/digest.sh@80 -- # qd=128 00:29:11.237 04:40:50 -- host/digest.sh@82 -- # bperfpid=3035662 00:29:11.237 04:40:50 -- host/digest.sh@83 -- # waitforlisten 3035662 /var/tmp/bperf.sock 00:29:11.237 04:40:50 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:11.237 04:40:50 -- common/autotest_common.sh@829 -- # '[' -z 3035662 ']' 00:29:11.237 04:40:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:11.237 04:40:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:11.237 04:40:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:11.237 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:11.237 04:40:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:11.237 04:40:50 -- common/autotest_common.sh@10 -- # set +x 00:29:11.237 [2024-11-26 04:40:50.446625] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:11.237 [2024-11-26 04:40:50.446730] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3035662 ] 00:29:11.496 EAL: No free 2048 kB hugepages reported on node 1 00:29:11.496 [2024-11-26 04:40:50.507333] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:11.496 [2024-11-26 04:40:50.593397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:11.496 04:40:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:11.496 04:40:50 -- common/autotest_common.sh@862 -- # return 0 00:29:11.496 04:40:50 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:11.496 04:40:50 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:11.496 04:40:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:12.065 04:40:51 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:12.065 04:40:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:12.326 nvme0n1 00:29:12.326 04:40:51 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:12.326 04:40:51 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:12.326 Running I/O for 2 seconds... 00:29:14.862 00:29:14.862 Latency(us) 00:29:14.862 [2024-11-26T03:40:54.088Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:14.862 [2024-11-26T03:40:54.088Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:14.862 nvme0n1 : 2.01 19502.06 76.18 0.00 0.00 6549.56 3058.35 10679.94 00:29:14.862 [2024-11-26T03:40:54.088Z] =================================================================================================================== 00:29:14.862 [2024-11-26T03:40:54.088Z] Total : 19502.06 76.18 0.00 0.00 6549.56 3058.35 10679.94 00:29:14.862 0 00:29:14.862 04:40:53 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:14.862 04:40:53 -- host/digest.sh@92 -- # get_accel_stats 00:29:14.862 04:40:53 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:14.862 04:40:53 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:14.862 | select(.opcode=="crc32c") 00:29:14.862 | "\(.module_name) \(.executed)"' 00:29:14.862 04:40:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:14.862 04:40:53 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:14.862 04:40:53 -- host/digest.sh@93 -- # exp_module=software 00:29:14.862 04:40:53 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:14.862 04:40:53 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:14.862 04:40:53 -- host/digest.sh@97 -- # killprocess 3035662 00:29:14.862 04:40:53 -- common/autotest_common.sh@936 -- # '[' -z 3035662 ']' 00:29:14.862 04:40:53 -- common/autotest_common.sh@940 -- # kill -0 3035662 00:29:14.862 04:40:53 -- common/autotest_common.sh@941 -- # uname 00:29:14.862 04:40:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:14.862 04:40:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3035662 00:29:14.862 04:40:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:14.862 04:40:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:14.862 04:40:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3035662' 00:29:14.862 killing process with pid 3035662 00:29:14.862 04:40:53 -- common/autotest_common.sh@955 -- # kill 3035662 00:29:14.862 Received shutdown signal, test time was about 2.000000 seconds 00:29:14.862 00:29:14.862 Latency(us) 00:29:14.862 [2024-11-26T03:40:54.088Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:14.862 [2024-11-26T03:40:54.088Z] =================================================================================================================== 00:29:14.862 [2024-11-26T03:40:54.088Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:14.862 04:40:53 -- common/autotest_common.sh@960 -- # wait 3035662 00:29:14.862 04:40:54 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:14.862 04:40:54 -- host/digest.sh@77 -- # local rw bs qd 00:29:14.862 04:40:54 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:14.862 04:40:54 -- host/digest.sh@80 -- # rw=randwrite 00:29:14.862 04:40:54 -- host/digest.sh@80 -- # bs=131072 00:29:14.862 04:40:54 -- host/digest.sh@80 -- # qd=16 00:29:14.862 04:40:54 -- host/digest.sh@82 -- # bperfpid=3036084 00:29:14.862 04:40:54 -- host/digest.sh@83 -- # waitforlisten 3036084 /var/tmp/bperf.sock 00:29:14.862 04:40:54 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:14.862 04:40:54 -- common/autotest_common.sh@829 -- # '[' -z 3036084 ']' 00:29:14.862 04:40:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:14.862 04:40:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:14.862 04:40:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:14.862 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:14.862 04:40:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:14.862 04:40:54 -- common/autotest_common.sh@10 -- # set +x 00:29:14.862 [2024-11-26 04:40:54.069012] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:14.862 [2024-11-26 04:40:54.069099] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3036084 ] 00:29:14.862 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:14.862 Zero copy mechanism will not be used. 00:29:15.121 EAL: No free 2048 kB hugepages reported on node 1 00:29:15.121 [2024-11-26 04:40:54.126814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:15.121 [2024-11-26 04:40:54.210150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:15.121 04:40:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:15.121 04:40:54 -- common/autotest_common.sh@862 -- # return 0 00:29:15.121 04:40:54 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:15.121 04:40:54 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:15.121 04:40:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:15.691 04:40:54 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:15.691 04:40:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:15.951 nvme0n1 00:29:15.951 04:40:55 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:15.951 04:40:55 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:15.951 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:15.951 Zero copy mechanism will not be used. 00:29:15.951 Running I/O for 2 seconds... 00:29:18.485 00:29:18.485 Latency(us) 00:29:18.485 [2024-11-26T03:40:57.711Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:18.485 [2024-11-26T03:40:57.711Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:18.485 nvme0n1 : 2.00 6946.31 868.29 0.00 0.00 2296.20 1832.58 4854.52 00:29:18.485 [2024-11-26T03:40:57.711Z] =================================================================================================================== 00:29:18.485 [2024-11-26T03:40:57.711Z] Total : 6946.31 868.29 0.00 0.00 2296.20 1832.58 4854.52 00:29:18.485 0 00:29:18.485 04:40:57 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:18.485 04:40:57 -- host/digest.sh@92 -- # get_accel_stats 00:29:18.485 04:40:57 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:18.485 04:40:57 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:18.485 | select(.opcode=="crc32c") 00:29:18.485 | "\(.module_name) \(.executed)"' 00:29:18.485 04:40:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:18.485 04:40:57 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:18.485 04:40:57 -- host/digest.sh@93 -- # exp_module=software 00:29:18.485 04:40:57 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:18.485 04:40:57 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:18.485 04:40:57 -- host/digest.sh@97 -- # killprocess 3036084 00:29:18.485 04:40:57 -- common/autotest_common.sh@936 -- # '[' -z 3036084 ']' 00:29:18.485 04:40:57 -- common/autotest_common.sh@940 -- # kill -0 3036084 00:29:18.485 04:40:57 -- common/autotest_common.sh@941 -- # uname 00:29:18.485 04:40:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:18.485 04:40:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3036084 00:29:18.485 04:40:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:18.485 04:40:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:18.485 04:40:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3036084' 00:29:18.485 killing process with pid 3036084 00:29:18.485 04:40:57 -- common/autotest_common.sh@955 -- # kill 3036084 00:29:18.485 Received shutdown signal, test time was about 2.000000 seconds 00:29:18.485 00:29:18.485 Latency(us) 00:29:18.485 [2024-11-26T03:40:57.711Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:18.485 [2024-11-26T03:40:57.711Z] =================================================================================================================== 00:29:18.485 [2024-11-26T03:40:57.711Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:18.485 04:40:57 -- common/autotest_common.sh@960 -- # wait 3036084 00:29:18.485 04:40:57 -- host/digest.sh@126 -- # killprocess 3034678 00:29:18.485 04:40:57 -- common/autotest_common.sh@936 -- # '[' -z 3034678 ']' 00:29:18.485 04:40:57 -- common/autotest_common.sh@940 -- # kill -0 3034678 00:29:18.485 04:40:57 -- common/autotest_common.sh@941 -- # uname 00:29:18.485 04:40:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:18.485 04:40:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3034678 00:29:18.744 04:40:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:18.744 04:40:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:18.744 04:40:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3034678' 00:29:18.744 killing process with pid 3034678 00:29:18.744 04:40:57 -- common/autotest_common.sh@955 -- # kill 3034678 00:29:18.744 04:40:57 -- common/autotest_common.sh@960 -- # wait 3034678 00:29:18.744 00:29:18.744 real 0m15.275s 00:29:18.744 user 0m29.600s 00:29:18.744 sys 0m4.287s 00:29:18.744 04:40:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:18.744 04:40:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.744 ************************************ 00:29:18.744 END TEST nvmf_digest_clean 00:29:18.744 ************************************ 00:29:18.744 04:40:57 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:18.744 04:40:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:18.744 04:40:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:18.744 04:40:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.744 ************************************ 00:29:18.744 START TEST nvmf_digest_error 00:29:18.744 ************************************ 00:29:18.744 04:40:57 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:18.744 04:40:57 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:18.744 04:40:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:18.744 04:40:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:18.744 04:40:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.744 04:40:57 -- nvmf/common.sh@469 -- # nvmfpid=3036536 00:29:18.744 04:40:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:18.744 04:40:57 -- nvmf/common.sh@470 -- # waitforlisten 3036536 00:29:18.744 04:40:57 -- common/autotest_common.sh@829 -- # '[' -z 3036536 ']' 00:29:18.744 04:40:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:18.744 04:40:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:18.744 04:40:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:18.744 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:18.744 04:40:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:18.744 04:40:57 -- common/autotest_common.sh@10 -- # set +x 00:29:19.002 [2024-11-26 04:40:57.997693] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:19.002 [2024-11-26 04:40:57.997780] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:19.002 EAL: No free 2048 kB hugepages reported on node 1 00:29:19.002 [2024-11-26 04:40:58.059922] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:19.002 [2024-11-26 04:40:58.143485] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:19.002 [2024-11-26 04:40:58.143627] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:19.002 [2024-11-26 04:40:58.143642] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:19.002 [2024-11-26 04:40:58.143653] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:19.002 [2024-11-26 04:40:58.143700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:19.002 04:40:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:19.002 04:40:58 -- common/autotest_common.sh@862 -- # return 0 00:29:19.002 04:40:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:19.002 04:40:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:19.002 04:40:58 -- common/autotest_common.sh@10 -- # set +x 00:29:19.260 04:40:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:19.260 04:40:58 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:19.260 04:40:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.260 04:40:58 -- common/autotest_common.sh@10 -- # set +x 00:29:19.260 [2024-11-26 04:40:58.240360] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:19.260 04:40:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.260 04:40:58 -- host/digest.sh@104 -- # common_target_config 00:29:19.260 04:40:58 -- host/digest.sh@43 -- # rpc_cmd 00:29:19.260 04:40:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.260 04:40:58 -- common/autotest_common.sh@10 -- # set +x 00:29:19.260 null0 00:29:19.260 [2024-11-26 04:40:58.349865] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:19.260 [2024-11-26 04:40:58.374116] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:19.260 04:40:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.260 04:40:58 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:19.260 04:40:58 -- host/digest.sh@54 -- # local rw bs qd 00:29:19.260 04:40:58 -- host/digest.sh@56 -- # rw=randread 00:29:19.260 04:40:58 -- host/digest.sh@56 -- # bs=4096 00:29:19.260 04:40:58 -- host/digest.sh@56 -- # qd=128 00:29:19.260 04:40:58 -- host/digest.sh@58 -- # bperfpid=3036675 00:29:19.260 04:40:58 -- host/digest.sh@60 -- # waitforlisten 3036675 /var/tmp/bperf.sock 00:29:19.260 04:40:58 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:19.260 04:40:58 -- common/autotest_common.sh@829 -- # '[' -z 3036675 ']' 00:29:19.260 04:40:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:19.260 04:40:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:19.260 04:40:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:19.260 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:19.260 04:40:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:19.260 04:40:58 -- common/autotest_common.sh@10 -- # set +x 00:29:19.260 [2024-11-26 04:40:58.418671] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:19.260 [2024-11-26 04:40:58.418755] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3036675 ] 00:29:19.260 EAL: No free 2048 kB hugepages reported on node 1 00:29:19.260 [2024-11-26 04:40:58.479108] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:19.519 [2024-11-26 04:40:58.567797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:20.459 04:40:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:20.459 04:40:59 -- common/autotest_common.sh@862 -- # return 0 00:29:20.459 04:40:59 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:20.459 04:40:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:20.718 04:40:59 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:20.718 04:40:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.718 04:40:59 -- common/autotest_common.sh@10 -- # set +x 00:29:20.718 04:40:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.718 04:40:59 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:20.718 04:40:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:21.288 nvme0n1 00:29:21.288 04:41:00 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:21.288 04:41:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.288 04:41:00 -- common/autotest_common.sh@10 -- # set +x 00:29:21.288 04:41:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.288 04:41:00 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:21.288 04:41:00 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:21.288 Running I/O for 2 seconds... 00:29:21.288 [2024-11-26 04:41:00.423783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.288 [2024-11-26 04:41:00.423835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:2426 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.288 [2024-11-26 04:41:00.423854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.288 [2024-11-26 04:41:00.437657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.288 [2024-11-26 04:41:00.437717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:25076 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.288 [2024-11-26 04:41:00.437745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.288 [2024-11-26 04:41:00.451934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.288 [2024-11-26 04:41:00.451976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:1563 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.288 [2024-11-26 04:41:00.451992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.288 [2024-11-26 04:41:00.468294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.288 [2024-11-26 04:41:00.468327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:10243 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.288 [2024-11-26 04:41:00.468345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.288 [2024-11-26 04:41:00.478912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.288 [2024-11-26 04:41:00.478959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:16205 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.288 [2024-11-26 04:41:00.478975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.288 [2024-11-26 04:41:00.494832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.288 [2024-11-26 04:41:00.494864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:6132 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.288 [2024-11-26 04:41:00.494882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.549 [2024-11-26 04:41:00.511089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.511122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:10435 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.511140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.525983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.526016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10706 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.526033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.536914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.536954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:14972 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.536971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.554030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.554060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:19724 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.554092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.571485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.571522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:17841 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.571542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.582297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.582331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24802 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.582350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.598525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.598561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:11462 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.598579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.616103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.616139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:25560 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.616157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.633565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.633600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4667 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.633619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.644889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.644933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:20004 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.644950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.661122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.661157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:22171 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.661176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.676801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.676842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17185 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.676859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.688224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.688258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:2411 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.688277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.706312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.706348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17852 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.706367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.723309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.723345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:14619 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.723364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.740337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.740372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:8165 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.740391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.550 [2024-11-26 04:41:00.757235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.550 [2024-11-26 04:41:00.757271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:2551 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.550 [2024-11-26 04:41:00.757290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.810 [2024-11-26 04:41:00.774150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.810 [2024-11-26 04:41:00.774186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:11518 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.810 [2024-11-26 04:41:00.774205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.810 [2024-11-26 04:41:00.790945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.810 [2024-11-26 04:41:00.790984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20502 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.810 [2024-11-26 04:41:00.790999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.810 [2024-11-26 04:41:00.808013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.810 [2024-11-26 04:41:00.808055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:20301 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.810 [2024-11-26 04:41:00.808075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.810 [2024-11-26 04:41:00.824980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.810 [2024-11-26 04:41:00.825037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:15431 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.810 [2024-11-26 04:41:00.825056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.810 [2024-11-26 04:41:00.842149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.810 [2024-11-26 04:41:00.842184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:10349 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.810 [2024-11-26 04:41:00.842203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.811 [2024-11-26 04:41:00.859321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.811 [2024-11-26 04:41:00.859355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:14346 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.811 [2024-11-26 04:41:00.859374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.811 [2024-11-26 04:41:00.876537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.811 [2024-11-26 04:41:00.876572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:3255 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.811 [2024-11-26 04:41:00.876591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.811 [2024-11-26 04:41:00.893530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.811 [2024-11-26 04:41:00.893564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:4211 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.811 [2024-11-26 04:41:00.893583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.811 [2024-11-26 04:41:00.910802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.811 [2024-11-26 04:41:00.910831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:4540 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.811 [2024-11-26 04:41:00.910846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.811 [2024-11-26 04:41:00.927937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.811 [2024-11-26 04:41:00.927973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1062 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.811 [2024-11-26 04:41:00.927989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.811 [2024-11-26 04:41:00.944959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.811 [2024-11-26 04:41:00.944989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25517 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.811 [2024-11-26 04:41:00.945004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.811 [2024-11-26 04:41:00.961889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.811 [2024-11-26 04:41:00.961918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:7232 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.811 [2024-11-26 04:41:00.961935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.811 [2024-11-26 04:41:00.977781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.811 [2024-11-26 04:41:00.977812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:9680 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.811 [2024-11-26 04:41:00.977829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.811 [2024-11-26 04:41:00.989883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.811 [2024-11-26 04:41:00.989912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:15435 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.811 [2024-11-26 04:41:00.989928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.811 [2024-11-26 04:41:01.005747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.811 [2024-11-26 04:41:01.005776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:25067 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.811 [2024-11-26 04:41:01.005792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.811 [2024-11-26 04:41:01.030010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:21.811 [2024-11-26 04:41:01.030047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:12585 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.811 [2024-11-26 04:41:01.030066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.071 [2024-11-26 04:41:01.040933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.071 [2024-11-26 04:41:01.040963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23228 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.071 [2024-11-26 04:41:01.040994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.071 [2024-11-26 04:41:01.056563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.071 [2024-11-26 04:41:01.056598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20232 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.071 [2024-11-26 04:41:01.056617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.071 [2024-11-26 04:41:01.072464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.071 [2024-11-26 04:41:01.072500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:4445 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.071 [2024-11-26 04:41:01.072519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.071 [2024-11-26 04:41:01.089617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.071 [2024-11-26 04:41:01.089651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23123 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.071 [2024-11-26 04:41:01.089677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.071 [2024-11-26 04:41:01.106848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.071 [2024-11-26 04:41:01.106877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:2498 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.071 [2024-11-26 04:41:01.106893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.071 [2024-11-26 04:41:01.123260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.071 [2024-11-26 04:41:01.123296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:14237 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.071 [2024-11-26 04:41:01.123315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.071 [2024-11-26 04:41:01.140008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.071 [2024-11-26 04:41:01.140043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:22046 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.071 [2024-11-26 04:41:01.140063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.071 [2024-11-26 04:41:01.157154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.071 [2024-11-26 04:41:01.157189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:5783 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.071 [2024-11-26 04:41:01.157209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.071 [2024-11-26 04:41:01.168144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.071 [2024-11-26 04:41:01.168178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20823 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.071 [2024-11-26 04:41:01.168197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.071 [2024-11-26 04:41:01.183792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.071 [2024-11-26 04:41:01.183821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:22521 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.071 [2024-11-26 04:41:01.183837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.071 [2024-11-26 04:41:01.201111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.071 [2024-11-26 04:41:01.201146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:12408 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.072 [2024-11-26 04:41:01.201165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.072 [2024-11-26 04:41:01.216835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.072 [2024-11-26 04:41:01.216866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:22139 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.072 [2024-11-26 04:41:01.216882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.072 [2024-11-26 04:41:01.228853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.072 [2024-11-26 04:41:01.228887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:23327 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.072 [2024-11-26 04:41:01.228905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.072 [2024-11-26 04:41:01.246483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.072 [2024-11-26 04:41:01.246517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:22204 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.072 [2024-11-26 04:41:01.246536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.072 [2024-11-26 04:41:01.263659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.072 [2024-11-26 04:41:01.263702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:19177 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.072 [2024-11-26 04:41:01.263736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.072 [2024-11-26 04:41:01.280424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.072 [2024-11-26 04:41:01.280458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:21047 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.072 [2024-11-26 04:41:01.280477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.331 [2024-11-26 04:41:01.296535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.331 [2024-11-26 04:41:01.296572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:25067 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.331 [2024-11-26 04:41:01.296592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.331 [2024-11-26 04:41:01.309128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.331 [2024-11-26 04:41:01.309163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13620 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.331 [2024-11-26 04:41:01.309182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.331 [2024-11-26 04:41:01.325362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.325399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:20508 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.325418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.341772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.341818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:7091 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.341835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.352934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.352981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1986 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.352999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.368966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.368994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19810 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.369027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.386618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.386652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:235 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.386670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.403948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.403979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:11398 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.404010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.421460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.421497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:13268 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.421516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.437096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.437131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:16372 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.437151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.448923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.448953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23138 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.448969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.466476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.466511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:20473 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.466530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.484124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.484160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:2184 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.484179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.499927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.499959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21068 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.499982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.512015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.512055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:25534 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.512074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.529527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.529562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:19713 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.529580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.332 [2024-11-26 04:41:01.545554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.332 [2024-11-26 04:41:01.545589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:10606 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.332 [2024-11-26 04:41:01.545608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.592 [2024-11-26 04:41:01.562842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.592 [2024-11-26 04:41:01.562876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9336 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.592 [2024-11-26 04:41:01.562894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.592 [2024-11-26 04:41:01.578577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.592 [2024-11-26 04:41:01.578607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19561 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.592 [2024-11-26 04:41:01.578622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.592 [2024-11-26 04:41:01.594353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.594383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:23624 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.594399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.609991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.610035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:10572 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.610051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.625503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.625543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:16183 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.625559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.640918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.640947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:22015 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.640963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.656532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.656576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:4644 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.656593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.671944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.671974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:3093 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.672005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.687347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.687375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:20985 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.687390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.702787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.702816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:10827 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.702832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.718132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.718160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4253 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.718175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.733513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.733541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:2284 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.733557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.749200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.749228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:4318 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.749243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.764930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.764971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:18761 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.764998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.780312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.780356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:11625 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.780372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.795833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.795863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:21540 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.795888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.593 [2024-11-26 04:41:01.810233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.593 [2024-11-26 04:41:01.810266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:12981 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.593 [2024-11-26 04:41:01.810283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.854 [2024-11-26 04:41:01.820738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.854 [2024-11-26 04:41:01.820768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:23333 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.854 [2024-11-26 04:41:01.820785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.854 [2024-11-26 04:41:01.837240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.854 [2024-11-26 04:41:01.837270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:14322 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.854 [2024-11-26 04:41:01.837301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.854 [2024-11-26 04:41:01.851736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.854 [2024-11-26 04:41:01.851767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:8514 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.854 [2024-11-26 04:41:01.851784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.854 [2024-11-26 04:41:01.867553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.854 [2024-11-26 04:41:01.867585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:16126 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.854 [2024-11-26 04:41:01.867601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.854 [2024-11-26 04:41:01.877717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.854 [2024-11-26 04:41:01.877748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:6713 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.854 [2024-11-26 04:41:01.877780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.854 [2024-11-26 04:41:01.892966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.854 [2024-11-26 04:41:01.893003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:16206 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.854 [2024-11-26 04:41:01.893020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.854 [2024-11-26 04:41:01.908628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.854 [2024-11-26 04:41:01.908657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:21753 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.854 [2024-11-26 04:41:01.908697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.854 [2024-11-26 04:41:01.923922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.854 [2024-11-26 04:41:01.923953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:11238 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.854 [2024-11-26 04:41:01.923970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.855 [2024-11-26 04:41:01.938358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.855 [2024-11-26 04:41:01.938390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:21778 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.855 [2024-11-26 04:41:01.938406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.855 [2024-11-26 04:41:01.948708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.855 [2024-11-26 04:41:01.948737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:13380 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.855 [2024-11-26 04:41:01.948753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.855 [2024-11-26 04:41:01.964239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.855 [2024-11-26 04:41:01.964268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:16171 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.855 [2024-11-26 04:41:01.964284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.855 [2024-11-26 04:41:01.980487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.855 [2024-11-26 04:41:01.980516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:7248 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.855 [2024-11-26 04:41:01.980532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.855 [2024-11-26 04:41:01.996365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.855 [2024-11-26 04:41:01.996396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:7275 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.855 [2024-11-26 04:41:01.996413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.855 [2024-11-26 04:41:02.011950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.855 [2024-11-26 04:41:02.011979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21326 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.855 [2024-11-26 04:41:02.012011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.855 [2024-11-26 04:41:02.027532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.855 [2024-11-26 04:41:02.027561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11501 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.855 [2024-11-26 04:41:02.027577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.855 [2024-11-26 04:41:02.042998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.855 [2024-11-26 04:41:02.043026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:21962 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.855 [2024-11-26 04:41:02.043042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.855 [2024-11-26 04:41:02.058422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.855 [2024-11-26 04:41:02.058451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:4399 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.855 [2024-11-26 04:41:02.058466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.855 [2024-11-26 04:41:02.074206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:22.855 [2024-11-26 04:41:02.074235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:1681 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.855 [2024-11-26 04:41:02.074265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.090544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.090576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:5763 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.090593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.105905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.105936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:22164 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.105953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.121347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.121376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:24186 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.121393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.136626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.136655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14309 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.136694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.152116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.152146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:8542 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.152170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.167217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.167246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18332 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.167261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.182793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.182824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:11160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.182841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.198204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.198234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23249 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.198250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.212446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.212478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:13860 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.212495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.223535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.223579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:644 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.223596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.236377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.236406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:16899 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.236421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.252411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.252441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:8847 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.252457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.267959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.268002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:21160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.268018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.283816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.283849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:11161 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.283867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.299477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.114 [2024-11-26 04:41:02.299509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:872 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.114 [2024-11-26 04:41:02.299526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.114 [2024-11-26 04:41:02.309629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.115 [2024-11-26 04:41:02.309660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:6147 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.115 [2024-11-26 04:41:02.309707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.115 [2024-11-26 04:41:02.324312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.115 [2024-11-26 04:41:02.324341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:6125 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.115 [2024-11-26 04:41:02.324357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.373 [2024-11-26 04:41:02.339842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.373 [2024-11-26 04:41:02.339874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:14299 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.373 [2024-11-26 04:41:02.339891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.373 [2024-11-26 04:41:02.355482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.373 [2024-11-26 04:41:02.355513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:11170 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.373 [2024-11-26 04:41:02.355530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.373 [2024-11-26 04:41:02.370907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.373 [2024-11-26 04:41:02.370938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:16328 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.373 [2024-11-26 04:41:02.370970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.373 [2024-11-26 04:41:02.386464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.373 [2024-11-26 04:41:02.386493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:22567 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.373 [2024-11-26 04:41:02.386508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.373 [2024-11-26 04:41:02.401925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x23f9400) 00:29:23.373 [2024-11-26 04:41:02.401954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16123 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.373 [2024-11-26 04:41:02.401993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.373 00:29:23.373 Latency(us) 00:29:23.373 [2024-11-26T03:41:02.599Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:23.373 [2024-11-26T03:41:02.599Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:23.373 nvme0n1 : 2.05 16133.65 63.02 0.00 0.00 7767.19 3470.98 48739.37 00:29:23.373 [2024-11-26T03:41:02.599Z] =================================================================================================================== 00:29:23.373 [2024-11-26T03:41:02.599Z] Total : 16133.65 63.02 0.00 0.00 7767.19 3470.98 48739.37 00:29:23.373 0 00:29:23.373 04:41:02 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:23.373 04:41:02 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:23.373 04:41:02 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:23.373 | .driver_specific 00:29:23.373 | .nvme_error 00:29:23.373 | .status_code 00:29:23.373 | .command_transient_transport_error' 00:29:23.373 04:41:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:23.633 04:41:02 -- host/digest.sh@71 -- # (( 129 > 0 )) 00:29:23.633 04:41:02 -- host/digest.sh@73 -- # killprocess 3036675 00:29:23.633 04:41:02 -- common/autotest_common.sh@936 -- # '[' -z 3036675 ']' 00:29:23.633 04:41:02 -- common/autotest_common.sh@940 -- # kill -0 3036675 00:29:23.633 04:41:02 -- common/autotest_common.sh@941 -- # uname 00:29:23.633 04:41:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:23.633 04:41:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3036675 00:29:23.633 04:41:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:23.633 04:41:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:23.633 04:41:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3036675' 00:29:23.633 killing process with pid 3036675 00:29:23.633 04:41:02 -- common/autotest_common.sh@955 -- # kill 3036675 00:29:23.633 Received shutdown signal, test time was about 2.000000 seconds 00:29:23.633 00:29:23.633 Latency(us) 00:29:23.633 [2024-11-26T03:41:02.859Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:23.633 [2024-11-26T03:41:02.859Z] =================================================================================================================== 00:29:23.633 [2024-11-26T03:41:02.859Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:23.633 04:41:02 -- common/autotest_common.sh@960 -- # wait 3036675 00:29:23.892 04:41:02 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:23.892 04:41:02 -- host/digest.sh@54 -- # local rw bs qd 00:29:23.892 04:41:02 -- host/digest.sh@56 -- # rw=randread 00:29:23.892 04:41:02 -- host/digest.sh@56 -- # bs=131072 00:29:23.892 04:41:02 -- host/digest.sh@56 -- # qd=16 00:29:23.892 04:41:02 -- host/digest.sh@58 -- # bperfpid=3037231 00:29:23.892 04:41:02 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:23.892 04:41:02 -- host/digest.sh@60 -- # waitforlisten 3037231 /var/tmp/bperf.sock 00:29:23.892 04:41:02 -- common/autotest_common.sh@829 -- # '[' -z 3037231 ']' 00:29:23.892 04:41:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:23.892 04:41:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:23.892 04:41:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:23.892 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:23.892 04:41:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:23.892 04:41:02 -- common/autotest_common.sh@10 -- # set +x 00:29:23.892 [2024-11-26 04:41:03.033273] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:23.892 [2024-11-26 04:41:03.033358] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3037231 ] 00:29:23.892 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:23.892 Zero copy mechanism will not be used. 00:29:23.892 EAL: No free 2048 kB hugepages reported on node 1 00:29:23.892 [2024-11-26 04:41:03.093738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:24.151 [2024-11-26 04:41:03.179899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:25.089 04:41:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:25.089 04:41:04 -- common/autotest_common.sh@862 -- # return 0 00:29:25.089 04:41:04 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:25.089 04:41:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:25.089 04:41:04 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:25.089 04:41:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.089 04:41:04 -- common/autotest_common.sh@10 -- # set +x 00:29:25.089 04:41:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.089 04:41:04 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:25.089 04:41:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:25.655 nvme0n1 00:29:25.655 04:41:04 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:25.655 04:41:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.655 04:41:04 -- common/autotest_common.sh@10 -- # set +x 00:29:25.655 04:41:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.655 04:41:04 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:25.655 04:41:04 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:25.916 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:25.916 Zero copy mechanism will not be used. 00:29:25.916 Running I/O for 2 seconds... 00:29:25.916 [2024-11-26 04:41:04.960521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.916 [2024-11-26 04:41:04.960578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.916 [2024-11-26 04:41:04.960611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.916 [2024-11-26 04:41:04.967844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.916 [2024-11-26 04:41:04.967878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.916 [2024-11-26 04:41:04.967898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.916 [2024-11-26 04:41:04.974165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.916 [2024-11-26 04:41:04.974210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.916 [2024-11-26 04:41:04.974230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.916 [2024-11-26 04:41:04.980521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.916 [2024-11-26 04:41:04.980563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.916 [2024-11-26 04:41:04.980583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.916 [2024-11-26 04:41:04.986934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.916 [2024-11-26 04:41:04.986972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.916 [2024-11-26 04:41:04.987007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.916 [2024-11-26 04:41:04.992611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.916 [2024-11-26 04:41:04.992645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.916 [2024-11-26 04:41:04.992664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.916 [2024-11-26 04:41:04.998868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.916 [2024-11-26 04:41:04.998899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.916 [2024-11-26 04:41:04.998916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.916 [2024-11-26 04:41:05.004560] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.916 [2024-11-26 04:41:05.004595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.916 [2024-11-26 04:41:05.004615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.916 [2024-11-26 04:41:05.010711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.916 [2024-11-26 04:41:05.010765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.916 [2024-11-26 04:41:05.010782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.916 [2024-11-26 04:41:05.016745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.916 [2024-11-26 04:41:05.016775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.916 [2024-11-26 04:41:05.016792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.916 [2024-11-26 04:41:05.022798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.916 [2024-11-26 04:41:05.022827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.916 [2024-11-26 04:41:05.022844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.916 [2024-11-26 04:41:05.028757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.916 [2024-11-26 04:41:05.028787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.916 [2024-11-26 04:41:05.028803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.916 [2024-11-26 04:41:05.035002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.035037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.035056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.041218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.041254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.041273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.047260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.047295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.047315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.053470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.053505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.053524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.059568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.059602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.059621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.065397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.065430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.065449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.071313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.071348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.071367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.077256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.077290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.077309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.083204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.083238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.083256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.089024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.089069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.089096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.095072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.095106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.095125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.101268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.101303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.101321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.107182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.107216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.107235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.113175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.113208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.113227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.119253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.119286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.119306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.125190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.125224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.125243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.131055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.131083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.131099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.917 [2024-11-26 04:41:05.136988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:25.917 [2024-11-26 04:41:05.137022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.917 [2024-11-26 04:41:05.137041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.143053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.143094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.143115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.148830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.148861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.148877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.154463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.154496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.154515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.160184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.160218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.160236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.166164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.166197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.166216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.171997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.172026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.172060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.178199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.178232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.178251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.184188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.184220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.184239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.189945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.189975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.189992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.195864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.195892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.195908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.201673] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.201716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.201749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.207318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.207350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.207368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.213097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.213129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.213148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.218966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.219010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.219027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.224858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.224888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.224905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.230942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.230990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.231007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.236630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.236662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.236680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.242272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.242306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.242331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.248269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.248302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.248320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.254123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.254155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.254175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.260175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.260207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.260226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.266002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.266036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.266055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.271911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.271941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.271958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.277918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.277947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.277978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.283554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.283587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.283606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.289330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.289363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.289382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.295114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.295146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.295165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.301185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.179 [2024-11-26 04:41:05.301217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.179 [2024-11-26 04:41:05.301236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.179 [2024-11-26 04:41:05.306938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.306981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.306996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.313044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.313072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.313088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.319131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.319164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.319183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.324864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.324893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.324909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.330657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.330696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.330732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.336344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.336376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.336394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.342068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.342100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.342125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.348154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.348188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.348207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.353938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.353969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.354003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.360090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.360122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.360141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.366158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.366191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.366210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.372043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.372076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.372095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.378049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.378095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.378114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.384017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.384050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.384069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.390011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.390044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.390062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.180 [2024-11-26 04:41:05.395783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.180 [2024-11-26 04:41:05.395818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.180 [2024-11-26 04:41:05.395836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.401385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.401419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.401438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.406957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.407006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.407025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.413042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.413075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.413094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.418963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.419010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.419029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.424664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.424704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.424739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.430347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.430380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.430398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.436146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.436179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.436197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.442206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.442239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.442258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.448173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.448206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.448225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.453922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.453951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.453985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.459607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.459640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.459659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.465363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.465397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.465416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.471245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.471279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.471297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.477103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.477136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.477155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.483151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.483183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.483201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.489137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.489170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.489189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.494518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.494562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.494582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.500399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.500431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.500450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.506201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.506233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-11-26 04:41:05.506251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.441 [2024-11-26 04:41:05.511817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.441 [2024-11-26 04:41:05.511847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.511865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.517666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.517711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.517746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.523311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.523343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.523362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.529150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.529182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.529200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.534964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.534992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.535023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.540816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.540844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.540860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.546547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.546584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.546603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.552235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.552267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.552285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.558170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.558203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.558222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.564089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.564122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.564141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.569957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.570004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.570022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.575988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.576034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.576053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.581809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.581838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.581869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.587475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.587507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.587526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.593132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.593165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.593183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.599065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.599097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.599115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.604769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.604798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.604814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.610868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.610897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.610914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.616465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.616497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.616515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.622412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.622445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.622463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.628383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.628416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.628435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.634097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.634129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-11-26 04:41:05.634148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.442 [2024-11-26 04:41:05.640179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.442 [2024-11-26 04:41:05.640212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.443 [2024-11-26 04:41:05.640231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.443 [2024-11-26 04:41:05.646241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.443 [2024-11-26 04:41:05.646274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.443 [2024-11-26 04:41:05.646308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.443 [2024-11-26 04:41:05.652075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.443 [2024-11-26 04:41:05.652107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.443 [2024-11-26 04:41:05.652126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.443 [2024-11-26 04:41:05.657935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.443 [2024-11-26 04:41:05.657966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.443 [2024-11-26 04:41:05.657988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.702 [2024-11-26 04:41:05.663808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.702 [2024-11-26 04:41:05.663838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-11-26 04:41:05.663869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.702 [2024-11-26 04:41:05.669418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.702 [2024-11-26 04:41:05.669451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-11-26 04:41:05.669470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.702 [2024-11-26 04:41:05.675216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.702 [2024-11-26 04:41:05.675248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-11-26 04:41:05.675267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.702 [2024-11-26 04:41:05.681179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.702 [2024-11-26 04:41:05.681210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-11-26 04:41:05.681229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.702 [2024-11-26 04:41:05.686996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.687029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.687047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.692933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.692977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.692994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.698557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.698596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.698615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.704427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.704459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.704479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.710301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.710334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.710352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.716209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.716240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.716259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.722939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.722970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.723004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.729886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.729917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.729936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.737442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.737476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.737495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.745499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.745533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.745552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.753286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.753320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.753339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.761213] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.761247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.761267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.769094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.769129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.769149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.777238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.777273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.777292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.783650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.783693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.783717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.790744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.790775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.790795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.798749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.798794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.798812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.806261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.806296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.806316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.813710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.813757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.813775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.821948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.822007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.822034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.829931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.829978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.829998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.837143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.837179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.837209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.844870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.844902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.844919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.852670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.852715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.852750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.861302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.861337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.861367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.867362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.867398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.867418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.872725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.703 [2024-11-26 04:41:05.872756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.703 [2024-11-26 04:41:05.872776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.703 [2024-11-26 04:41:05.878627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.704 [2024-11-26 04:41:05.878661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.704 [2024-11-26 04:41:05.878681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.704 [2024-11-26 04:41:05.885379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.704 [2024-11-26 04:41:05.885419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.704 [2024-11-26 04:41:05.885439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.704 [2024-11-26 04:41:05.892615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.704 [2024-11-26 04:41:05.892650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.704 [2024-11-26 04:41:05.892669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.704 [2024-11-26 04:41:05.899575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.704 [2024-11-26 04:41:05.899609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.704 [2024-11-26 04:41:05.899632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.704 [2024-11-26 04:41:05.905253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.704 [2024-11-26 04:41:05.905287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.704 [2024-11-26 04:41:05.905305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.704 [2024-11-26 04:41:05.911055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.704 [2024-11-26 04:41:05.911087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.704 [2024-11-26 04:41:05.911107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.704 [2024-11-26 04:41:05.916985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.704 [2024-11-26 04:41:05.917032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.704 [2024-11-26 04:41:05.917051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.704 [2024-11-26 04:41:05.922983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.704 [2024-11-26 04:41:05.923028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.704 [2024-11-26 04:41:05.923045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.929023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.929058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.963 [2024-11-26 04:41:05.929081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.935095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.935129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.963 [2024-11-26 04:41:05.935155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.940988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.941036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.963 [2024-11-26 04:41:05.941055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.946966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.947014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.963 [2024-11-26 04:41:05.947033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.952335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.952368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.963 [2024-11-26 04:41:05.952386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.958285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.958318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.963 [2024-11-26 04:41:05.958339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.964361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.964395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.963 [2024-11-26 04:41:05.964419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.970274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.970308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.963 [2024-11-26 04:41:05.970328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.976376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.976409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.963 [2024-11-26 04:41:05.976436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.982295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.982329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.963 [2024-11-26 04:41:05.982349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.988451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.988485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.963 [2024-11-26 04:41:05.988510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.994406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.994440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.963 [2024-11-26 04:41:05.994459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.963 [2024-11-26 04:41:05.999933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.963 [2024-11-26 04:41:05.999963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:05.999981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.005502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.005536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.005556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.011618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.011653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.011673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.017795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.017827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.017844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.023659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.023735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.023755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.029601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.029635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.029655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.035487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.035522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.035543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.041332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.041365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.041385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.047268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.047302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.047321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.053217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.053253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.053271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.059422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.059456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.059485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.064643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.064696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.064733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.070210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.070254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.070273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.073817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.073846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.073862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.080048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.080096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.080120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.085959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.086008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.086029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.091973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.092021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.092040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.097713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.097756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.097773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.103429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.103461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.103480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.109136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.109168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.109188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.115004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.115034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.115073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.120970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.121014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.121030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.126832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.126860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.126876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.132663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.132703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.132738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.138421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.138460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.138480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.144332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.144364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.144382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.150268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.964 [2024-11-26 04:41:06.150300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.964 [2024-11-26 04:41:06.150319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.964 [2024-11-26 04:41:06.156332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.965 [2024-11-26 04:41:06.156364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.965 [2024-11-26 04:41:06.156384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.965 [2024-11-26 04:41:06.162233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.965 [2024-11-26 04:41:06.162265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.965 [2024-11-26 04:41:06.162284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.965 [2024-11-26 04:41:06.168092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.965 [2024-11-26 04:41:06.168124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.965 [2024-11-26 04:41:06.168143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.965 [2024-11-26 04:41:06.174027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.965 [2024-11-26 04:41:06.174070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.965 [2024-11-26 04:41:06.174089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.965 [2024-11-26 04:41:06.180148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:26.965 [2024-11-26 04:41:06.180184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.965 [2024-11-26 04:41:06.180203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.186349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.186384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.186406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.192441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.192475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.192495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.198313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.198346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.198365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.204260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.204293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.204312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.210046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.210079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.210097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.216093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.216126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.216146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.222183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.222216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.222234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.228180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.228213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.228231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.234201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.234234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.234253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.240234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.240266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.240298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.246285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.246318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.246337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.252357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.252390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.252408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.258204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.258236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.258256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.264250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.264282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.264301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.270294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.270327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.270346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.276228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.276260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.276278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.282017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.282063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.282082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.287755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.287783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.287804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.293639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.293677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.293709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.299318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.299350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.299375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.305159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.226 [2024-11-26 04:41:06.305190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.226 [2024-11-26 04:41:06.305208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.226 [2024-11-26 04:41:06.311219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.311251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.311271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.317061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.317094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.317116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.322798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.322826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.322842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.328582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.328615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.328633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.334219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.334252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.334271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.340357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.340390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.340409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.346378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.346411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.346431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.352357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.352390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.352409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.358230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.358261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.358285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.364171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.364203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.364221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.370256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.370290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.370313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.376112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.376144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.376164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.382094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.382124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.382141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.388009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.388056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.388075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.394139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.394172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.394198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.400357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.400391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.400410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.406340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.406374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.406393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.412216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.412250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.412269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.418047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.418079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.418098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.424039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.424072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.424090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.431260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.431295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.431316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.227 [2024-11-26 04:41:06.439105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.227 [2024-11-26 04:41:06.439140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.227 [2024-11-26 04:41:06.439160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.447339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.447375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.447396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.455188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.455223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.455242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.463103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.463137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.463157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.471047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.471082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.471102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.479727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.479775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.479793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.486735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.486781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.486799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.494881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.494912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.494930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.502292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.502327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.502346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.509062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.509097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.509116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.516915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.516945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.516982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.524882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.524928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.524945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.532889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.532920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.532951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.540025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.540074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.540094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.546834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.546865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.546882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.553303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.553339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.553358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.559799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.559843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.559859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.567059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.490 [2024-11-26 04:41:06.567093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.490 [2024-11-26 04:41:06.567112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.490 [2024-11-26 04:41:06.574986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.575034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.575054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.583085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.583125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.583146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.590681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.590736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.590752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.597316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.597351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.597370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.604914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.604959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.604976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.611636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.611670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.611698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.619292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.619326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.619346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.626954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.626986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.627020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.634557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.634592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.634611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.641248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.641283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.641302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.647706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.647753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.647798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.655533] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.655568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.655587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.663034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.663069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.663089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.670255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.670289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.670309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.676824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.676875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.676892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.683528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.683561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.683580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.689423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.689457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.689476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.695391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.695424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.695442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.701251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.701284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.701310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.491 [2024-11-26 04:41:06.707167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.491 [2024-11-26 04:41:06.707201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.491 [2024-11-26 04:41:06.707220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.751 [2024-11-26 04:41:06.712981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.751 [2024-11-26 04:41:06.713036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.751 [2024-11-26 04:41:06.713055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.751 [2024-11-26 04:41:06.718861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.751 [2024-11-26 04:41:06.718892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.751 [2024-11-26 04:41:06.718910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.751 [2024-11-26 04:41:06.724869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.751 [2024-11-26 04:41:06.724900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.751 [2024-11-26 04:41:06.724917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.751 [2024-11-26 04:41:06.730576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.751 [2024-11-26 04:41:06.730609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.751 [2024-11-26 04:41:06.730628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.736499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.736533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.736552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.742399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.742432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.742452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.748135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.748168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.748186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.753871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.753907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.753925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.759919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.759949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.759966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.765822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.765852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.765869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.771599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.771632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.771651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.777444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.777476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.777494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.783256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.783289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.783308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.789116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.789149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.789167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.795122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.795154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.795173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.801051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.801084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.801102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.807173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.807207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.807226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.813252] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.813286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.813305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.819442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.819478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.819497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.825249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.825284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.825303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.831253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.831287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.831308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.837334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.837369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.837388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.843307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.843341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.843360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.849378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.849411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.849430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.855112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.855145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.855171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.752 [2024-11-26 04:41:06.861158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.752 [2024-11-26 04:41:06.861192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.752 [2024-11-26 04:41:06.861211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.867320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.867353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.867372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.873390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.873424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.873443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.877996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.878030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.878049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.883633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.883667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.883695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.889985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.890030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.890049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.896571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.896605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.896624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.903045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.903080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.903099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.908735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.908767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.908784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.914429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.914473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.914493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.920916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.920948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.920966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.928311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.928345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.928365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.935761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.935792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.935809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.943169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.943203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.943223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.753 [2024-11-26 04:41:06.950473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75a2f0) 00:29:27.753 [2024-11-26 04:41:06.950507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.753 [2024-11-26 04:41:06.950527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.753 00:29:27.753 Latency(us) 00:29:27.753 [2024-11-26T03:41:06.979Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:27.753 [2024-11-26T03:41:06.979Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:27.753 nvme0n1 : 2.00 4996.61 624.58 0.00 0.00 3198.30 597.71 11553.75 00:29:27.753 [2024-11-26T03:41:06.979Z] =================================================================================================================== 00:29:27.753 [2024-11-26T03:41:06.979Z] Total : 4996.61 624.58 0.00 0.00 3198.30 597.71 11553.75 00:29:27.753 0 00:29:27.753 04:41:06 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:28.012 04:41:06 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:28.012 04:41:06 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:28.012 | .driver_specific 00:29:28.012 | .nvme_error 00:29:28.012 | .status_code 00:29:28.012 | .command_transient_transport_error' 00:29:28.012 04:41:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:28.270 04:41:07 -- host/digest.sh@71 -- # (( 322 > 0 )) 00:29:28.270 04:41:07 -- host/digest.sh@73 -- # killprocess 3037231 00:29:28.270 04:41:07 -- common/autotest_common.sh@936 -- # '[' -z 3037231 ']' 00:29:28.270 04:41:07 -- common/autotest_common.sh@940 -- # kill -0 3037231 00:29:28.270 04:41:07 -- common/autotest_common.sh@941 -- # uname 00:29:28.270 04:41:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:28.270 04:41:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3037231 00:29:28.270 04:41:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:28.270 04:41:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:28.270 04:41:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3037231' 00:29:28.270 killing process with pid 3037231 00:29:28.270 04:41:07 -- common/autotest_common.sh@955 -- # kill 3037231 00:29:28.270 Received shutdown signal, test time was about 2.000000 seconds 00:29:28.270 00:29:28.270 Latency(us) 00:29:28.270 [2024-11-26T03:41:07.496Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:28.270 [2024-11-26T03:41:07.496Z] =================================================================================================================== 00:29:28.270 [2024-11-26T03:41:07.496Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:28.270 04:41:07 -- common/autotest_common.sh@960 -- # wait 3037231 00:29:28.528 04:41:07 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:28.528 04:41:07 -- host/digest.sh@54 -- # local rw bs qd 00:29:28.528 04:41:07 -- host/digest.sh@56 -- # rw=randwrite 00:29:28.528 04:41:07 -- host/digest.sh@56 -- # bs=4096 00:29:28.528 04:41:07 -- host/digest.sh@56 -- # qd=128 00:29:28.528 04:41:07 -- host/digest.sh@58 -- # bperfpid=3037785 00:29:28.528 04:41:07 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:28.528 04:41:07 -- host/digest.sh@60 -- # waitforlisten 3037785 /var/tmp/bperf.sock 00:29:28.528 04:41:07 -- common/autotest_common.sh@829 -- # '[' -z 3037785 ']' 00:29:28.528 04:41:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:28.528 04:41:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:28.528 04:41:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:28.528 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:28.528 04:41:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:28.528 04:41:07 -- common/autotest_common.sh@10 -- # set +x 00:29:28.528 [2024-11-26 04:41:07.538273] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:28.528 [2024-11-26 04:41:07.538360] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3037785 ] 00:29:28.528 EAL: No free 2048 kB hugepages reported on node 1 00:29:28.529 [2024-11-26 04:41:07.604009] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:28.529 [2024-11-26 04:41:07.692204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:29.464 04:41:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:29.464 04:41:08 -- common/autotest_common.sh@862 -- # return 0 00:29:29.464 04:41:08 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:29.464 04:41:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:29.722 04:41:08 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:29.723 04:41:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.723 04:41:08 -- common/autotest_common.sh@10 -- # set +x 00:29:29.723 04:41:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.723 04:41:08 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:29.723 04:41:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:29.981 nvme0n1 00:29:29.981 04:41:09 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:29.981 04:41:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.981 04:41:09 -- common/autotest_common.sh@10 -- # set +x 00:29:29.981 04:41:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.981 04:41:09 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:29.981 04:41:09 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:30.239 Running I/O for 2 seconds... 00:29:30.239 [2024-11-26 04:41:09.266950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ee5c8 00:29:30.239 [2024-11-26 04:41:09.268266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:7161 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.239 [2024-11-26 04:41:09.268308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:29:30.239 [2024-11-26 04:41:09.279613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ea248 00:29:30.239 [2024-11-26 04:41:09.280443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:7129 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.239 [2024-11-26 04:41:09.280478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:30.239 [2024-11-26 04:41:09.292097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f2d80 00:29:30.239 [2024-11-26 04:41:09.292662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:4337 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.239 [2024-11-26 04:41:09.292702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:30.239 [2024-11-26 04:41:09.303900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e88f8 00:29:30.239 [2024-11-26 04:41:09.304418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:21604 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.239 [2024-11-26 04:41:09.304448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:29:30.239 [2024-11-26 04:41:09.316893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e88f8 00:29:30.239 [2024-11-26 04:41:09.318172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24710 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.239 [2024-11-26 04:41:09.318217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:30.239 [2024-11-26 04:41:09.326874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f5be8 00:29:30.239 [2024-11-26 04:41:09.327228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:17284 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.239 [2024-11-26 04:41:09.327273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:29:30.239 [2024-11-26 04:41:09.338467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0788 00:29:30.239 [2024-11-26 04:41:09.338743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:12759 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.239 [2024-11-26 04:41:09.338773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:29:30.240 [2024-11-26 04:41:09.349909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f7da8 00:29:30.240 [2024-11-26 04:41:09.350153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:13953 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.240 [2024-11-26 04:41:09.350184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:29:30.240 [2024-11-26 04:41:09.361220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e2c28 00:29:30.240 [2024-11-26 04:41:09.361533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:4572 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.240 [2024-11-26 04:41:09.361564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:29:30.240 [2024-11-26 04:41:09.374375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f35f0 00:29:30.240 [2024-11-26 04:41:09.376101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:14062 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.240 [2024-11-26 04:41:09.376132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.240 [2024-11-26 04:41:09.384534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f6cc8 00:29:30.240 [2024-11-26 04:41:09.385497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:17936 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.240 [2024-11-26 04:41:09.385525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:30.240 [2024-11-26 04:41:09.395988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e5a90 00:29:30.240 [2024-11-26 04:41:09.397781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:8924 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.240 [2024-11-26 04:41:09.397811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.240 [2024-11-26 04:41:09.407433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f1868 00:29:30.240 [2024-11-26 04:41:09.408636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:12841 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.240 [2024-11-26 04:41:09.408663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.240 [2024-11-26 04:41:09.417613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f1ca0 00:29:30.240 [2024-11-26 04:41:09.418670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:16399 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.240 [2024-11-26 04:41:09.418710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:29:30.240 [2024-11-26 04:41:09.428943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e01f8 00:29:30.240 [2024-11-26 04:41:09.430066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:17601 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.240 [2024-11-26 04:41:09.430096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:29:30.240 [2024-11-26 04:41:09.440395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190df988 00:29:30.240 [2024-11-26 04:41:09.441545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:17958 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.240 [2024-11-26 04:41:09.441582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:30.240 [2024-11-26 04:41:09.452255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f57b0 00:29:30.240 [2024-11-26 04:41:09.452933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:20235 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.240 [2024-11-26 04:41:09.452977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.463810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f3e60 00:29:30.501 [2024-11-26 04:41:09.464158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:12242 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.464192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.475322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0350 00:29:30.501 [2024-11-26 04:41:09.475614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:14208 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.475644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.488605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e0a68 00:29:30.501 [2024-11-26 04:41:09.490309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:25345 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.490352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.499850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e4de8 00:29:30.501 [2024-11-26 04:41:09.501312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20367 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.501342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.511320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e5220 00:29:30.501 [2024-11-26 04:41:09.513010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:16401 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.513040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.523119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f8e88 00:29:30.501 [2024-11-26 04:41:09.524383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:3153 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.524411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.533374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ecc78 00:29:30.501 [2024-11-26 04:41:09.534332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:3070 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.534362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.544232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eea00 00:29:30.501 [2024-11-26 04:41:09.545232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:5683 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.545261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.555792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0ff8 00:29:30.501 [2024-11-26 04:41:09.556809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:24979 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.556839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.567171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ef6a8 00:29:30.501 [2024-11-26 04:41:09.568172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:8107 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.568203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.578532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.501 [2024-11-26 04:41:09.579578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:9629 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.579609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.589812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e0ea0 00:29:30.501 [2024-11-26 04:41:09.590869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:4836 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.590900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.601296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ef270 00:29:30.501 [2024-11-26 04:41:09.601574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:25108 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.601602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.613166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.501 [2024-11-26 04:41:09.614213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:627 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.501 [2024-11-26 04:41:09.614242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.501 [2024-11-26 04:41:09.624920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.501 [2024-11-26 04:41:09.625934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:22610 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.502 [2024-11-26 04:41:09.625964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:29:30.502 [2024-11-26 04:41:09.636858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.502 [2024-11-26 04:41:09.637879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:3328 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.502 [2024-11-26 04:41:09.637909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:29:30.502 [2024-11-26 04:41:09.648787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.502 [2024-11-26 04:41:09.649836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:3645 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.502 [2024-11-26 04:41:09.649866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:30.502 [2024-11-26 04:41:09.660661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.502 [2024-11-26 04:41:09.661679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:21502 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.502 [2024-11-26 04:41:09.661715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:30.502 [2024-11-26 04:41:09.672620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.502 [2024-11-26 04:41:09.673661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:22141 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.502 [2024-11-26 04:41:09.673699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:30.502 [2024-11-26 04:41:09.684672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.502 [2024-11-26 04:41:09.685757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:5461 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.502 [2024-11-26 04:41:09.685785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:30.502 [2024-11-26 04:41:09.696717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.502 [2024-11-26 04:41:09.697787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:18343 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.502 [2024-11-26 04:41:09.697817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:30.502 [2024-11-26 04:41:09.708612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.502 [2024-11-26 04:41:09.709682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:16403 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.502 [2024-11-26 04:41:09.709736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:30.502 [2024-11-26 04:41:09.720497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.502 [2024-11-26 04:41:09.721547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:10864 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.502 [2024-11-26 04:41:09.721577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:30.763 [2024-11-26 04:41:09.732391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.764 [2024-11-26 04:41:09.733592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:12318 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.733622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.744420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.764 [2024-11-26 04:41:09.745638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:2779 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.745675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.756487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.764 [2024-11-26 04:41:09.757676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:17637 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.757726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.768408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.764 [2024-11-26 04:41:09.769654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:6251 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.769683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.780355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.764 [2024-11-26 04:41:09.781552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:18188 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.781582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.792107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.764 [2024-11-26 04:41:09.793362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:340 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.793405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.804031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:30.764 [2024-11-26 04:41:09.805203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:8477 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.805246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.815206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f7100 00:29:30.764 [2024-11-26 04:41:09.816322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:9378 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.816352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.826768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.827544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:11065 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.827586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.838648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.839633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:22393 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.839663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.850448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.851462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:3533 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.851493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.862518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.863510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:13622 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.863539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.874417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.875519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:1845 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.875550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.886386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.887523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:25254 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.887553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.898378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.899429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:10364 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.899459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.910441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.911556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:56 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.911586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.922419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.923501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:5373 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.923531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.934421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.935477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:18212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.935507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.946410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.947587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:18720 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.947617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.958354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.959464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:18856 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.959494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.970365] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.971588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:21502 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.971618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:30.764 [2024-11-26 04:41:09.982415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:30.764 [2024-11-26 04:41:09.983659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:23084 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.764 [2024-11-26 04:41:09.983695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:31.025 [2024-11-26 04:41:09.994460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:31.026 [2024-11-26 04:41:09.995636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:9245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:09.995665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.006462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:31.026 [2024-11-26 04:41:10.007701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:19834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.007748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.018374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:31.026 [2024-11-26 04:41:10.019556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:14102 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.019603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.030191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f4b08 00:29:31.026 [2024-11-26 04:41:10.030533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:3047 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.030567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.042096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.043110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:17482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.043143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.054146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.055067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:8589 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.055111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.065845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.066864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:4755 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.066894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.078069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.079121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:20849 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.079151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.090270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.091347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:237 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.091378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.102397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.103413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:949 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.103443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.114451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.115562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:18992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.115591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.126409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.127475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:25295 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.127505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.138363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.139401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:5049 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.139446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.150318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.151474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:25522 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.151504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.162346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.163572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:5917 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.163600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.174329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.175522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:6398 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.175552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.186298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.187460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9942 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.187490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.198205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.199362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:20790 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.199392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.210046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.211245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:1527 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.211290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.221881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.223139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:16359 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.223181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.233678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8088 00:29:31.026 [2024-11-26 04:41:10.234855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:18136 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.234898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:31.026 [2024-11-26 04:41:10.244872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:31.026 [2024-11-26 04:41:10.246002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:8674 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.026 [2024-11-26 04:41:10.246032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:29:31.288 [2024-11-26 04:41:10.256775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ec840 00:29:31.288 [2024-11-26 04:41:10.257482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:1226 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.288 [2024-11-26 04:41:10.257525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:31.288 [2024-11-26 04:41:10.268654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0350 00:29:31.288 [2024-11-26 04:41:10.269478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:10340 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.288 [2024-11-26 04:41:10.269508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:31.288 [2024-11-26 04:41:10.279807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f3a28 00:29:31.288 [2024-11-26 04:41:10.281177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:19654 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.288 [2024-11-26 04:41:10.281221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:31.288 [2024-11-26 04:41:10.291118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eff18 00:29:31.288 [2024-11-26 04:41:10.292138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:841 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.288 [2024-11-26 04:41:10.292168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:29:31.288 [2024-11-26 04:41:10.303791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eb328 00:29:31.288 [2024-11-26 04:41:10.304973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:16662 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.288 [2024-11-26 04:41:10.305021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:31.288 [2024-11-26 04:41:10.317153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eb328 00:29:31.288 [2024-11-26 04:41:10.318632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:25148 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.288 [2024-11-26 04:41:10.318664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:31.288 [2024-11-26 04:41:10.329707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f9f68 00:29:31.288 [2024-11-26 04:41:10.330770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:3091 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.288 [2024-11-26 04:41:10.330815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:31.288 [2024-11-26 04:41:10.341949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0788 00:29:31.288 [2024-11-26 04:41:10.342752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:8425 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.288 [2024-11-26 04:41:10.342795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:31.288 [2024-11-26 04:41:10.354161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f6458 00:29:31.288 [2024-11-26 04:41:10.354894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:17863 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.288 [2024-11-26 04:41:10.354922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:29:31.288 [2024-11-26 04:41:10.366282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ea680 00:29:31.289 [2024-11-26 04:41:10.366953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:1579 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.289 [2024-11-26 04:41:10.366986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:31.289 [2024-11-26 04:41:10.378583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e6b70 00:29:31.289 [2024-11-26 04:41:10.379270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:15526 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.289 [2024-11-26 04:41:10.379303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:31.289 [2024-11-26 04:41:10.390941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e3d08 00:29:31.289 [2024-11-26 04:41:10.391511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:21048 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.289 [2024-11-26 04:41:10.391539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:31.289 [2024-11-26 04:41:10.403126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0788 00:29:31.289 [2024-11-26 04:41:10.403731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:16699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.289 [2024-11-26 04:41:10.403761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:31.289 [2024-11-26 04:41:10.415369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f57b0 00:29:31.289 [2024-11-26 04:41:10.415934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:4057 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.289 [2024-11-26 04:41:10.415969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:31.289 [2024-11-26 04:41:10.427531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190fc560 00:29:31.289 [2024-11-26 04:41:10.428045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:213 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.289 [2024-11-26 04:41:10.428073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:31.289 [2024-11-26 04:41:10.439804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0ff8 00:29:31.289 [2024-11-26 04:41:10.440251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:21652 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.289 [2024-11-26 04:41:10.440279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:31.289 [2024-11-26 04:41:10.451734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ebb98 00:29:31.289 [2024-11-26 04:41:10.452186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:10047 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.289 [2024-11-26 04:41:10.452217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:29:31.289 [2024-11-26 04:41:10.463927] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e27f0 00:29:31.289 [2024-11-26 04:41:10.464417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:3041 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.289 [2024-11-26 04:41:10.464447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:29:31.289 [2024-11-26 04:41:10.475994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0788 00:29:31.289 [2024-11-26 04:41:10.476581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:7014 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.289 [2024-11-26 04:41:10.476614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.289 [2024-11-26 04:41:10.488078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190fc998 00:29:31.289 [2024-11-26 04:41:10.489532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:20817 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.289 [2024-11-26 04:41:10.489566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.289 [2024-11-26 04:41:10.500356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e3498 00:29:31.289 [2024-11-26 04:41:10.501788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:785 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.289 [2024-11-26 04:41:10.501815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.512542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190fc128 00:29:31.550 [2024-11-26 04:41:10.513606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:9675 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.513642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.525300] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e5ec8 00:29:31.550 [2024-11-26 04:41:10.526598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:20877 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.526632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.538456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e5ec8 00:29:31.550 [2024-11-26 04:41:10.540050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:19376 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.540080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.551520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:31.550 [2024-11-26 04:41:10.552817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:7517 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.552844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.562283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0bc0 00:29:31.550 [2024-11-26 04:41:10.563258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:10768 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.563290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.574723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190df988 00:29:31.550 [2024-11-26 04:41:10.575651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:8430 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.575695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.587193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ebb98 00:29:31.550 [2024-11-26 04:41:10.588144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:5856 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.588173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.599218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0350 00:29:31.550 [2024-11-26 04:41:10.600207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:4675 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.600240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.611763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f8618 00:29:31.550 [2024-11-26 04:41:10.612709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:9245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.612752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.623460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190df988 00:29:31.550 [2024-11-26 04:41:10.624454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:12707 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.624489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.635700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190fbcf0 00:29:31.550 [2024-11-26 04:41:10.636678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:10245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.636722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.647851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f2d80 00:29:31.550 [2024-11-26 04:41:10.648844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:847 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.648885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.659945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ef6a8 00:29:31.550 [2024-11-26 04:41:10.660954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:7240 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.660999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.672160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f35f0 00:29:31.550 [2024-11-26 04:41:10.673176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:18478 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.550 [2024-11-26 04:41:10.673207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:003a p:0 m:0 dnr:0 00:29:31.550 [2024-11-26 04:41:10.684302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0bc0 00:29:31.550 [2024-11-26 04:41:10.685344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:9264 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.551 [2024-11-26 04:41:10.685383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:29:31.551 [2024-11-26 04:41:10.696972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f57b0 00:29:31.551 [2024-11-26 04:41:10.697637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:382 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.551 [2024-11-26 04:41:10.697668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:29:31.551 [2024-11-26 04:41:10.709636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190fd640 00:29:31.551 [2024-11-26 04:41:10.710418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16859 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.551 [2024-11-26 04:41:10.710450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:31.551 [2024-11-26 04:41:10.721676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f35f0 00:29:31.551 [2024-11-26 04:41:10.722934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:2949 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.551 [2024-11-26 04:41:10.722975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:31.551 [2024-11-26 04:41:10.733999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e8d30 00:29:31.551 [2024-11-26 04:41:10.735261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:21091 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.551 [2024-11-26 04:41:10.735293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:31.551 [2024-11-26 04:41:10.747135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1710 00:29:31.551 [2024-11-26 04:41:10.748537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:9023 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.551 [2024-11-26 04:41:10.748568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:31.551 [2024-11-26 04:41:10.759566] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f5378 00:29:31.551 [2024-11-26 04:41:10.760548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:11536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.551 [2024-11-26 04:41:10.760580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.771860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ecc78 00:29:31.812 [2024-11-26 04:41:10.772574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:12047 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.772607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.784195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e2c28 00:29:31.812 [2024-11-26 04:41:10.784880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:2446 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.784921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.796333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eaef0 00:29:31.812 [2024-11-26 04:41:10.796956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:6767 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.796984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.808481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f81e0 00:29:31.812 [2024-11-26 04:41:10.809106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:15634 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.809133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.820702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0350 00:29:31.812 [2024-11-26 04:41:10.821261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:6304 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.821288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.833005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ed920 00:29:31.812 [2024-11-26 04:41:10.833468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:25235 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.833496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.844887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e6300 00:29:31.812 [2024-11-26 04:41:10.845346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:602 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.845374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.857240] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e38d0 00:29:31.812 [2024-11-26 04:41:10.857670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:4600 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.857706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.869547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190fa7d8 00:29:31.812 [2024-11-26 04:41:10.869950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:13950 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.869979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.881656] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e01f8 00:29:31.812 [2024-11-26 04:41:10.882064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:22085 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.882092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.893768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190fb480 00:29:31.812 [2024-11-26 04:41:10.894198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:10688 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.894224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.905766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f2948 00:29:31.812 [2024-11-26 04:41:10.906238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:10957 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.906266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.917988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e01f8 00:29:31.812 [2024-11-26 04:41:10.918573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:10590 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.918601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.929881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190eb760 00:29:31.812 [2024-11-26 04:41:10.931134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:5987 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.931166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.941995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e1f80 00:29:31.812 [2024-11-26 04:41:10.943228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:205 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.943259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.954032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f5be8 00:29:31.812 [2024-11-26 04:41:10.954949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:7050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.954981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.966438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e6300 00:29:31.812 [2024-11-26 04:41:10.967610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:5735 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.967642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.978663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ecc78 00:29:31.812 [2024-11-26 04:41:10.979879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:23713 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.979908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:10.990987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190fc560 00:29:31.812 [2024-11-26 04:41:10.992197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:3871 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:10.992229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:11.003202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f0350 00:29:31.812 [2024-11-26 04:41:11.004442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:15128 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:11.004480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:11.015442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e7818 00:29:31.812 [2024-11-26 04:41:11.016694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:3373 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:11.016726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:29:31.812 [2024-11-26 04:41:11.027708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f3a28 00:29:31.812 [2024-11-26 04:41:11.028940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:9887 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.812 [2024-11-26 04:41:11.028971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.040281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e2c28 00:29:32.072 [2024-11-26 04:41:11.041341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:22978 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.041373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.052448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f96f8 00:29:32.072 [2024-11-26 04:41:11.053510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:15699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.053543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.064560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190fb8b8 00:29:32.072 [2024-11-26 04:41:11.065643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:14774 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.065676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.076573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f6890 00:29:32.072 [2024-11-26 04:41:11.077672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:14831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.077715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.088592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f1868 00:29:32.072 [2024-11-26 04:41:11.089743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:4406 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.089771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.100814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190fb8b8 00:29:32.072 [2024-11-26 04:41:11.101908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:6401 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.101940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.113478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ef6a8 00:29:32.072 [2024-11-26 04:41:11.114218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:1655 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.114261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.125870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ea248 00:29:32.072 [2024-11-26 04:41:11.126661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:13586 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.126696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.137824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f2510 00:29:32.072 [2024-11-26 04:41:11.139267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:15206 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.139299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.151014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f2510 00:29:32.072 [2024-11-26 04:41:11.152533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:16861 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.152564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.163496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e0ea0 00:29:32.072 [2024-11-26 04:41:11.164605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:5719 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.164636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.175842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190ed4e8 00:29:32.072 [2024-11-26 04:41:11.176596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:634 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.176623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.188056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190f9b30 00:29:32.072 [2024-11-26 04:41:11.188832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:15793 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.188873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.200220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e49b0 00:29:32.072 [2024-11-26 04:41:11.200920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:25233 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.200947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.212411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e84c0 00:29:32.072 [2024-11-26 04:41:11.213147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:15017 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.213173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.224610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e49b0 00:29:32.072 [2024-11-26 04:41:11.225256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22153 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.225284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:32.072 [2024-11-26 04:41:11.236715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e4140 00:29:32.072 [2024-11-26 04:41:11.237334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1765 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.072 [2024-11-26 04:41:11.237362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:32.073 [2024-11-26 04:41:11.248863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e4578 00:29:32.073 [2024-11-26 04:41:11.249442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:8887 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.073 [2024-11-26 04:41:11.249471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:32.073 [2024-11-26 04:41:11.260852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13ac920) with pdu=0x2000190e99d8 00:29:32.073 [2024-11-26 04:41:11.261407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:12597 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:32.073 [2024-11-26 04:41:11.261438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:32.073 00:29:32.073 Latency(us) 00:29:32.073 [2024-11-26T03:41:11.299Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:32.073 [2024-11-26T03:41:11.299Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:32.073 nvme0n1 : 2.01 21254.45 83.03 0.00 0.00 6014.58 2924.85 13301.38 00:29:32.073 [2024-11-26T03:41:11.299Z] =================================================================================================================== 00:29:32.073 [2024-11-26T03:41:11.299Z] Total : 21254.45 83.03 0.00 0.00 6014.58 2924.85 13301.38 00:29:32.073 0 00:29:32.073 04:41:11 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:32.073 04:41:11 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:32.073 04:41:11 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:32.073 | .driver_specific 00:29:32.073 | .nvme_error 00:29:32.073 | .status_code 00:29:32.073 | .command_transient_transport_error' 00:29:32.073 04:41:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:32.331 04:41:11 -- host/digest.sh@71 -- # (( 167 > 0 )) 00:29:32.331 04:41:11 -- host/digest.sh@73 -- # killprocess 3037785 00:29:32.331 04:41:11 -- common/autotest_common.sh@936 -- # '[' -z 3037785 ']' 00:29:32.331 04:41:11 -- common/autotest_common.sh@940 -- # kill -0 3037785 00:29:32.331 04:41:11 -- common/autotest_common.sh@941 -- # uname 00:29:32.331 04:41:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:32.331 04:41:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3037785 00:29:32.589 04:41:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:32.589 04:41:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:32.589 04:41:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3037785' 00:29:32.590 killing process with pid 3037785 00:29:32.590 04:41:11 -- common/autotest_common.sh@955 -- # kill 3037785 00:29:32.590 Received shutdown signal, test time was about 2.000000 seconds 00:29:32.590 00:29:32.590 Latency(us) 00:29:32.590 [2024-11-26T03:41:11.816Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:32.590 [2024-11-26T03:41:11.816Z] =================================================================================================================== 00:29:32.590 [2024-11-26T03:41:11.816Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:32.590 04:41:11 -- common/autotest_common.sh@960 -- # wait 3037785 00:29:32.590 04:41:11 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:29:32.590 04:41:11 -- host/digest.sh@54 -- # local rw bs qd 00:29:32.590 04:41:11 -- host/digest.sh@56 -- # rw=randwrite 00:29:32.590 04:41:11 -- host/digest.sh@56 -- # bs=131072 00:29:32.590 04:41:11 -- host/digest.sh@56 -- # qd=16 00:29:32.590 04:41:11 -- host/digest.sh@58 -- # bperfpid=3038287 00:29:32.590 04:41:11 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:29:32.590 04:41:11 -- host/digest.sh@60 -- # waitforlisten 3038287 /var/tmp/bperf.sock 00:29:32.590 04:41:11 -- common/autotest_common.sh@829 -- # '[' -z 3038287 ']' 00:29:32.590 04:41:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:32.590 04:41:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:32.590 04:41:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:32.590 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:32.590 04:41:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:32.590 04:41:11 -- common/autotest_common.sh@10 -- # set +x 00:29:32.850 [2024-11-26 04:41:11.838512] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:32.850 [2024-11-26 04:41:11.838583] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3038287 ] 00:29:32.850 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:32.850 Zero copy mechanism will not be used. 00:29:32.850 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.850 [2024-11-26 04:41:11.897745] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:32.850 [2024-11-26 04:41:11.981458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:33.786 04:41:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:33.786 04:41:12 -- common/autotest_common.sh@862 -- # return 0 00:29:33.786 04:41:12 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:33.786 04:41:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:34.044 04:41:13 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:34.044 04:41:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.044 04:41:13 -- common/autotest_common.sh@10 -- # set +x 00:29:34.044 04:41:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.044 04:41:13 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:34.044 04:41:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:34.302 nvme0n1 00:29:34.302 04:41:13 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:34.302 04:41:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.302 04:41:13 -- common/autotest_common.sh@10 -- # set +x 00:29:34.302 04:41:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.302 04:41:13 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:34.302 04:41:13 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:34.562 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:34.562 Zero copy mechanism will not be used. 00:29:34.562 Running I/O for 2 seconds... 00:29:34.562 [2024-11-26 04:41:13.645035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.562 [2024-11-26 04:41:13.645338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.562 [2024-11-26 04:41:13.645379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.562 [2024-11-26 04:41:13.650047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.562 [2024-11-26 04:41:13.650198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.562 [2024-11-26 04:41:13.650229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.562 [2024-11-26 04:41:13.654332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.562 [2024-11-26 04:41:13.654467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.562 [2024-11-26 04:41:13.654497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.562 [2024-11-26 04:41:13.658665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.562 [2024-11-26 04:41:13.658777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.562 [2024-11-26 04:41:13.658807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.562 [2024-11-26 04:41:13.662950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.562 [2024-11-26 04:41:13.663055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.562 [2024-11-26 04:41:13.663084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.562 [2024-11-26 04:41:13.667244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.667382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.667411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.671456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.671590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.671618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.676112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.676398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.676427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.680546] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.680727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.680755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.684719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.684830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.684859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.688947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.689060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.689089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.693520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.693602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.693629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.698656] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.698820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.698849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.702889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.703004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.703032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.707024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.707176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.707205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.711584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.711798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.711827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.717001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.717215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.717244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.721255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.721364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.721393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.725517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.725644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.725673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.729637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.729768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.729797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.733767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.733902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.733931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.737953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.738077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.738105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.742167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.742302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.742330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.746411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.746641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.746670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.750639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.750841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.750870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.754802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.754940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.754969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.758925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.759041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.759077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.763115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.763249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.763278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.767193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.767322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.767350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.771890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.772051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.772080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.563 [2024-11-26 04:41:13.777982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.563 [2024-11-26 04:41:13.778157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.563 [2024-11-26 04:41:13.778186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.823 [2024-11-26 04:41:13.784135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.823 [2024-11-26 04:41:13.784466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.823 [2024-11-26 04:41:13.784497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.823 [2024-11-26 04:41:13.790378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.823 [2024-11-26 04:41:13.790692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.823 [2024-11-26 04:41:13.790724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.823 [2024-11-26 04:41:13.796826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.823 [2024-11-26 04:41:13.796998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.823 [2024-11-26 04:41:13.797027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.823 [2024-11-26 04:41:13.803205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.823 [2024-11-26 04:41:13.803442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.823 [2024-11-26 04:41:13.803472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.823 [2024-11-26 04:41:13.809482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.823 [2024-11-26 04:41:13.809662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.823 [2024-11-26 04:41:13.809698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.823 [2024-11-26 04:41:13.816099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.823 [2024-11-26 04:41:13.816276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.823 [2024-11-26 04:41:13.816304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.822970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.823204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.823233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.829079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.829290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.829318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.835228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.835520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.835549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.841049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.841258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.841287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.846771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.846962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.846991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.853290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.853501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.853529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.859915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.860108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.860136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.865173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.865317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.865343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.869578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.869770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.869799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.874227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.874401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.874430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.879129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.879371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.879415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.884833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.885119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.885149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.891083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.891328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.891356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.897000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.897155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.897183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.903658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.903812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.903841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.909882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.909970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.910004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.915315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.915469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.915498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.920177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.920298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.920328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.924767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.924990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.925019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.930113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.930358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.930387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.935698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.935892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.935921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.941396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.941546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.941575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.947544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.947773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.947802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.953513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.953703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.953732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.958910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.959119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.959147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.964903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.965107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.965135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.824 [2024-11-26 04:41:13.971034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.824 [2024-11-26 04:41:13.971315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.824 [2024-11-26 04:41:13.971344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:13.977054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:13.977308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:13.977336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:13.982957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:13.983202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:13.983231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:13.989282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:13.989460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:13.989489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:13.995735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:13.995954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:13.995982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:14.000763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:14.000905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:14.000936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:14.005288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:14.005483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:14.005511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:14.009772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:14.009955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:14.009984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:14.014011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:14.014236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:14.014265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:14.018278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:14.018554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:14.018587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:14.022561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:14.022746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:14.022774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:14.027432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:14.027518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:14.027544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:14.031622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:14.031732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:14.031759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:14.035756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:14.035877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:14.035905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.825 [2024-11-26 04:41:14.040136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:34.825 [2024-11-26 04:41:14.040294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.825 [2024-11-26 04:41:14.040323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.086 [2024-11-26 04:41:14.044887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.086 [2024-11-26 04:41:14.045038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.086 [2024-11-26 04:41:14.045074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.086 [2024-11-26 04:41:14.049302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.086 [2024-11-26 04:41:14.049534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.086 [2024-11-26 04:41:14.049562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.086 [2024-11-26 04:41:14.053541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.086 [2024-11-26 04:41:14.053748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.086 [2024-11-26 04:41:14.053778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.086 [2024-11-26 04:41:14.057771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.086 [2024-11-26 04:41:14.057970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.086 [2024-11-26 04:41:14.057998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.086 [2024-11-26 04:41:14.061883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.086 [2024-11-26 04:41:14.061992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.086 [2024-11-26 04:41:14.062020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.086 [2024-11-26 04:41:14.065984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.086 [2024-11-26 04:41:14.066090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.086 [2024-11-26 04:41:14.066118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.086 [2024-11-26 04:41:14.070160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.086 [2024-11-26 04:41:14.070307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.086 [2024-11-26 04:41:14.070333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.086 [2024-11-26 04:41:14.074440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.086 [2024-11-26 04:41:14.074625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.086 [2024-11-26 04:41:14.074653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.086 [2024-11-26 04:41:14.078503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.086 [2024-11-26 04:41:14.078607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.086 [2024-11-26 04:41:14.078635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.086 [2024-11-26 04:41:14.083562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.086 [2024-11-26 04:41:14.083777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.086 [2024-11-26 04:41:14.083806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.087756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.087941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.087969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.091939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.092124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.092152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.096351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.096479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.096507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.100838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.100926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.100954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.105948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.106053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.106081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.110097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.110289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.110318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.114268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.114404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.114433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.119305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.119535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.119570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.123499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.123732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.123764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.127878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.128050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.128078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.132023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.132165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.132194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.136138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.136284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.136312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.140231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.140368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.140396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.144413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.144579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.144608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.148558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.148705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.148742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.153666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.153882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.153911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.158987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.159120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.159147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.164254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.164368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.164395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.169052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.169194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.169221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.173186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.173326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.173355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.177330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.177442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.177473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.181494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.181656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.181693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.186250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.186432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.186461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.191030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.191192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.087 [2024-11-26 04:41:14.191219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.087 [2024-11-26 04:41:14.195247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.087 [2024-11-26 04:41:14.195357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.195385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.199471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.199634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.199663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.203750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.203830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.203856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.209137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.209268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.209297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.213335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.213443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.213471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.217510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.217678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.217713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.221726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.221898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.221927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.226002] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.226165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.226193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.230269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.230385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.230413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.235156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.235289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.235324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.239364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.239484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.239512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.243480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.243603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.243631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.247594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.247721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.247750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.251810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.251955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.251983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.256523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.256739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.256769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.261173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.261345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.261374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.265214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.265337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.265365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.269236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.269382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.269409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.273324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.273487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.273515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.278371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.278564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.278592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.284330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.284514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.088 [2024-11-26 04:41:14.284541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.088 [2024-11-26 04:41:14.290123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.088 [2024-11-26 04:41:14.290374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.089 [2024-11-26 04:41:14.290403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.089 [2024-11-26 04:41:14.295819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.089 [2024-11-26 04:41:14.296093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.089 [2024-11-26 04:41:14.296122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.089 [2024-11-26 04:41:14.301613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.089 [2024-11-26 04:41:14.301815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.089 [2024-11-26 04:41:14.301844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.374 [2024-11-26 04:41:14.307363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.307519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.307548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.313424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.313593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.313625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.319814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.319966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.319996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.326488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.326670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.326710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.333170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.333370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.333400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.339889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.340055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.340086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.346813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.347116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.347146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.353513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.353645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.353675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.360079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.360263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.360291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.366464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.366571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.366600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.372005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.372130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.372158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.377423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.377517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.377556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.382671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.382818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.382846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.387013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.387212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.387240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.391194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.391404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.391432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.395807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.396026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.396054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.400890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.401015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.401040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.406113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.406236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.406262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.411653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.411854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.411883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.416160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.416299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.416328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.420560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.420707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.420736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.425197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.425418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.425446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.429599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.429780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.429808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.434150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.434351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.434380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.439222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.439396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.439424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.444074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.444222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.375 [2024-11-26 04:41:14.444250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.375 [2024-11-26 04:41:14.448516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.375 [2024-11-26 04:41:14.448725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.448754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.452932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.453089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.453117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.457561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.457663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.457703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.462572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.462722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.462751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.467186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.467402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.467430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.471709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.471944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.471973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.476196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.476393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.476421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.480725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.480858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.480886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.485278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.485485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.485515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.489763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.489879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.489907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.494228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.494376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.494405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.498757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.498965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.498993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.503236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.503423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.503452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.507924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.508138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.508167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.512424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.512615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.512643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.517325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.517455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.517484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.522819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.522999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.523028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.527324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.527463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.527491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.531824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.531934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.531962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.536387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.536609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.536638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.540907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.541061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.541089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.545479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.545731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.545760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.549944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.550110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.550138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.554408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.554566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.554594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.558878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.559059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.559087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.563216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.563411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.563439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.568324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.376 [2024-11-26 04:41:14.568500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.376 [2024-11-26 04:41:14.568528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.376 [2024-11-26 04:41:14.574814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.377 [2024-11-26 04:41:14.575064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.377 [2024-11-26 04:41:14.575092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.377 [2024-11-26 04:41:14.581781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.377 [2024-11-26 04:41:14.582032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.377 [2024-11-26 04:41:14.582071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.589429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.589802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.589832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.596804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.597013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.597042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.603840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.603964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.603994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.611454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.611743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.611773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.618528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.618713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.618749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.625723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.625889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.625916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.632971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.633250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.633278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.639712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.639975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.640004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.646951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.647241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.647268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.653827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.654076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.654104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.660595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.660727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.660755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.666602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.666752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.666781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.671693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.671875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.671902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.676528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.676693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.676721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.681846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.682120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.682148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.688176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.688359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.653 [2024-11-26 04:41:14.688386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.653 [2024-11-26 04:41:14.694311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.653 [2024-11-26 04:41:14.694496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.694525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.699718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.699905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.699934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.704639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.704793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.704822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.709341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.709563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.709591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.713956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.714139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.714167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.719084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.719266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.719294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.725267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.725527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.725556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.730919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.731120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.731148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.736894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.737128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.737155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.743731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.744014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.744047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.750753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.750916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.750944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.757961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.758241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.758269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.764804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.764960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.764988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.771560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.771768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.771796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.778694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.779001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.779029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.785761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.785919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.785947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.792950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.793230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.793258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.799445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.799757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.799787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.804619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.804824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.804852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.810907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.811144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.811172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.816856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.817039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.817068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.822220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.822394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.822421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.827078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.827300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.827328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.832087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.832301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.832330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.837108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.837319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.837348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.841647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.841819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.841847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.846967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.654 [2024-11-26 04:41:14.847154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.654 [2024-11-26 04:41:14.847182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.654 [2024-11-26 04:41:14.853313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.655 [2024-11-26 04:41:14.853483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.655 [2024-11-26 04:41:14.853512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.655 [2024-11-26 04:41:14.859699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.655 [2024-11-26 04:41:14.859892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.655 [2024-11-26 04:41:14.859921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.655 [2024-11-26 04:41:14.866730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.655 [2024-11-26 04:41:14.867010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.655 [2024-11-26 04:41:14.867040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.874127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.874397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.874428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.880410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.880719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.880749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.887508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.887732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.887761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.894188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.894460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.894489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.900966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.901122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.901150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.906480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.906700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.906729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.911674] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.911872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.911900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.917461] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.917658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.917692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.922858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.922985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.923012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.928601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.928800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.928829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.933268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.933455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.933484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.937805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.937944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.937973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.943329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.943448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.943474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.947966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.948153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.948182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.952397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.952538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.952566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.956821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.956975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.957003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.961434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.961655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.961684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.966715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.966911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.966939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.971571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.971764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.971793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.976443] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.976623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.976656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.982507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.923 [2024-11-26 04:41:14.982740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.923 [2024-11-26 04:41:14.982768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.923 [2024-11-26 04:41:14.988555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:14.988681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:14.988735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:14.995189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:14.995338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:14.995373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.002193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.002422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.002454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.008925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.009213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.009245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.015204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.015405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.015438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.020203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.020386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.020418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.024758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.024885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.024915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.029287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.029425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.029458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.034069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.034198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.034231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.040059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.040273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.040305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.046899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.047098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.047131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.053774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.054057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.054090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.060896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.061137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.061168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.068065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.068216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.068247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.075134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.075313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.075343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.082326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.082465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.082499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.089414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.089662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.089705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.096540] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.096676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.096731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.103630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.103793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.103819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.111166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.111443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.111476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.117630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.117938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.117968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.124152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.124330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.124362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.131082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.131228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.131261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.924 [2024-11-26 04:41:15.137857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:35.924 [2024-11-26 04:41:15.137982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.924 [2024-11-26 04:41:15.138012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.183 [2024-11-26 04:41:15.144749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.183 [2024-11-26 04:41:15.144943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.183 [2024-11-26 04:41:15.144974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.183 [2024-11-26 04:41:15.151306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.183 [2024-11-26 04:41:15.151513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.183 [2024-11-26 04:41:15.151545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.183 [2024-11-26 04:41:15.158159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.158374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.158406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.165578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.165872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.165907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.172881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.173173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.173205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.180232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.180475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.180508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.187550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.187705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.187752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.193854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.194052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.194084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.199281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.199422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.199454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.205091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.205328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.205360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.211420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.211564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.211593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.217799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.217976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.218004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.224057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.224311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.224340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.230352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.230588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.230618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.236511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.236632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.236660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.242940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.243125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.243157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.249889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.250093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.250126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.256381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.256566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.256598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.262908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.263087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.263117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.267854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.268053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.268084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.272752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.272957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.273006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.278746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.278935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.278963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.283173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.283292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.283323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.287650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.287792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.287832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.292178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.292336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.292366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.296743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.296891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.296919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.301130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.301264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.301293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.305623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.305849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.184 [2024-11-26 04:41:15.305880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.184 [2024-11-26 04:41:15.310221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.184 [2024-11-26 04:41:15.310405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.310436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.314833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.315030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.315067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.319493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.319639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.319669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.324677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.324822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.324850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.329125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.329280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.329312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.333614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.333805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.333833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.338027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.338148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.338178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.342542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.342783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.342811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.347070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.347223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.347253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.351569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.351794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.351822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.356021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.356177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.356207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.360495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.360629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.360659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.364947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.365112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.365142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.369730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.369844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.369871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.374448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.374590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.374618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.378957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.379189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.379222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.383545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.383759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.383789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.388116] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.388323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.388356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.392551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.392703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.392747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.396934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.397075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.397107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.185 [2024-11-26 04:41:15.402872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.185 [2024-11-26 04:41:15.403127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.185 [2024-11-26 04:41:15.403160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.409633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.409847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.409881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.417041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.417261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.417293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.423883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.424178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.424211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.430603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.430861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.430891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.437436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.437681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.437724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.444295] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.444502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.444534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.451273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.451446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.451477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.457675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.457808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.457836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.463899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.464061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.464092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.470207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.470386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.470417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.476640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.476905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.476934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.483003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.483267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.483299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.489075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.489229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.489258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.494109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.494252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.494284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.498679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.498835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.498864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.503502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.503662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.503705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.508710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.508916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.508945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.514533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.514737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.514766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.521165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.521359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.521392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.525971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.526202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.526235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.530640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.530878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.530908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.535266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.535433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.535464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.541233] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.541408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.541440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.546976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.547127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.547165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.553578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.553732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.553761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.560471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.560679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.560733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.566680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.566951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.566980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.572837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.573048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.573080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.577491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.577696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.577743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.582151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.582356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.582387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.444 [2024-11-26 04:41:15.587060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.444 [2024-11-26 04:41:15.587250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.444 [2024-11-26 04:41:15.587282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.445 [2024-11-26 04:41:15.591854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.445 [2024-11-26 04:41:15.592040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.445 [2024-11-26 04:41:15.592072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.445 [2024-11-26 04:41:15.596505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.445 [2024-11-26 04:41:15.596800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.445 [2024-11-26 04:41:15.596829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.445 [2024-11-26 04:41:15.602175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.445 [2024-11-26 04:41:15.602369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.445 [2024-11-26 04:41:15.602401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.445 [2024-11-26 04:41:15.608822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.445 [2024-11-26 04:41:15.609062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.445 [2024-11-26 04:41:15.609094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.445 [2024-11-26 04:41:15.615167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.445 [2024-11-26 04:41:15.615445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.445 [2024-11-26 04:41:15.615478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.445 [2024-11-26 04:41:15.622276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.445 [2024-11-26 04:41:15.622486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.445 [2024-11-26 04:41:15.622519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.445 [2024-11-26 04:41:15.628788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.445 [2024-11-26 04:41:15.628919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.445 [2024-11-26 04:41:15.628947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.445 [2024-11-26 04:41:15.635197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.445 [2024-11-26 04:41:15.635444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.445 [2024-11-26 04:41:15.635474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.445 [2024-11-26 04:41:15.642015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x13acac0) with pdu=0x2000190fef90 00:29:36.445 [2024-11-26 04:41:15.642228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.445 [2024-11-26 04:41:15.642261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.445 00:29:36.445 Latency(us) 00:29:36.445 [2024-11-26T03:41:15.671Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:36.445 [2024-11-26T03:41:15.671Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:36.445 nvme0n1 : 2.00 5748.08 718.51 0.00 0.00 2775.88 1699.08 7864.32 00:29:36.445 [2024-11-26T03:41:15.671Z] =================================================================================================================== 00:29:36.445 [2024-11-26T03:41:15.671Z] Total : 5748.08 718.51 0.00 0.00 2775.88 1699.08 7864.32 00:29:36.445 0 00:29:36.445 04:41:15 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:36.445 04:41:15 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:36.445 04:41:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:36.445 04:41:15 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:36.445 | .driver_specific 00:29:36.445 | .nvme_error 00:29:36.445 | .status_code 00:29:36.445 | .command_transient_transport_error' 00:29:36.702 04:41:15 -- host/digest.sh@71 -- # (( 371 > 0 )) 00:29:36.702 04:41:15 -- host/digest.sh@73 -- # killprocess 3038287 00:29:36.702 04:41:15 -- common/autotest_common.sh@936 -- # '[' -z 3038287 ']' 00:29:36.702 04:41:15 -- common/autotest_common.sh@940 -- # kill -0 3038287 00:29:36.702 04:41:15 -- common/autotest_common.sh@941 -- # uname 00:29:36.702 04:41:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:36.702 04:41:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3038287 00:29:36.960 04:41:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:36.960 04:41:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:36.960 04:41:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3038287' 00:29:36.960 killing process with pid 3038287 00:29:36.960 04:41:15 -- common/autotest_common.sh@955 -- # kill 3038287 00:29:36.960 Received shutdown signal, test time was about 2.000000 seconds 00:29:36.960 00:29:36.960 Latency(us) 00:29:36.960 [2024-11-26T03:41:16.186Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:36.960 [2024-11-26T03:41:16.186Z] =================================================================================================================== 00:29:36.960 [2024-11-26T03:41:16.186Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:36.960 04:41:15 -- common/autotest_common.sh@960 -- # wait 3038287 00:29:36.960 04:41:16 -- host/digest.sh@115 -- # killprocess 3036536 00:29:36.960 04:41:16 -- common/autotest_common.sh@936 -- # '[' -z 3036536 ']' 00:29:36.960 04:41:16 -- common/autotest_common.sh@940 -- # kill -0 3036536 00:29:36.960 04:41:16 -- common/autotest_common.sh@941 -- # uname 00:29:36.960 04:41:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:36.960 04:41:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3036536 00:29:37.220 04:41:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:37.220 04:41:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:37.220 04:41:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3036536' 00:29:37.220 killing process with pid 3036536 00:29:37.220 04:41:16 -- common/autotest_common.sh@955 -- # kill 3036536 00:29:37.220 04:41:16 -- common/autotest_common.sh@960 -- # wait 3036536 00:29:37.220 00:29:37.220 real 0m18.482s 00:29:37.220 user 0m37.921s 00:29:37.220 sys 0m4.353s 00:29:37.220 04:41:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:37.220 04:41:16 -- common/autotest_common.sh@10 -- # set +x 00:29:37.220 ************************************ 00:29:37.220 END TEST nvmf_digest_error 00:29:37.220 ************************************ 00:29:37.481 04:41:16 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:29:37.481 04:41:16 -- host/digest.sh@139 -- # nvmftestfini 00:29:37.481 04:41:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:37.481 04:41:16 -- nvmf/common.sh@116 -- # sync 00:29:37.481 04:41:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:37.481 04:41:16 -- nvmf/common.sh@119 -- # set +e 00:29:37.481 04:41:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:37.481 04:41:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:37.481 rmmod nvme_tcp 00:29:37.481 rmmod nvme_fabrics 00:29:37.481 rmmod nvme_keyring 00:29:37.481 04:41:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:37.481 04:41:16 -- nvmf/common.sh@123 -- # set -e 00:29:37.481 04:41:16 -- nvmf/common.sh@124 -- # return 0 00:29:37.481 04:41:16 -- nvmf/common.sh@477 -- # '[' -n 3036536 ']' 00:29:37.481 04:41:16 -- nvmf/common.sh@478 -- # killprocess 3036536 00:29:37.481 04:41:16 -- common/autotest_common.sh@936 -- # '[' -z 3036536 ']' 00:29:37.481 04:41:16 -- common/autotest_common.sh@940 -- # kill -0 3036536 00:29:37.481 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3036536) - No such process 00:29:37.481 04:41:16 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3036536 is not found' 00:29:37.481 Process with pid 3036536 is not found 00:29:37.481 04:41:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:37.481 04:41:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:37.481 04:41:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:37.481 04:41:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:37.481 04:41:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:37.481 04:41:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:37.481 04:41:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:37.481 04:41:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:39.386 04:41:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:39.386 00:29:39.386 real 0m38.121s 00:29:39.386 user 1m8.350s 00:29:39.386 sys 0m10.156s 00:29:39.386 04:41:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:39.386 04:41:18 -- common/autotest_common.sh@10 -- # set +x 00:29:39.386 ************************************ 00:29:39.386 END TEST nvmf_digest 00:29:39.386 ************************************ 00:29:39.386 04:41:18 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:29:39.386 04:41:18 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:29:39.386 04:41:18 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:29:39.386 04:41:18 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:39.386 04:41:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:39.386 04:41:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:39.386 04:41:18 -- common/autotest_common.sh@10 -- # set +x 00:29:39.386 ************************************ 00:29:39.386 START TEST nvmf_bdevperf 00:29:39.386 ************************************ 00:29:39.386 04:41:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:39.647 * Looking for test storage... 00:29:39.647 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:39.647 04:41:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:39.647 04:41:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:39.647 04:41:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:39.647 04:41:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:39.647 04:41:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:39.647 04:41:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:39.647 04:41:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:39.647 04:41:18 -- scripts/common.sh@335 -- # IFS=.-: 00:29:39.647 04:41:18 -- scripts/common.sh@335 -- # read -ra ver1 00:29:39.647 04:41:18 -- scripts/common.sh@336 -- # IFS=.-: 00:29:39.647 04:41:18 -- scripts/common.sh@336 -- # read -ra ver2 00:29:39.647 04:41:18 -- scripts/common.sh@337 -- # local 'op=<' 00:29:39.647 04:41:18 -- scripts/common.sh@339 -- # ver1_l=2 00:29:39.647 04:41:18 -- scripts/common.sh@340 -- # ver2_l=1 00:29:39.647 04:41:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:39.647 04:41:18 -- scripts/common.sh@343 -- # case "$op" in 00:29:39.647 04:41:18 -- scripts/common.sh@344 -- # : 1 00:29:39.647 04:41:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:39.647 04:41:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:39.647 04:41:18 -- scripts/common.sh@364 -- # decimal 1 00:29:39.647 04:41:18 -- scripts/common.sh@352 -- # local d=1 00:29:39.647 04:41:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:39.647 04:41:18 -- scripts/common.sh@354 -- # echo 1 00:29:39.647 04:41:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:39.647 04:41:18 -- scripts/common.sh@365 -- # decimal 2 00:29:39.647 04:41:18 -- scripts/common.sh@352 -- # local d=2 00:29:39.647 04:41:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:39.647 04:41:18 -- scripts/common.sh@354 -- # echo 2 00:29:39.647 04:41:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:39.647 04:41:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:39.647 04:41:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:39.647 04:41:18 -- scripts/common.sh@367 -- # return 0 00:29:39.647 04:41:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:39.647 04:41:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:39.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:39.647 --rc genhtml_branch_coverage=1 00:29:39.647 --rc genhtml_function_coverage=1 00:29:39.647 --rc genhtml_legend=1 00:29:39.647 --rc geninfo_all_blocks=1 00:29:39.647 --rc geninfo_unexecuted_blocks=1 00:29:39.647 00:29:39.647 ' 00:29:39.647 04:41:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:39.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:39.647 --rc genhtml_branch_coverage=1 00:29:39.647 --rc genhtml_function_coverage=1 00:29:39.647 --rc genhtml_legend=1 00:29:39.647 --rc geninfo_all_blocks=1 00:29:39.647 --rc geninfo_unexecuted_blocks=1 00:29:39.647 00:29:39.647 ' 00:29:39.647 04:41:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:39.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:39.647 --rc genhtml_branch_coverage=1 00:29:39.647 --rc genhtml_function_coverage=1 00:29:39.647 --rc genhtml_legend=1 00:29:39.647 --rc geninfo_all_blocks=1 00:29:39.647 --rc geninfo_unexecuted_blocks=1 00:29:39.647 00:29:39.647 ' 00:29:39.647 04:41:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:39.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:39.647 --rc genhtml_branch_coverage=1 00:29:39.647 --rc genhtml_function_coverage=1 00:29:39.647 --rc genhtml_legend=1 00:29:39.647 --rc geninfo_all_blocks=1 00:29:39.647 --rc geninfo_unexecuted_blocks=1 00:29:39.647 00:29:39.647 ' 00:29:39.647 04:41:18 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:39.647 04:41:18 -- nvmf/common.sh@7 -- # uname -s 00:29:39.647 04:41:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:39.647 04:41:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:39.647 04:41:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:39.647 04:41:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:39.647 04:41:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:39.647 04:41:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:39.647 04:41:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:39.647 04:41:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:39.647 04:41:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:39.647 04:41:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:39.647 04:41:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:39.647 04:41:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:39.647 04:41:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:39.647 04:41:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:39.647 04:41:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:39.647 04:41:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:39.647 04:41:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:39.647 04:41:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:39.647 04:41:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:39.647 04:41:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.647 04:41:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.647 04:41:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.647 04:41:18 -- paths/export.sh@5 -- # export PATH 00:29:39.647 04:41:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.647 04:41:18 -- nvmf/common.sh@46 -- # : 0 00:29:39.647 04:41:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:39.647 04:41:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:39.647 04:41:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:39.647 04:41:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:39.647 04:41:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:39.647 04:41:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:39.647 04:41:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:39.647 04:41:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:39.647 04:41:18 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:29:39.647 04:41:18 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:29:39.647 04:41:18 -- host/bdevperf.sh@24 -- # nvmftestinit 00:29:39.647 04:41:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:39.647 04:41:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:39.647 04:41:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:39.647 04:41:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:39.647 04:41:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:39.647 04:41:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:39.647 04:41:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:39.647 04:41:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:39.647 04:41:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:39.647 04:41:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:39.647 04:41:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:39.647 04:41:18 -- common/autotest_common.sh@10 -- # set +x 00:29:41.551 04:41:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:41.551 04:41:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:41.551 04:41:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:41.551 04:41:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:41.551 04:41:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:41.551 04:41:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:41.551 04:41:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:41.551 04:41:20 -- nvmf/common.sh@294 -- # net_devs=() 00:29:41.551 04:41:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:41.551 04:41:20 -- nvmf/common.sh@295 -- # e810=() 00:29:41.551 04:41:20 -- nvmf/common.sh@295 -- # local -ga e810 00:29:41.551 04:41:20 -- nvmf/common.sh@296 -- # x722=() 00:29:41.551 04:41:20 -- nvmf/common.sh@296 -- # local -ga x722 00:29:41.551 04:41:20 -- nvmf/common.sh@297 -- # mlx=() 00:29:41.551 04:41:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:41.551 04:41:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:41.551 04:41:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:41.551 04:41:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:41.551 04:41:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:41.551 04:41:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:41.551 04:41:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:41.551 04:41:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:41.551 04:41:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:41.551 04:41:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:41.551 04:41:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:41.551 04:41:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:41.551 04:41:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:41.551 04:41:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:41.551 04:41:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:41.551 04:41:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:41.551 04:41:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:41.551 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:41.551 04:41:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:41.551 04:41:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:41.551 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:41.551 04:41:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:41.551 04:41:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:41.551 04:41:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:41.551 04:41:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:41.551 04:41:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:41.551 04:41:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:41.551 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:41.551 04:41:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:41.551 04:41:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:41.551 04:41:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:41.551 04:41:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:41.551 04:41:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:41.551 04:41:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:41.551 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:41.551 04:41:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:41.551 04:41:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:41.551 04:41:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:41.551 04:41:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:41.551 04:41:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:41.551 04:41:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:41.551 04:41:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:41.551 04:41:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:41.551 04:41:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:41.551 04:41:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:41.551 04:41:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:41.551 04:41:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:41.551 04:41:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:41.551 04:41:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:41.551 04:41:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:41.551 04:41:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:41.551 04:41:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:41.551 04:41:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:41.551 04:41:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:41.551 04:41:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:41.551 04:41:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:41.551 04:41:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:41.551 04:41:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:41.551 04:41:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:41.551 04:41:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:41.551 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:41.552 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:29:41.552 00:29:41.552 --- 10.0.0.2 ping statistics --- 00:29:41.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:41.552 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:29:41.552 04:41:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:41.552 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:41.552 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.135 ms 00:29:41.552 00:29:41.552 --- 10.0.0.1 ping statistics --- 00:29:41.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:41.552 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:29:41.552 04:41:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:41.552 04:41:20 -- nvmf/common.sh@410 -- # return 0 00:29:41.552 04:41:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:41.552 04:41:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:41.552 04:41:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:41.552 04:41:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:41.552 04:41:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:41.552 04:41:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:41.552 04:41:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:41.810 04:41:20 -- host/bdevperf.sh@25 -- # tgt_init 00:29:41.810 04:41:20 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:41.810 04:41:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:41.810 04:41:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:41.810 04:41:20 -- common/autotest_common.sh@10 -- # set +x 00:29:41.810 04:41:20 -- nvmf/common.sh@469 -- # nvmfpid=3040727 00:29:41.811 04:41:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:41.811 04:41:20 -- nvmf/common.sh@470 -- # waitforlisten 3040727 00:29:41.811 04:41:20 -- common/autotest_common.sh@829 -- # '[' -z 3040727 ']' 00:29:41.811 04:41:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:41.811 04:41:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:41.811 04:41:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:41.811 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:41.811 04:41:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:41.811 04:41:20 -- common/autotest_common.sh@10 -- # set +x 00:29:41.811 [2024-11-26 04:41:20.835158] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:41.811 [2024-11-26 04:41:20.835225] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:41.811 EAL: No free 2048 kB hugepages reported on node 1 00:29:41.811 [2024-11-26 04:41:20.905572] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:41.811 [2024-11-26 04:41:20.997783] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:41.811 [2024-11-26 04:41:20.997951] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:41.811 [2024-11-26 04:41:20.997985] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:41.811 [2024-11-26 04:41:20.998011] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:41.811 [2024-11-26 04:41:20.998081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:41.811 [2024-11-26 04:41:20.998201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:41.811 [2024-11-26 04:41:20.998204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:42.744 04:41:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:42.744 04:41:21 -- common/autotest_common.sh@862 -- # return 0 00:29:42.744 04:41:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:42.744 04:41:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:42.744 04:41:21 -- common/autotest_common.sh@10 -- # set +x 00:29:42.744 04:41:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:42.744 04:41:21 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:42.744 04:41:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.744 04:41:21 -- common/autotest_common.sh@10 -- # set +x 00:29:42.744 [2024-11-26 04:41:21.854488] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:42.744 04:41:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.744 04:41:21 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:42.744 04:41:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.744 04:41:21 -- common/autotest_common.sh@10 -- # set +x 00:29:42.744 Malloc0 00:29:42.744 04:41:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.744 04:41:21 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:42.744 04:41:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.744 04:41:21 -- common/autotest_common.sh@10 -- # set +x 00:29:42.744 04:41:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.744 04:41:21 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:42.744 04:41:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.744 04:41:21 -- common/autotest_common.sh@10 -- # set +x 00:29:42.744 04:41:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.744 04:41:21 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:42.744 04:41:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.744 04:41:21 -- common/autotest_common.sh@10 -- # set +x 00:29:42.744 [2024-11-26 04:41:21.909916] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:42.744 04:41:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.744 04:41:21 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:29:42.744 04:41:21 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:29:42.744 04:41:21 -- nvmf/common.sh@520 -- # config=() 00:29:42.744 04:41:21 -- nvmf/common.sh@520 -- # local subsystem config 00:29:42.744 04:41:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:42.744 04:41:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:42.744 { 00:29:42.744 "params": { 00:29:42.744 "name": "Nvme$subsystem", 00:29:42.744 "trtype": "$TEST_TRANSPORT", 00:29:42.744 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:42.744 "adrfam": "ipv4", 00:29:42.744 "trsvcid": "$NVMF_PORT", 00:29:42.744 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:42.744 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:42.744 "hdgst": ${hdgst:-false}, 00:29:42.744 "ddgst": ${ddgst:-false} 00:29:42.744 }, 00:29:42.744 "method": "bdev_nvme_attach_controller" 00:29:42.744 } 00:29:42.744 EOF 00:29:42.744 )") 00:29:42.744 04:41:21 -- nvmf/common.sh@542 -- # cat 00:29:42.744 04:41:21 -- nvmf/common.sh@544 -- # jq . 00:29:42.744 04:41:21 -- nvmf/common.sh@545 -- # IFS=, 00:29:42.744 04:41:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:42.744 "params": { 00:29:42.744 "name": "Nvme1", 00:29:42.744 "trtype": "tcp", 00:29:42.745 "traddr": "10.0.0.2", 00:29:42.745 "adrfam": "ipv4", 00:29:42.745 "trsvcid": "4420", 00:29:42.745 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:42.745 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:42.745 "hdgst": false, 00:29:42.745 "ddgst": false 00:29:42.745 }, 00:29:42.745 "method": "bdev_nvme_attach_controller" 00:29:42.745 }' 00:29:42.745 [2024-11-26 04:41:21.957125] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:42.745 [2024-11-26 04:41:21.957211] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3040888 ] 00:29:43.004 EAL: No free 2048 kB hugepages reported on node 1 00:29:43.004 [2024-11-26 04:41:22.020503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:43.004 [2024-11-26 04:41:22.107449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:43.263 Running I/O for 1 seconds... 00:29:44.198 00:29:44.198 Latency(us) 00:29:44.198 [2024-11-26T03:41:23.424Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:44.198 [2024-11-26T03:41:23.424Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:44.198 Verification LBA range: start 0x0 length 0x4000 00:29:44.198 Nvme1n1 : 1.01 12604.15 49.23 0.00 0.00 10104.62 1517.04 17185.00 00:29:44.198 [2024-11-26T03:41:23.424Z] =================================================================================================================== 00:29:44.198 [2024-11-26T03:41:23.424Z] Total : 12604.15 49.23 0.00 0.00 10104.62 1517.04 17185.00 00:29:44.457 04:41:23 -- host/bdevperf.sh@30 -- # bdevperfpid=3041154 00:29:44.457 04:41:23 -- host/bdevperf.sh@32 -- # sleep 3 00:29:44.457 04:41:23 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:29:44.457 04:41:23 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:29:44.457 04:41:23 -- nvmf/common.sh@520 -- # config=() 00:29:44.457 04:41:23 -- nvmf/common.sh@520 -- # local subsystem config 00:29:44.457 04:41:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:44.457 04:41:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:44.457 { 00:29:44.457 "params": { 00:29:44.457 "name": "Nvme$subsystem", 00:29:44.457 "trtype": "$TEST_TRANSPORT", 00:29:44.457 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:44.457 "adrfam": "ipv4", 00:29:44.457 "trsvcid": "$NVMF_PORT", 00:29:44.457 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:44.457 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:44.457 "hdgst": ${hdgst:-false}, 00:29:44.457 "ddgst": ${ddgst:-false} 00:29:44.457 }, 00:29:44.457 "method": "bdev_nvme_attach_controller" 00:29:44.457 } 00:29:44.457 EOF 00:29:44.457 )") 00:29:44.457 04:41:23 -- nvmf/common.sh@542 -- # cat 00:29:44.457 04:41:23 -- nvmf/common.sh@544 -- # jq . 00:29:44.457 04:41:23 -- nvmf/common.sh@545 -- # IFS=, 00:29:44.457 04:41:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:44.457 "params": { 00:29:44.457 "name": "Nvme1", 00:29:44.457 "trtype": "tcp", 00:29:44.457 "traddr": "10.0.0.2", 00:29:44.457 "adrfam": "ipv4", 00:29:44.457 "trsvcid": "4420", 00:29:44.457 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:44.457 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:44.457 "hdgst": false, 00:29:44.457 "ddgst": false 00:29:44.457 }, 00:29:44.457 "method": "bdev_nvme_attach_controller" 00:29:44.457 }' 00:29:44.457 [2024-11-26 04:41:23.573914] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:44.457 [2024-11-26 04:41:23.574014] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3041154 ] 00:29:44.457 EAL: No free 2048 kB hugepages reported on node 1 00:29:44.457 [2024-11-26 04:41:23.633703] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:44.717 [2024-11-26 04:41:23.719159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:44.717 Running I/O for 15 seconds... 00:29:48.007 04:41:26 -- host/bdevperf.sh@33 -- # kill -9 3040727 00:29:48.007 04:41:26 -- host/bdevperf.sh@35 -- # sleep 3 00:29:48.007 [2024-11-26 04:41:26.549632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:9496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.549694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.549757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.549776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.549795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:9528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.549813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.549830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:9552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.549849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.549868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:8984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.549885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.549904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:8992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.549922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.549939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.549972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.550013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:9024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.550031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.550050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:9032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.550066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.550082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:9064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.550099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.550115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:9072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.550130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.550150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:9088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.550169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.550188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:9608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.550207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.550226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:9616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.550245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.550263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:9664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.007 [2024-11-26 04:41:26.550281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.550299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.550315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.550331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:9680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.550346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.007 [2024-11-26 04:41:26.550364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:9104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.007 [2024-11-26 04:41:26.550379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:9136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.550412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:9152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.550450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:9160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.550483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:9184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.550514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:9192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.550545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:9216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.550577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:9224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.550615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:9688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.550646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:9696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.008 [2024-11-26 04:41:26.550678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:9704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.008 [2024-11-26 04:41:26.550735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:9712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.550764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.550793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:9728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.008 [2024-11-26 04:41:26.550822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:9736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.008 [2024-11-26 04:41:26.550850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:9744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.550882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:9752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.008 [2024-11-26 04:41:26.550911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:9760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.008 [2024-11-26 04:41:26.550940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.550955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:9768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.008 [2024-11-26 04:41:26.550983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:9776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.551017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:9784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.008 [2024-11-26 04:41:26.551057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:9792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.551088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:9800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.551120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:9808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.551152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:9816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.008 [2024-11-26 04:41:26.551183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:9824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.008 [2024-11-26 04:41:26.551215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:9832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.551247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:9840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.551279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:9848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.551317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:9856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.551349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:9864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.551381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.008 [2024-11-26 04:41:26.551398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.008 [2024-11-26 04:41:26.551413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:9880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.551445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:9888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.551477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:9896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.551509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:9904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.551540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:9912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.551572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:9920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.009 [2024-11-26 04:41:26.551604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:9928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.009 [2024-11-26 04:41:26.551636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:9936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.009 [2024-11-26 04:41:26.551668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:9944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.009 [2024-11-26 04:41:26.551732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:9952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.009 [2024-11-26 04:41:26.551764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.551795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.551823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:9976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.551852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:9240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.551880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:9248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.551908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:9272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.551936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:9296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.551964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.551994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:9304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.552020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:9336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.552053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:9352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.552085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:9376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.552116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:9984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.009 [2024-11-26 04:41:26.552154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:9992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.009 [2024-11-26 04:41:26.552186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:10000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.552217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:10008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.009 [2024-11-26 04:41:26.552250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:10016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.552282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:10024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.009 [2024-11-26 04:41:26.552313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:10032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.009 [2024-11-26 04:41:26.552345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:10040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.009 [2024-11-26 04:41:26.552377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:10048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.009 [2024-11-26 04:41:26.552409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:10056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.009 [2024-11-26 04:41:26.552441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.009 [2024-11-26 04:41:26.552457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:10064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.552472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:10072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.552504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.010 [2024-11-26 04:41:26.552536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:9384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.552579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:9400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.552611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:9408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.552643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:9424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.552675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:9432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.552718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:9440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.552775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:9464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.552813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:9480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.552841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:10088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.010 [2024-11-26 04:41:26.552870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:10096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.552898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:10104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.552926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:10112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.010 [2024-11-26 04:41:26.552954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.552985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:10120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:10128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.010 [2024-11-26 04:41:26.553048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:10136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:10144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:9488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:9504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:9512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:9536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:9544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:9560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:9568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:10152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.010 [2024-11-26 04:41:26.553444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.010 [2024-11-26 04:41:26.553460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.010 [2024-11-26 04:41:26.553475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:10176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.011 [2024-11-26 04:41:26.553507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:10184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.553539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:10192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.553570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.553610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:10208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.553642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:10216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.553675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:10224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.553715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:10232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.011 [2024-11-26 04:41:26.553771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:10240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.011 [2024-11-26 04:41:26.553799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:10248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:48.011 [2024-11-26 04:41:26.553828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:9584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.553860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:9592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.553889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:9600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.553918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:9624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.553947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.553961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:9632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.553990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.554005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:9640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.554018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.554058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:9648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.011 [2024-11-26 04:41:26.554074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.554090] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb029a0 is same with the state(5) to be set 00:29:48.011 [2024-11-26 04:41:26.554118] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:48.011 [2024-11-26 04:41:26.554131] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:48.011 [2024-11-26 04:41:26.554143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9656 len:8 PRP1 0x0 PRP2 0x0 00:29:48.011 [2024-11-26 04:41:26.554163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.554225] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xb029a0 was disconnected and freed. reset controller. 00:29:48.011 [2024-11-26 04:41:26.554300] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:48.011 [2024-11-26 04:41:26.554324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.554341] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:48.011 [2024-11-26 04:41:26.554357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.554372] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:48.011 [2024-11-26 04:41:26.554387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.554402] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:48.011 [2024-11-26 04:41:26.554417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:48.011 [2024-11-26 04:41:26.554435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.011 [2024-11-26 04:41:26.557114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.011 [2024-11-26 04:41:26.557156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.011 [2024-11-26 04:41:26.557769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.011 [2024-11-26 04:41:26.557913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.011 [2024-11-26 04:41:26.557939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.011 [2024-11-26 04:41:26.557955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.011 [2024-11-26 04:41:26.558142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.011 [2024-11-26 04:41:26.558345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.011 [2024-11-26 04:41:26.558368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.011 [2024-11-26 04:41:26.558385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.011 [2024-11-26 04:41:26.560584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.011 [2024-11-26 04:41:26.569975] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.011 [2024-11-26 04:41:26.570451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.011 [2024-11-26 04:41:26.570626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.011 [2024-11-26 04:41:26.570655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.011 [2024-11-26 04:41:26.570694] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.012 [2024-11-26 04:41:26.570898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.012 [2024-11-26 04:41:26.571067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.012 [2024-11-26 04:41:26.571091] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.012 [2024-11-26 04:41:26.571107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.012 [2024-11-26 04:41:26.573340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.012 [2024-11-26 04:41:26.582436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.012 [2024-11-26 04:41:26.582774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.582956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.582983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.012 [2024-11-26 04:41:26.582999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.012 [2024-11-26 04:41:26.583128] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.012 [2024-11-26 04:41:26.583289] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.012 [2024-11-26 04:41:26.583313] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.012 [2024-11-26 04:41:26.583335] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.012 [2024-11-26 04:41:26.585747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.012 [2024-11-26 04:41:26.594933] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.012 [2024-11-26 04:41:26.595263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.595413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.595459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.012 [2024-11-26 04:41:26.595477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.012 [2024-11-26 04:41:26.595642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.012 [2024-11-26 04:41:26.595823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.012 [2024-11-26 04:41:26.595848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.012 [2024-11-26 04:41:26.595864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.012 [2024-11-26 04:41:26.598105] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.012 [2024-11-26 04:41:26.607610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.012 [2024-11-26 04:41:26.607995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.608247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.608273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.012 [2024-11-26 04:41:26.608304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.012 [2024-11-26 04:41:26.608461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.012 [2024-11-26 04:41:26.608695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.012 [2024-11-26 04:41:26.608720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.012 [2024-11-26 04:41:26.608736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.012 [2024-11-26 04:41:26.611269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.012 [2024-11-26 04:41:26.620326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.012 [2024-11-26 04:41:26.620639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.620782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.620812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.012 [2024-11-26 04:41:26.620830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.012 [2024-11-26 04:41:26.620995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.012 [2024-11-26 04:41:26.621199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.012 [2024-11-26 04:41:26.621223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.012 [2024-11-26 04:41:26.621239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.012 [2024-11-26 04:41:26.623570] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.012 [2024-11-26 04:41:26.632952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.012 [2024-11-26 04:41:26.633260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.633463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.633509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.012 [2024-11-26 04:41:26.633527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.012 [2024-11-26 04:41:26.633722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.012 [2024-11-26 04:41:26.633945] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.012 [2024-11-26 04:41:26.633969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.012 [2024-11-26 04:41:26.633985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.012 [2024-11-26 04:41:26.636169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.012 [2024-11-26 04:41:26.645761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.012 [2024-11-26 04:41:26.646125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.646276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.646303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.012 [2024-11-26 04:41:26.646320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.012 [2024-11-26 04:41:26.646502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.012 [2024-11-26 04:41:26.646635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.012 [2024-11-26 04:41:26.646659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.012 [2024-11-26 04:41:26.646676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.012 [2024-11-26 04:41:26.649142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.012 [2024-11-26 04:41:26.658226] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.012 [2024-11-26 04:41:26.658590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.658770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.012 [2024-11-26 04:41:26.658800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.012 [2024-11-26 04:41:26.658818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.013 [2024-11-26 04:41:26.658965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.013 [2024-11-26 04:41:26.659133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.013 [2024-11-26 04:41:26.659157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.013 [2024-11-26 04:41:26.659173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.013 [2024-11-26 04:41:26.661503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.013 [2024-11-26 04:41:26.670609] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.013 [2024-11-26 04:41:26.670892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.013 [2024-11-26 04:41:26.671096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.013 [2024-11-26 04:41:26.671150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.013 [2024-11-26 04:41:26.671167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.013 [2024-11-26 04:41:26.671332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.013 [2024-11-26 04:41:26.671483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.013 [2024-11-26 04:41:26.671507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.013 [2024-11-26 04:41:26.671522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.013 [2024-11-26 04:41:26.673935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.013 [2024-11-26 04:41:26.683259] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.013 [2024-11-26 04:41:26.683530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.013 [2024-11-26 04:41:26.683671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.013 [2024-11-26 04:41:26.683729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.013 [2024-11-26 04:41:26.683747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.013 [2024-11-26 04:41:26.683931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.013 [2024-11-26 04:41:26.684063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.013 [2024-11-26 04:41:26.684088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.013 [2024-11-26 04:41:26.684103] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.013 [2024-11-26 04:41:26.686294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.013 [2024-11-26 04:41:26.696015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.013 [2024-11-26 04:41:26.696325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.013 [2024-11-26 04:41:26.696469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.013 [2024-11-26 04:41:26.696498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.013 [2024-11-26 04:41:26.696516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.013 [2024-11-26 04:41:26.696682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.013 [2024-11-26 04:41:26.696863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.013 [2024-11-26 04:41:26.696887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.013 [2024-11-26 04:41:26.696903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.013 [2024-11-26 04:41:26.699270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.013 [2024-11-26 04:41:26.708602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.013 [2024-11-26 04:41:26.708942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.013 [2024-11-26 04:41:26.709116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.013 [2024-11-26 04:41:26.709146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.013 [2024-11-26 04:41:26.709164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.013 [2024-11-26 04:41:26.709292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.013 [2024-11-26 04:41:26.709444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.013 [2024-11-26 04:41:26.709467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.013 [2024-11-26 04:41:26.709483] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.013 [2024-11-26 04:41:26.712060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.013 [2024-11-26 04:41:26.721288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.013 [2024-11-26 04:41:26.721622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.013 [2024-11-26 04:41:26.721797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.013 [2024-11-26 04:41:26.721824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.013 [2024-11-26 04:41:26.721841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.013 [2024-11-26 04:41:26.721973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.013 [2024-11-26 04:41:26.722181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.013 [2024-11-26 04:41:26.722205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.013 [2024-11-26 04:41:26.722221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.014 [2024-11-26 04:41:26.724590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.014 [2024-11-26 04:41:26.733828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.014 [2024-11-26 04:41:26.734149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.734333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.734359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.014 [2024-11-26 04:41:26.734375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.014 [2024-11-26 04:41:26.734602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.014 [2024-11-26 04:41:26.734783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.014 [2024-11-26 04:41:26.734808] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.014 [2024-11-26 04:41:26.734824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.014 [2024-11-26 04:41:26.737245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.014 [2024-11-26 04:41:26.746486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.014 [2024-11-26 04:41:26.746836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.747068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.747103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.014 [2024-11-26 04:41:26.747122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.014 [2024-11-26 04:41:26.747322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.014 [2024-11-26 04:41:26.747437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.014 [2024-11-26 04:41:26.747461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.014 [2024-11-26 04:41:26.747477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.014 [2024-11-26 04:41:26.749945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.014 [2024-11-26 04:41:26.759250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.014 [2024-11-26 04:41:26.759605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.759764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.759793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.014 [2024-11-26 04:41:26.759810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.014 [2024-11-26 04:41:26.760029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.014 [2024-11-26 04:41:26.760198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.014 [2024-11-26 04:41:26.760222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.014 [2024-11-26 04:41:26.760238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.014 [2024-11-26 04:41:26.762640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.014 [2024-11-26 04:41:26.771743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.014 [2024-11-26 04:41:26.772072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.772205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.772234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.014 [2024-11-26 04:41:26.772252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.014 [2024-11-26 04:41:26.772381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.014 [2024-11-26 04:41:26.772514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.014 [2024-11-26 04:41:26.772537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.014 [2024-11-26 04:41:26.772553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.014 [2024-11-26 04:41:26.774893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.014 [2024-11-26 04:41:26.784365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.014 [2024-11-26 04:41:26.784692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.784868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.784897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.014 [2024-11-26 04:41:26.784920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.014 [2024-11-26 04:41:26.785105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.014 [2024-11-26 04:41:26.785256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.014 [2024-11-26 04:41:26.785280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.014 [2024-11-26 04:41:26.785295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.014 [2024-11-26 04:41:26.787573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.014 [2024-11-26 04:41:26.796789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.014 [2024-11-26 04:41:26.797104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.797269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.797298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.014 [2024-11-26 04:41:26.797316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.014 [2024-11-26 04:41:26.797500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.014 [2024-11-26 04:41:26.797669] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.014 [2024-11-26 04:41:26.797703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.014 [2024-11-26 04:41:26.797720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.014 [2024-11-26 04:41:26.800160] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.014 [2024-11-26 04:41:26.809319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.014 [2024-11-26 04:41:26.809674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.809814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.014 [2024-11-26 04:41:26.809840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.014 [2024-11-26 04:41:26.809856] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.014 [2024-11-26 04:41:26.810065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.014 [2024-11-26 04:41:26.810198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.014 [2024-11-26 04:41:26.810222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.014 [2024-11-26 04:41:26.810238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.014 [2024-11-26 04:41:26.812641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.015 [2024-11-26 04:41:26.821884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.015 [2024-11-26 04:41:26.822203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.822318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.822347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.015 [2024-11-26 04:41:26.822365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.015 [2024-11-26 04:41:26.822556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.015 [2024-11-26 04:41:26.822755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.015 [2024-11-26 04:41:26.822781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.015 [2024-11-26 04:41:26.822797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.015 [2024-11-26 04:41:26.824892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.015 [2024-11-26 04:41:26.834648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.015 [2024-11-26 04:41:26.834967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.835141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.835170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.015 [2024-11-26 04:41:26.835188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.015 [2024-11-26 04:41:26.835318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.015 [2024-11-26 04:41:26.835468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.015 [2024-11-26 04:41:26.835493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.015 [2024-11-26 04:41:26.835509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.015 [2024-11-26 04:41:26.837900] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.015 [2024-11-26 04:41:26.847222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.015 [2024-11-26 04:41:26.847563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.847705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.847735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.015 [2024-11-26 04:41:26.847753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.015 [2024-11-26 04:41:26.847900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.015 [2024-11-26 04:41:26.848104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.015 [2024-11-26 04:41:26.848128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.015 [2024-11-26 04:41:26.848144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.015 [2024-11-26 04:41:26.850440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.015 [2024-11-26 04:41:26.859817] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.015 [2024-11-26 04:41:26.860163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.860335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.860363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.015 [2024-11-26 04:41:26.860382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.015 [2024-11-26 04:41:26.860582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.015 [2024-11-26 04:41:26.860769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.015 [2024-11-26 04:41:26.860794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.015 [2024-11-26 04:41:26.860809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.015 [2024-11-26 04:41:26.863087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.015 [2024-11-26 04:41:26.872305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.015 [2024-11-26 04:41:26.872655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.872818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.872867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.015 [2024-11-26 04:41:26.872885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.015 [2024-11-26 04:41:26.873086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.015 [2024-11-26 04:41:26.873255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.015 [2024-11-26 04:41:26.873278] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.015 [2024-11-26 04:41:26.873294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.015 [2024-11-26 04:41:26.875588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.015 [2024-11-26 04:41:26.885036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.015 [2024-11-26 04:41:26.885461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.885660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.885697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.015 [2024-11-26 04:41:26.885718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.015 [2024-11-26 04:41:26.885847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.015 [2024-11-26 04:41:26.886033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.015 [2024-11-26 04:41:26.886056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.015 [2024-11-26 04:41:26.886072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.015 [2024-11-26 04:41:26.888458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.015 [2024-11-26 04:41:26.897550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.015 [2024-11-26 04:41:26.897858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.898026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.898076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.015 [2024-11-26 04:41:26.898094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.015 [2024-11-26 04:41:26.898295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.015 [2024-11-26 04:41:26.898481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.015 [2024-11-26 04:41:26.898505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.015 [2024-11-26 04:41:26.898527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.015 [2024-11-26 04:41:26.900816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.015 [2024-11-26 04:41:26.910227] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.015 [2024-11-26 04:41:26.910550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.910703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.015 [2024-11-26 04:41:26.910733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.015 [2024-11-26 04:41:26.910750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.015 [2024-11-26 04:41:26.910933] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.016 [2024-11-26 04:41:26.911101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.016 [2024-11-26 04:41:26.911125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.016 [2024-11-26 04:41:26.911141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.016 [2024-11-26 04:41:26.913580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.016 [2024-11-26 04:41:26.922792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.016 [2024-11-26 04:41:26.923214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.923399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.923428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.016 [2024-11-26 04:41:26.923446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.016 [2024-11-26 04:41:26.923646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.016 [2024-11-26 04:41:26.923811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.016 [2024-11-26 04:41:26.923836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.016 [2024-11-26 04:41:26.923851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.016 [2024-11-26 04:41:26.926127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.016 [2024-11-26 04:41:26.935453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.016 [2024-11-26 04:41:26.935778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.935920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.935949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.016 [2024-11-26 04:41:26.935967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.016 [2024-11-26 04:41:26.936114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.016 [2024-11-26 04:41:26.936319] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.016 [2024-11-26 04:41:26.936343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.016 [2024-11-26 04:41:26.936359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.016 [2024-11-26 04:41:26.938645] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.016 [2024-11-26 04:41:26.948126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.016 [2024-11-26 04:41:26.948397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.948562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.948591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.016 [2024-11-26 04:41:26.948609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.016 [2024-11-26 04:41:26.948822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.016 [2024-11-26 04:41:26.949010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.016 [2024-11-26 04:41:26.949034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.016 [2024-11-26 04:41:26.949049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.016 [2024-11-26 04:41:26.951488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.016 [2024-11-26 04:41:26.960749] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.016 [2024-11-26 04:41:26.961055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.961225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.961254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.016 [2024-11-26 04:41:26.961272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.016 [2024-11-26 04:41:26.961473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.016 [2024-11-26 04:41:26.961707] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.016 [2024-11-26 04:41:26.961733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.016 [2024-11-26 04:41:26.961749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.016 [2024-11-26 04:41:26.964098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.016 [2024-11-26 04:41:26.973216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.016 [2024-11-26 04:41:26.973656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.973954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.974007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.016 [2024-11-26 04:41:26.974024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.016 [2024-11-26 04:41:26.974189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.016 [2024-11-26 04:41:26.974322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.016 [2024-11-26 04:41:26.974345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.016 [2024-11-26 04:41:26.974361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.016 [2024-11-26 04:41:26.976717] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.016 [2024-11-26 04:41:26.985834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.016 [2024-11-26 04:41:26.986159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.986405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.986434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.016 [2024-11-26 04:41:26.986452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.016 [2024-11-26 04:41:26.986616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.016 [2024-11-26 04:41:26.986815] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.016 [2024-11-26 04:41:26.986840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.016 [2024-11-26 04:41:26.986856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.016 [2024-11-26 04:41:26.989078] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.016 [2024-11-26 04:41:26.998536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.016 [2024-11-26 04:41:26.998824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.998989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.016 [2024-11-26 04:41:26.999054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.016 [2024-11-26 04:41:26.999072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.016 [2024-11-26 04:41:26.999273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.016 [2024-11-26 04:41:26.999443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.016 [2024-11-26 04:41:26.999466] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.016 [2024-11-26 04:41:26.999482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.017 [2024-11-26 04:41:27.001770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.017 [2024-11-26 04:41:27.010842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.017 [2024-11-26 04:41:27.011134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.011310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.011341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.017 [2024-11-26 04:41:27.011359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.017 [2024-11-26 04:41:27.011542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.017 [2024-11-26 04:41:27.011724] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.017 [2024-11-26 04:41:27.011749] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.017 [2024-11-26 04:41:27.011764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.017 [2024-11-26 04:41:27.014077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.017 [2024-11-26 04:41:27.023540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.017 [2024-11-26 04:41:27.023815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.023984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.024013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.017 [2024-11-26 04:41:27.024031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.017 [2024-11-26 04:41:27.024178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.017 [2024-11-26 04:41:27.024294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.017 [2024-11-26 04:41:27.024318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.017 [2024-11-26 04:41:27.024334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.017 [2024-11-26 04:41:27.026668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.017 [2024-11-26 04:41:27.035819] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.017 [2024-11-26 04:41:27.036136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.036313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.036363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.017 [2024-11-26 04:41:27.036380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.017 [2024-11-26 04:41:27.036527] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.017 [2024-11-26 04:41:27.036744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.017 [2024-11-26 04:41:27.036769] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.017 [2024-11-26 04:41:27.036785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.017 [2024-11-26 04:41:27.039051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.017 [2024-11-26 04:41:27.048405] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.017 [2024-11-26 04:41:27.048737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.048872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.048902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.017 [2024-11-26 04:41:27.048919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.017 [2024-11-26 04:41:27.049085] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.017 [2024-11-26 04:41:27.049272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.017 [2024-11-26 04:41:27.049296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.017 [2024-11-26 04:41:27.049312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.017 [2024-11-26 04:41:27.051608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.017 [2024-11-26 04:41:27.060892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.017 [2024-11-26 04:41:27.061178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.061317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.061352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.017 [2024-11-26 04:41:27.061371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.017 [2024-11-26 04:41:27.061481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.017 [2024-11-26 04:41:27.061650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.017 [2024-11-26 04:41:27.061674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.017 [2024-11-26 04:41:27.061699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.017 [2024-11-26 04:41:27.063885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.017 [2024-11-26 04:41:27.073390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.017 [2024-11-26 04:41:27.073713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.073879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.073908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.017 [2024-11-26 04:41:27.073925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.017 [2024-11-26 04:41:27.074073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.017 [2024-11-26 04:41:27.074242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.017 [2024-11-26 04:41:27.074266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.017 [2024-11-26 04:41:27.074282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.017 [2024-11-26 04:41:27.076625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.017 [2024-11-26 04:41:27.085952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.017 [2024-11-26 04:41:27.086283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.086397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.017 [2024-11-26 04:41:27.086425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.017 [2024-11-26 04:41:27.086443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.017 [2024-11-26 04:41:27.086572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.017 [2024-11-26 04:41:27.086751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.017 [2024-11-26 04:41:27.086776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.017 [2024-11-26 04:41:27.086792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.017 [2024-11-26 04:41:27.089286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.018 [2024-11-26 04:41:27.098638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.018 [2024-11-26 04:41:27.098959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.099108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.099134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.018 [2024-11-26 04:41:27.099155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.018 [2024-11-26 04:41:27.099345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.018 [2024-11-26 04:41:27.099514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.018 [2024-11-26 04:41:27.099538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.018 [2024-11-26 04:41:27.099554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.018 [2024-11-26 04:41:27.101916] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.018 [2024-11-26 04:41:27.111272] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.018 [2024-11-26 04:41:27.111594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.111758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.111785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.018 [2024-11-26 04:41:27.111802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.018 [2024-11-26 04:41:27.111934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.018 [2024-11-26 04:41:27.112098] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.018 [2024-11-26 04:41:27.112123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.018 [2024-11-26 04:41:27.112138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.018 [2024-11-26 04:41:27.114404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.018 [2024-11-26 04:41:27.123983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.018 [2024-11-26 04:41:27.124310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.124451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.124480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.018 [2024-11-26 04:41:27.124499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.018 [2024-11-26 04:41:27.124646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.018 [2024-11-26 04:41:27.124817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.018 [2024-11-26 04:41:27.124842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.018 [2024-11-26 04:41:27.124858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.018 [2024-11-26 04:41:27.127170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.018 [2024-11-26 04:41:27.136488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.018 [2024-11-26 04:41:27.136786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.136952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.136981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.018 [2024-11-26 04:41:27.136999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.018 [2024-11-26 04:41:27.137117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.018 [2024-11-26 04:41:27.137304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.018 [2024-11-26 04:41:27.137328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.018 [2024-11-26 04:41:27.137343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.018 [2024-11-26 04:41:27.139538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.018 [2024-11-26 04:41:27.148998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.018 [2024-11-26 04:41:27.149388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.149580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.149608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.018 [2024-11-26 04:41:27.149626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.018 [2024-11-26 04:41:27.149784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.018 [2024-11-26 04:41:27.149955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.018 [2024-11-26 04:41:27.149978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.018 [2024-11-26 04:41:27.149994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.018 [2024-11-26 04:41:27.152452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.018 [2024-11-26 04:41:27.161626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.018 [2024-11-26 04:41:27.161890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.162092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.162143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.018 [2024-11-26 04:41:27.162161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.018 [2024-11-26 04:41:27.162326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.018 [2024-11-26 04:41:27.162495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.018 [2024-11-26 04:41:27.162518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.018 [2024-11-26 04:41:27.162534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.018 [2024-11-26 04:41:27.165056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.018 [2024-11-26 04:41:27.174061] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.018 [2024-11-26 04:41:27.174405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.174554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.174579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.018 [2024-11-26 04:41:27.174595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.018 [2024-11-26 04:41:27.174874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.018 [2024-11-26 04:41:27.175050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.018 [2024-11-26 04:41:27.175074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.018 [2024-11-26 04:41:27.175091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.018 [2024-11-26 04:41:27.177293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.018 [2024-11-26 04:41:27.186731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.018 [2024-11-26 04:41:27.187030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.018 [2024-11-26 04:41:27.187168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.019 [2024-11-26 04:41:27.187197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.019 [2024-11-26 04:41:27.187214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.019 [2024-11-26 04:41:27.187343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.019 [2024-11-26 04:41:27.187548] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.019 [2024-11-26 04:41:27.187572] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.019 [2024-11-26 04:41:27.187588] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.019 [2024-11-26 04:41:27.189856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.019 [2024-11-26 04:41:27.199389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.019 [2024-11-26 04:41:27.199701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.019 [2024-11-26 04:41:27.199843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.019 [2024-11-26 04:41:27.199872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.019 [2024-11-26 04:41:27.199890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.019 [2024-11-26 04:41:27.200074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.019 [2024-11-26 04:41:27.200225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.019 [2024-11-26 04:41:27.200248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.019 [2024-11-26 04:41:27.200264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.019 [2024-11-26 04:41:27.202668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.019 [2024-11-26 04:41:27.212093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.019 [2024-11-26 04:41:27.212389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.019 [2024-11-26 04:41:27.212530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.019 [2024-11-26 04:41:27.212559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.019 [2024-11-26 04:41:27.212577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.019 [2024-11-26 04:41:27.212754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.019 [2024-11-26 04:41:27.212888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.019 [2024-11-26 04:41:27.212917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.019 [2024-11-26 04:41:27.212933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.019 [2024-11-26 04:41:27.215156] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.281 [2024-11-26 04:41:27.224796] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.281 [2024-11-26 04:41:27.225079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.281 [2024-11-26 04:41:27.225211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.281 [2024-11-26 04:41:27.225238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.281 [2024-11-26 04:41:27.225254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.281 [2024-11-26 04:41:27.225451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.281 [2024-11-26 04:41:27.225621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.281 [2024-11-26 04:41:27.225645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.281 [2024-11-26 04:41:27.225660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.281 [2024-11-26 04:41:27.228097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.281 [2024-11-26 04:41:27.237343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.281 [2024-11-26 04:41:27.237714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.281 [2024-11-26 04:41:27.237906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.281 [2024-11-26 04:41:27.237935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.281 [2024-11-26 04:41:27.237953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.281 [2024-11-26 04:41:27.238082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.281 [2024-11-26 04:41:27.238215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.281 [2024-11-26 04:41:27.238239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.281 [2024-11-26 04:41:27.238254] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.281 [2024-11-26 04:41:27.240423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.281 [2024-11-26 04:41:27.250052] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.281 [2024-11-26 04:41:27.250442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.281 [2024-11-26 04:41:27.250562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.281 [2024-11-26 04:41:27.250592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.281 [2024-11-26 04:41:27.250609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.281 [2024-11-26 04:41:27.250791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.281 [2024-11-26 04:41:27.250980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.281 [2024-11-26 04:41:27.251004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.281 [2024-11-26 04:41:27.251026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.281 [2024-11-26 04:41:27.253285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.281 [2024-11-26 04:41:27.262596] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.281 [2024-11-26 04:41:27.262947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.281 [2024-11-26 04:41:27.263172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.281 [2024-11-26 04:41:27.263212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.281 [2024-11-26 04:41:27.263228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.281 [2024-11-26 04:41:27.263408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.281 [2024-11-26 04:41:27.263577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.281 [2024-11-26 04:41:27.263601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.281 [2024-11-26 04:41:27.263616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.281 [2024-11-26 04:41:27.265867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.281 [2024-11-26 04:41:27.275321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.281 [2024-11-26 04:41:27.275663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.281 [2024-11-26 04:41:27.275813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.281 [2024-11-26 04:41:27.275842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.281 [2024-11-26 04:41:27.275860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.281 [2024-11-26 04:41:27.276025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.281 [2024-11-26 04:41:27.276158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.281 [2024-11-26 04:41:27.276181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.281 [2024-11-26 04:41:27.276197] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.281 [2024-11-26 04:41:27.278461] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.281 [2024-11-26 04:41:27.287970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.282 [2024-11-26 04:41:27.288274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.288420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.288448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.282 [2024-11-26 04:41:27.288466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.282 [2024-11-26 04:41:27.288594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.282 [2024-11-26 04:41:27.288757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.282 [2024-11-26 04:41:27.288783] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.282 [2024-11-26 04:41:27.288799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.282 [2024-11-26 04:41:27.291117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.282 [2024-11-26 04:41:27.300643] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.282 [2024-11-26 04:41:27.301011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.301191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.301219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.282 [2024-11-26 04:41:27.301237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.282 [2024-11-26 04:41:27.301401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.282 [2024-11-26 04:41:27.301571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.282 [2024-11-26 04:41:27.301594] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.282 [2024-11-26 04:41:27.301611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.282 [2024-11-26 04:41:27.303968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.282 [2024-11-26 04:41:27.313389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.282 [2024-11-26 04:41:27.313734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.313908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.313937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.282 [2024-11-26 04:41:27.313955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.282 [2024-11-26 04:41:27.314109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.282 [2024-11-26 04:41:27.314278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.282 [2024-11-26 04:41:27.314301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.282 [2024-11-26 04:41:27.314317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.282 [2024-11-26 04:41:27.316631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.282 [2024-11-26 04:41:27.325945] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.282 [2024-11-26 04:41:27.326275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.326445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.326474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.282 [2024-11-26 04:41:27.326491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.282 [2024-11-26 04:41:27.326657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.282 [2024-11-26 04:41:27.326821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.282 [2024-11-26 04:41:27.326846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.282 [2024-11-26 04:41:27.326862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.282 [2024-11-26 04:41:27.329031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.282 [2024-11-26 04:41:27.338484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.282 [2024-11-26 04:41:27.338760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.338944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.338986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.282 [2024-11-26 04:41:27.339005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.282 [2024-11-26 04:41:27.339187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.282 [2024-11-26 04:41:27.339391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.282 [2024-11-26 04:41:27.339416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.282 [2024-11-26 04:41:27.339431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.282 [2024-11-26 04:41:27.341737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.282 [2024-11-26 04:41:27.351067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.282 [2024-11-26 04:41:27.351398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.351567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.351596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.282 [2024-11-26 04:41:27.351614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.282 [2024-11-26 04:41:27.351845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.282 [2024-11-26 04:41:27.351979] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.282 [2024-11-26 04:41:27.352003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.282 [2024-11-26 04:41:27.352019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.282 [2024-11-26 04:41:27.354404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.282 [2024-11-26 04:41:27.363704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.282 [2024-11-26 04:41:27.364053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.364222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.364251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.282 [2024-11-26 04:41:27.364270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.282 [2024-11-26 04:41:27.364455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.282 [2024-11-26 04:41:27.364623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.282 [2024-11-26 04:41:27.364648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.282 [2024-11-26 04:41:27.364664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.282 [2024-11-26 04:41:27.366972] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.282 [2024-11-26 04:41:27.376170] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.282 [2024-11-26 04:41:27.376509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.376701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.282 [2024-11-26 04:41:27.376739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.282 [2024-11-26 04:41:27.376758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.282 [2024-11-26 04:41:27.376923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.282 [2024-11-26 04:41:27.377074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.283 [2024-11-26 04:41:27.377099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.283 [2024-11-26 04:41:27.377115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.283 [2024-11-26 04:41:27.379394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.283 [2024-11-26 04:41:27.388964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.283 [2024-11-26 04:41:27.389350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.389478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.389506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.283 [2024-11-26 04:41:27.389524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.283 [2024-11-26 04:41:27.389672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.283 [2024-11-26 04:41:27.389852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.283 [2024-11-26 04:41:27.389878] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.283 [2024-11-26 04:41:27.389894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.283 [2024-11-26 04:41:27.392243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.283 [2024-11-26 04:41:27.401462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.283 [2024-11-26 04:41:27.401790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.401962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.401989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.283 [2024-11-26 04:41:27.402006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.283 [2024-11-26 04:41:27.402149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.283 [2024-11-26 04:41:27.402327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.283 [2024-11-26 04:41:27.402353] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.283 [2024-11-26 04:41:27.402369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.283 [2024-11-26 04:41:27.404840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.283 [2024-11-26 04:41:27.414106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.283 [2024-11-26 04:41:27.414372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.414514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.414554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.283 [2024-11-26 04:41:27.414574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.283 [2024-11-26 04:41:27.414774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.283 [2024-11-26 04:41:27.414907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.283 [2024-11-26 04:41:27.414933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.283 [2024-11-26 04:41:27.414949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.283 [2024-11-26 04:41:27.417339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.283 [2024-11-26 04:41:27.426562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.283 [2024-11-26 04:41:27.426935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.427085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.427111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.283 [2024-11-26 04:41:27.427127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.283 [2024-11-26 04:41:27.427346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.283 [2024-11-26 04:41:27.427498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.283 [2024-11-26 04:41:27.427522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.283 [2024-11-26 04:41:27.427538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.283 [2024-11-26 04:41:27.429941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.283 [2024-11-26 04:41:27.439222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.283 [2024-11-26 04:41:27.439526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.439704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.439736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.283 [2024-11-26 04:41:27.439754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.283 [2024-11-26 04:41:27.439937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.283 [2024-11-26 04:41:27.440052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.283 [2024-11-26 04:41:27.440077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.283 [2024-11-26 04:41:27.440093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.283 [2024-11-26 04:41:27.442519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.283 [2024-11-26 04:41:27.451508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.283 [2024-11-26 04:41:27.451819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.451996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.452024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.283 [2024-11-26 04:41:27.452060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.283 [2024-11-26 04:41:27.452254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.283 [2024-11-26 04:41:27.452423] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.283 [2024-11-26 04:41:27.452447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.283 [2024-11-26 04:41:27.452463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.283 [2024-11-26 04:41:27.454777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.283 [2024-11-26 04:41:27.463873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.283 [2024-11-26 04:41:27.464175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.464343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.283 [2024-11-26 04:41:27.464373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.283 [2024-11-26 04:41:27.464391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.283 [2024-11-26 04:41:27.464540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.283 [2024-11-26 04:41:27.464673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.283 [2024-11-26 04:41:27.464714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.283 [2024-11-26 04:41:27.464732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.283 [2024-11-26 04:41:27.467032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.284 [2024-11-26 04:41:27.476518] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.284 [2024-11-26 04:41:27.476882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.284 [2024-11-26 04:41:27.477064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.284 [2024-11-26 04:41:27.477089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.284 [2024-11-26 04:41:27.477121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.284 [2024-11-26 04:41:27.477304] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.284 [2024-11-26 04:41:27.477491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.284 [2024-11-26 04:41:27.477516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.284 [2024-11-26 04:41:27.477532] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.284 [2024-11-26 04:41:27.480042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.284 [2024-11-26 04:41:27.489122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.284 [2024-11-26 04:41:27.489483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.284 [2024-11-26 04:41:27.489646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.284 [2024-11-26 04:41:27.489675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.284 [2024-11-26 04:41:27.489705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.284 [2024-11-26 04:41:27.489895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.284 [2024-11-26 04:41:27.490082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.284 [2024-11-26 04:41:27.490107] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.284 [2024-11-26 04:41:27.490123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.284 [2024-11-26 04:41:27.492583] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.284 [2024-11-26 04:41:27.501621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.547 [2024-11-26 04:41:27.501948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.547 [2024-11-26 04:41:27.502129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.547 [2024-11-26 04:41:27.502156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.547 [2024-11-26 04:41:27.502172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.547 [2024-11-26 04:41:27.502404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.547 [2024-11-26 04:41:27.502610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.547 [2024-11-26 04:41:27.502635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.547 [2024-11-26 04:41:27.502651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.547 [2024-11-26 04:41:27.504820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.547 [2024-11-26 04:41:27.514119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.547 [2024-11-26 04:41:27.514403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.547 [2024-11-26 04:41:27.514582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.547 [2024-11-26 04:41:27.514610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.547 [2024-11-26 04:41:27.514626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.547 [2024-11-26 04:41:27.514863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.547 [2024-11-26 04:41:27.515070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.547 [2024-11-26 04:41:27.515096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.547 [2024-11-26 04:41:27.515112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.547 [2024-11-26 04:41:27.517394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.547 [2024-11-26 04:41:27.526916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.547 [2024-11-26 04:41:27.527216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.547 [2024-11-26 04:41:27.527385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.547 [2024-11-26 04:41:27.527412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.547 [2024-11-26 04:41:27.527428] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.547 [2024-11-26 04:41:27.527580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.547 [2024-11-26 04:41:27.527762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.547 [2024-11-26 04:41:27.527789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.547 [2024-11-26 04:41:27.527806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.547 [2024-11-26 04:41:27.530197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.547 [2024-11-26 04:41:27.539333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.547 [2024-11-26 04:41:27.539625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.547 [2024-11-26 04:41:27.539772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.547 [2024-11-26 04:41:27.539803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.547 [2024-11-26 04:41:27.539821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.547 [2024-11-26 04:41:27.539950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.547 [2024-11-26 04:41:27.540138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.547 [2024-11-26 04:41:27.540162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.547 [2024-11-26 04:41:27.540178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.547 [2024-11-26 04:41:27.542527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.547 [2024-11-26 04:41:27.552018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.547 [2024-11-26 04:41:27.552403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.547 [2024-11-26 04:41:27.552568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.547 [2024-11-26 04:41:27.552597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.547 [2024-11-26 04:41:27.552616] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.547 [2024-11-26 04:41:27.552773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.547 [2024-11-26 04:41:27.552980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.547 [2024-11-26 04:41:27.553004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.547 [2024-11-26 04:41:27.553020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.547 [2024-11-26 04:41:27.555298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.547 [2024-11-26 04:41:27.564607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.547 [2024-11-26 04:41:27.564920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.547 [2024-11-26 04:41:27.565094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.547 [2024-11-26 04:41:27.565142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.547 [2024-11-26 04:41:27.565160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.547 [2024-11-26 04:41:27.565308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.547 [2024-11-26 04:41:27.565468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.547 [2024-11-26 04:41:27.565492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.547 [2024-11-26 04:41:27.565514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.547 [2024-11-26 04:41:27.567859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.548 [2024-11-26 04:41:27.577089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.548 [2024-11-26 04:41:27.577466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.577566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.577592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.548 [2024-11-26 04:41:27.577609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.548 [2024-11-26 04:41:27.577750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.548 [2024-11-26 04:41:27.577948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.548 [2024-11-26 04:41:27.577973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.548 [2024-11-26 04:41:27.577989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.548 [2024-11-26 04:41:27.580356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.548 [2024-11-26 04:41:27.589525] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.548 [2024-11-26 04:41:27.589862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.589986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.590028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.548 [2024-11-26 04:41:27.590046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.548 [2024-11-26 04:41:27.590194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.548 [2024-11-26 04:41:27.590380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.548 [2024-11-26 04:41:27.590406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.548 [2024-11-26 04:41:27.590422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.548 [2024-11-26 04:41:27.592850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.548 [2024-11-26 04:41:27.602053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.548 [2024-11-26 04:41:27.602320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.602500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.602531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.548 [2024-11-26 04:41:27.602549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.548 [2024-11-26 04:41:27.602743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.548 [2024-11-26 04:41:27.602914] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.548 [2024-11-26 04:41:27.602935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.548 [2024-11-26 04:41:27.602955] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.548 [2024-11-26 04:41:27.605184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.548 [2024-11-26 04:41:27.614767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.548 [2024-11-26 04:41:27.615006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.615122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.615152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.548 [2024-11-26 04:41:27.615170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.548 [2024-11-26 04:41:27.615352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.548 [2024-11-26 04:41:27.615504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.548 [2024-11-26 04:41:27.615529] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.548 [2024-11-26 04:41:27.615545] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.548 [2024-11-26 04:41:27.617930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.548 [2024-11-26 04:41:27.627415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.548 [2024-11-26 04:41:27.627748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.627857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.627884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.548 [2024-11-26 04:41:27.627900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.548 [2024-11-26 04:41:27.628127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.548 [2024-11-26 04:41:27.628224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.548 [2024-11-26 04:41:27.628247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.548 [2024-11-26 04:41:27.628263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.548 [2024-11-26 04:41:27.630416] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.548 [2024-11-26 04:41:27.639980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.548 [2024-11-26 04:41:27.640341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.640517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.640547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.548 [2024-11-26 04:41:27.640565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.548 [2024-11-26 04:41:27.640757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.548 [2024-11-26 04:41:27.640894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.548 [2024-11-26 04:41:27.640915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.548 [2024-11-26 04:41:27.640929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.548 [2024-11-26 04:41:27.643304] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.548 [2024-11-26 04:41:27.652454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.548 [2024-11-26 04:41:27.652773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.652885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.652911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.548 [2024-11-26 04:41:27.652928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.548 [2024-11-26 04:41:27.653106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.548 [2024-11-26 04:41:27.653313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.548 [2024-11-26 04:41:27.653339] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.548 [2024-11-26 04:41:27.653355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.548 [2024-11-26 04:41:27.655505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.548 [2024-11-26 04:41:27.664854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.548 [2024-11-26 04:41:27.665152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.665321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.548 [2024-11-26 04:41:27.665350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.548 [2024-11-26 04:41:27.665369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.548 [2024-11-26 04:41:27.665552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.548 [2024-11-26 04:41:27.665733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.549 [2024-11-26 04:41:27.665758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.549 [2024-11-26 04:41:27.665774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.549 [2024-11-26 04:41:27.668187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.549 [2024-11-26 04:41:27.677640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.549 [2024-11-26 04:41:27.677947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.678121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.678146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.549 [2024-11-26 04:41:27.678162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.549 [2024-11-26 04:41:27.678321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.549 [2024-11-26 04:41:27.678507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.549 [2024-11-26 04:41:27.678532] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.549 [2024-11-26 04:41:27.678548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.549 [2024-11-26 04:41:27.680912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.549 [2024-11-26 04:41:27.690317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.549 [2024-11-26 04:41:27.690666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.690827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.690854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.549 [2024-11-26 04:41:27.690870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.549 [2024-11-26 04:41:27.691008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.549 [2024-11-26 04:41:27.691161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.549 [2024-11-26 04:41:27.691186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.549 [2024-11-26 04:41:27.691202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.549 [2024-11-26 04:41:27.693360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.549 [2024-11-26 04:41:27.702663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.549 [2024-11-26 04:41:27.702935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.703133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.703182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.549 [2024-11-26 04:41:27.703200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.549 [2024-11-26 04:41:27.703437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.549 [2024-11-26 04:41:27.703623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.549 [2024-11-26 04:41:27.703648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.549 [2024-11-26 04:41:27.703664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.549 [2024-11-26 04:41:27.706024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.549 [2024-11-26 04:41:27.715340] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.549 [2024-11-26 04:41:27.715662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.715850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.715878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.549 [2024-11-26 04:41:27.715911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.549 [2024-11-26 04:41:27.716040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.549 [2024-11-26 04:41:27.716246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.549 [2024-11-26 04:41:27.716271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.549 [2024-11-26 04:41:27.716287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.549 [2024-11-26 04:41:27.718641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.549 [2024-11-26 04:41:27.728027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.549 [2024-11-26 04:41:27.728416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.728589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.728618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.549 [2024-11-26 04:41:27.728636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.549 [2024-11-26 04:41:27.728792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.549 [2024-11-26 04:41:27.728943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.549 [2024-11-26 04:41:27.728966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.549 [2024-11-26 04:41:27.728981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.549 [2024-11-26 04:41:27.731282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.549 [2024-11-26 04:41:27.740591] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.549 [2024-11-26 04:41:27.740956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.741150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.741198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.549 [2024-11-26 04:41:27.741216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.549 [2024-11-26 04:41:27.741382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.549 [2024-11-26 04:41:27.741550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.549 [2024-11-26 04:41:27.741575] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.549 [2024-11-26 04:41:27.741591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.549 [2024-11-26 04:41:27.744055] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.549 [2024-11-26 04:41:27.753036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.549 [2024-11-26 04:41:27.753337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.753508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.753538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.549 [2024-11-26 04:41:27.753556] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.549 [2024-11-26 04:41:27.753793] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.549 [2024-11-26 04:41:27.754000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.549 [2024-11-26 04:41:27.754026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.549 [2024-11-26 04:41:27.754042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.549 [2024-11-26 04:41:27.756269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.549 [2024-11-26 04:41:27.765636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.549 [2024-11-26 04:41:27.765937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.549 [2024-11-26 04:41:27.766112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.550 [2024-11-26 04:41:27.766139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.550 [2024-11-26 04:41:27.766160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.550 [2024-11-26 04:41:27.766401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.550 [2024-11-26 04:41:27.766571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.550 [2024-11-26 04:41:27.766597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.550 [2024-11-26 04:41:27.766613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.812 [2024-11-26 04:41:27.768949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.812 [2024-11-26 04:41:27.778092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.812 [2024-11-26 04:41:27.778382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.812 [2024-11-26 04:41:27.778517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.812 [2024-11-26 04:41:27.778548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.812 [2024-11-26 04:41:27.778567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.812 [2024-11-26 04:41:27.778730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.812 [2024-11-26 04:41:27.778864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.812 [2024-11-26 04:41:27.778887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.812 [2024-11-26 04:41:27.778903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.812 [2024-11-26 04:41:27.781256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.812 [2024-11-26 04:41:27.790679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.812 [2024-11-26 04:41:27.791062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.812 [2024-11-26 04:41:27.791229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.812 [2024-11-26 04:41:27.791260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.812 [2024-11-26 04:41:27.791278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.812 [2024-11-26 04:41:27.791443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.812 [2024-11-26 04:41:27.791575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.812 [2024-11-26 04:41:27.791601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.812 [2024-11-26 04:41:27.791617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.812 [2024-11-26 04:41:27.793821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.812 [2024-11-26 04:41:27.803303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.812 [2024-11-26 04:41:27.803650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.812 [2024-11-26 04:41:27.803821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.812 [2024-11-26 04:41:27.803851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.812 [2024-11-26 04:41:27.803869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.812 [2024-11-26 04:41:27.804041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.812 [2024-11-26 04:41:27.804194] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.812 [2024-11-26 04:41:27.804219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.812 [2024-11-26 04:41:27.804235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.812 [2024-11-26 04:41:27.806643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.812 [2024-11-26 04:41:27.815831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.812 [2024-11-26 04:41:27.816123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.812 [2024-11-26 04:41:27.816236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.812 [2024-11-26 04:41:27.816264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.812 [2024-11-26 04:41:27.816283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.812 [2024-11-26 04:41:27.816485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.812 [2024-11-26 04:41:27.816715] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.812 [2024-11-26 04:41:27.816742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.812 [2024-11-26 04:41:27.816758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.812 [2024-11-26 04:41:27.819239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.812 [2024-11-26 04:41:27.828418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.812 [2024-11-26 04:41:27.828756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.812 [2024-11-26 04:41:27.828864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.812 [2024-11-26 04:41:27.828889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.812 [2024-11-26 04:41:27.828907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.812 [2024-11-26 04:41:27.829057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.812 [2024-11-26 04:41:27.829284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.812 [2024-11-26 04:41:27.829310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.812 [2024-11-26 04:41:27.829327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.813 [2024-11-26 04:41:27.831642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.813 [2024-11-26 04:41:27.841090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.813 [2024-11-26 04:41:27.841531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.841669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.841723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.813 [2024-11-26 04:41:27.841742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.813 [2024-11-26 04:41:27.841889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.813 [2024-11-26 04:41:27.842046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.813 [2024-11-26 04:41:27.842069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.813 [2024-11-26 04:41:27.842085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.813 [2024-11-26 04:41:27.844583] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.813 [2024-11-26 04:41:27.853761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.813 [2024-11-26 04:41:27.854117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.854275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.854307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.813 [2024-11-26 04:41:27.854326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.813 [2024-11-26 04:41:27.854492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.813 [2024-11-26 04:41:27.854661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.813 [2024-11-26 04:41:27.854697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.813 [2024-11-26 04:41:27.854716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.813 [2024-11-26 04:41:27.857014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.813 [2024-11-26 04:41:27.866380] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.813 [2024-11-26 04:41:27.866775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.866920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.866948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.813 [2024-11-26 04:41:27.866966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.813 [2024-11-26 04:41:27.867113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.813 [2024-11-26 04:41:27.867246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.813 [2024-11-26 04:41:27.867269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.813 [2024-11-26 04:41:27.867284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.813 [2024-11-26 04:41:27.869543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.813 [2024-11-26 04:41:27.879152] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.813 [2024-11-26 04:41:27.879509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.879650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.879678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.813 [2024-11-26 04:41:27.879710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.813 [2024-11-26 04:41:27.879896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.813 [2024-11-26 04:41:27.880028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.813 [2024-11-26 04:41:27.880057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.813 [2024-11-26 04:41:27.880073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.813 [2024-11-26 04:41:27.882481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.813 [2024-11-26 04:41:27.891827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.813 [2024-11-26 04:41:27.892159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.892325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.892355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.813 [2024-11-26 04:41:27.892373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.813 [2024-11-26 04:41:27.892557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.813 [2024-11-26 04:41:27.892738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.813 [2024-11-26 04:41:27.892764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.813 [2024-11-26 04:41:27.892781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.813 [2024-11-26 04:41:27.895133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.813 [2024-11-26 04:41:27.904300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.813 [2024-11-26 04:41:27.904619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.904763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.904791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.813 [2024-11-26 04:41:27.904809] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.813 [2024-11-26 04:41:27.904992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.813 [2024-11-26 04:41:27.905197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.813 [2024-11-26 04:41:27.905223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.813 [2024-11-26 04:41:27.905239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.813 [2024-11-26 04:41:27.907520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.813 [2024-11-26 04:41:27.916864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.813 [2024-11-26 04:41:27.917296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.917532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.917594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.813 [2024-11-26 04:41:27.917612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.813 [2024-11-26 04:41:27.917812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.813 [2024-11-26 04:41:27.917983] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.813 [2024-11-26 04:41:27.918008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.813 [2024-11-26 04:41:27.918029] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.813 [2024-11-26 04:41:27.920455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.813 [2024-11-26 04:41:27.929551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.813 [2024-11-26 04:41:27.929865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.930006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.930036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.813 [2024-11-26 04:41:27.930054] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.813 [2024-11-26 04:41:27.930201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.813 [2024-11-26 04:41:27.930334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.813 [2024-11-26 04:41:27.930358] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.813 [2024-11-26 04:41:27.930375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.813 [2024-11-26 04:41:27.932638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.813 [2024-11-26 04:41:27.941966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.813 [2024-11-26 04:41:27.942311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.942477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.942505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.813 [2024-11-26 04:41:27.942522] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.813 [2024-11-26 04:41:27.942737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.813 [2024-11-26 04:41:27.942871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.813 [2024-11-26 04:41:27.942894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.813 [2024-11-26 04:41:27.942911] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.813 [2024-11-26 04:41:27.945280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.813 [2024-11-26 04:41:27.954534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.813 [2024-11-26 04:41:27.954886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.813 [2024-11-26 04:41:27.955026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:27.955056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.814 [2024-11-26 04:41:27.955073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.814 [2024-11-26 04:41:27.955255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.814 [2024-11-26 04:41:27.955406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.814 [2024-11-26 04:41:27.955430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.814 [2024-11-26 04:41:27.955446] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.814 [2024-11-26 04:41:27.957779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.814 [2024-11-26 04:41:27.967067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.814 [2024-11-26 04:41:27.967398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:27.967545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:27.967575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.814 [2024-11-26 04:41:27.967593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.814 [2024-11-26 04:41:27.967740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.814 [2024-11-26 04:41:27.967885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.814 [2024-11-26 04:41:27.967908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.814 [2024-11-26 04:41:27.967925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.814 [2024-11-26 04:41:27.970349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.814 [2024-11-26 04:41:27.979583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.814 [2024-11-26 04:41:27.979863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:27.980017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:27.980043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.814 [2024-11-26 04:41:27.980059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.814 [2024-11-26 04:41:27.980286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.814 [2024-11-26 04:41:27.980468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.814 [2024-11-26 04:41:27.980493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.814 [2024-11-26 04:41:27.980509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.814 [2024-11-26 04:41:27.982991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.814 [2024-11-26 04:41:27.992091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.814 [2024-11-26 04:41:27.992423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:27.992559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:27.992586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.814 [2024-11-26 04:41:27.992604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.814 [2024-11-26 04:41:27.992782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.814 [2024-11-26 04:41:27.992934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.814 [2024-11-26 04:41:27.992958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.814 [2024-11-26 04:41:27.992973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.814 [2024-11-26 04:41:27.995394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.814 [2024-11-26 04:41:28.004661] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.814 [2024-11-26 04:41:28.004986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:28.005175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:28.005221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.814 [2024-11-26 04:41:28.005239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.814 [2024-11-26 04:41:28.005403] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.814 [2024-11-26 04:41:28.005608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.814 [2024-11-26 04:41:28.005633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.814 [2024-11-26 04:41:28.005650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.814 [2024-11-26 04:41:28.008015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.814 [2024-11-26 04:41:28.017274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.814 [2024-11-26 04:41:28.017736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:28.017860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:28.017890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.814 [2024-11-26 04:41:28.017909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.814 [2024-11-26 04:41:28.018093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.814 [2024-11-26 04:41:28.018264] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.814 [2024-11-26 04:41:28.018289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.814 [2024-11-26 04:41:28.018305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.814 [2024-11-26 04:41:28.020741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.814 [2024-11-26 04:41:28.029833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.814 [2024-11-26 04:41:28.030097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:28.030263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.814 [2024-11-26 04:41:28.030311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:48.814 [2024-11-26 04:41:28.030330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:48.814 [2024-11-26 04:41:28.030460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:48.814 [2024-11-26 04:41:28.030573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.814 [2024-11-26 04:41:28.030596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.814 [2024-11-26 04:41:28.030612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.076 [2024-11-26 04:41:28.032979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.076 [2024-11-26 04:41:28.042230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.076 [2024-11-26 04:41:28.042582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.076 [2024-11-26 04:41:28.042705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.076 [2024-11-26 04:41:28.042735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.076 [2024-11-26 04:41:28.042753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.076 [2024-11-26 04:41:28.042918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.076 [2024-11-26 04:41:28.043123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.076 [2024-11-26 04:41:28.043148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.076 [2024-11-26 04:41:28.043164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.076 [2024-11-26 04:41:28.045481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.076 [2024-11-26 04:41:28.054969] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.076 [2024-11-26 04:41:28.055262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.076 [2024-11-26 04:41:28.055429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.076 [2024-11-26 04:41:28.055460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.076 [2024-11-26 04:41:28.055478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.076 [2024-11-26 04:41:28.055643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.076 [2024-11-26 04:41:28.055845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.076 [2024-11-26 04:41:28.055871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.076 [2024-11-26 04:41:28.055887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.076 [2024-11-26 04:41:28.058153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.076 [2024-11-26 04:41:28.067603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.076 [2024-11-26 04:41:28.067923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.076 [2024-11-26 04:41:28.068080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.076 [2024-11-26 04:41:28.068109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.076 [2024-11-26 04:41:28.068126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.076 [2024-11-26 04:41:28.068286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.076 [2024-11-26 04:41:28.068474] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.076 [2024-11-26 04:41:28.068500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.076 [2024-11-26 04:41:28.068516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.076 [2024-11-26 04:41:28.070621] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.076 [2024-11-26 04:41:28.080305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.076 [2024-11-26 04:41:28.080611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.076 [2024-11-26 04:41:28.080756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.076 [2024-11-26 04:41:28.080793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.076 [2024-11-26 04:41:28.080814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.076 [2024-11-26 04:41:28.080945] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.076 [2024-11-26 04:41:28.081077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.076 [2024-11-26 04:41:28.081100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.076 [2024-11-26 04:41:28.081116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.076 [2024-11-26 04:41:28.083492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.076 [2024-11-26 04:41:28.092721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.076 [2024-11-26 04:41:28.093066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.093202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.093227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.077 [2024-11-26 04:41:28.093243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.077 [2024-11-26 04:41:28.093386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.077 [2024-11-26 04:41:28.093552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.077 [2024-11-26 04:41:28.093576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.077 [2024-11-26 04:41:28.093591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.077 [2024-11-26 04:41:28.095879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.077 [2024-11-26 04:41:28.105257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.077 [2024-11-26 04:41:28.105678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.105864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.105893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.077 [2024-11-26 04:41:28.105911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.077 [2024-11-26 04:41:28.106095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.077 [2024-11-26 04:41:28.106284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.077 [2024-11-26 04:41:28.106309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.077 [2024-11-26 04:41:28.106325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.077 [2024-11-26 04:41:28.108536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.077 [2024-11-26 04:41:28.117804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.077 [2024-11-26 04:41:28.118151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.118280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.118343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.077 [2024-11-26 04:41:28.118368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.077 [2024-11-26 04:41:28.118570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.077 [2024-11-26 04:41:28.118769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.077 [2024-11-26 04:41:28.118794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.077 [2024-11-26 04:41:28.118809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.077 [2024-11-26 04:41:28.121177] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.077 [2024-11-26 04:41:28.130545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.077 [2024-11-26 04:41:28.130874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.131026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.131056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.077 [2024-11-26 04:41:28.131074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.077 [2024-11-26 04:41:28.131204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.077 [2024-11-26 04:41:28.131409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.077 [2024-11-26 04:41:28.131435] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.077 [2024-11-26 04:41:28.131451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.077 [2024-11-26 04:41:28.133777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.077 [2024-11-26 04:41:28.143182] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.077 [2024-11-26 04:41:28.143523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.143702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.143741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.077 [2024-11-26 04:41:28.143759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.077 [2024-11-26 04:41:28.143978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.077 [2024-11-26 04:41:28.144166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.077 [2024-11-26 04:41:28.144192] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.077 [2024-11-26 04:41:28.144208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.077 [2024-11-26 04:41:28.146573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.077 [2024-11-26 04:41:28.155609] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.077 [2024-11-26 04:41:28.155957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.156125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.156168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.077 [2024-11-26 04:41:28.156184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.077 [2024-11-26 04:41:28.156368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.077 [2024-11-26 04:41:28.156518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.077 [2024-11-26 04:41:28.156544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.077 [2024-11-26 04:41:28.156560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.077 [2024-11-26 04:41:28.159027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.077 [2024-11-26 04:41:28.168160] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.077 [2024-11-26 04:41:28.168461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.168617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.168644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.077 [2024-11-26 04:41:28.168676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.077 [2024-11-26 04:41:28.168816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.077 [2024-11-26 04:41:28.168984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.077 [2024-11-26 04:41:28.169010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.077 [2024-11-26 04:41:28.169026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.077 [2024-11-26 04:41:28.171379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.077 [2024-11-26 04:41:28.180787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.077 [2024-11-26 04:41:28.181231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.181415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.181440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.077 [2024-11-26 04:41:28.181470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.077 [2024-11-26 04:41:28.181659] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.077 [2024-11-26 04:41:28.181864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.077 [2024-11-26 04:41:28.181890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.077 [2024-11-26 04:41:28.181907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.077 [2024-11-26 04:41:28.184031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.077 [2024-11-26 04:41:28.193390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.077 [2024-11-26 04:41:28.193837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.194033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.194058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.077 [2024-11-26 04:41:28.194073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.077 [2024-11-26 04:41:28.194242] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.077 [2024-11-26 04:41:28.194448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.077 [2024-11-26 04:41:28.194473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.077 [2024-11-26 04:41:28.194490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.077 [2024-11-26 04:41:28.196803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.077 [2024-11-26 04:41:28.205858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.077 [2024-11-26 04:41:28.206246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.206350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.077 [2024-11-26 04:41:28.206374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.078 [2024-11-26 04:41:28.206389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.078 [2024-11-26 04:41:28.206555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.078 [2024-11-26 04:41:28.206720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.078 [2024-11-26 04:41:28.206744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.078 [2024-11-26 04:41:28.206760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.078 [2024-11-26 04:41:28.209094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.078 [2024-11-26 04:41:28.218630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.078 [2024-11-26 04:41:28.218948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.219129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.219157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.078 [2024-11-26 04:41:28.219173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.078 [2024-11-26 04:41:28.219345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.078 [2024-11-26 04:41:28.219518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.078 [2024-11-26 04:41:28.219543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.078 [2024-11-26 04:41:28.219560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.078 [2024-11-26 04:41:28.221964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.078 [2024-11-26 04:41:28.231150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.078 [2024-11-26 04:41:28.231497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.231645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.231669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.078 [2024-11-26 04:41:28.231696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.078 [2024-11-26 04:41:28.231873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.078 [2024-11-26 04:41:28.232023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.078 [2024-11-26 04:41:28.232052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.078 [2024-11-26 04:41:28.232068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.078 [2024-11-26 04:41:28.234259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.078 [2024-11-26 04:41:28.243537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.078 [2024-11-26 04:41:28.243884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.243994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.244021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.078 [2024-11-26 04:41:28.244039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.078 [2024-11-26 04:41:28.244222] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.078 [2024-11-26 04:41:28.244409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.078 [2024-11-26 04:41:28.244434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.078 [2024-11-26 04:41:28.244450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.078 [2024-11-26 04:41:28.246943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.078 [2024-11-26 04:41:28.255955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.078 [2024-11-26 04:41:28.256313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.256479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.256508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.078 [2024-11-26 04:41:28.256526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.078 [2024-11-26 04:41:28.256673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.078 [2024-11-26 04:41:28.256823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.078 [2024-11-26 04:41:28.256847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.078 [2024-11-26 04:41:28.256862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.078 [2024-11-26 04:41:28.258923] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.078 [2024-11-26 04:41:28.268654] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.078 [2024-11-26 04:41:28.268989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.269187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.269243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.078 [2024-11-26 04:41:28.269262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.078 [2024-11-26 04:41:28.269463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.078 [2024-11-26 04:41:28.269587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.078 [2024-11-26 04:41:28.269612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.078 [2024-11-26 04:41:28.269634] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.078 [2024-11-26 04:41:28.272020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.078 [2024-11-26 04:41:28.281163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.078 [2024-11-26 04:41:28.281444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.281613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.281643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.078 [2024-11-26 04:41:28.281663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.078 [2024-11-26 04:41:28.281878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.078 [2024-11-26 04:41:28.282065] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.078 [2024-11-26 04:41:28.282090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.078 [2024-11-26 04:41:28.282106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.078 [2024-11-26 04:41:28.284374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.078 [2024-11-26 04:41:28.293641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.078 [2024-11-26 04:41:28.293974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.294096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.078 [2024-11-26 04:41:28.294125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.078 [2024-11-26 04:41:28.294143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.078 [2024-11-26 04:41:28.294291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.078 [2024-11-26 04:41:28.294442] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.078 [2024-11-26 04:41:28.294467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.078 [2024-11-26 04:41:28.294483] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.078 [2024-11-26 04:41:28.296772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.339 [2024-11-26 04:41:28.306269] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.339 [2024-11-26 04:41:28.306608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.306753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.306782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.339 [2024-11-26 04:41:28.306799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.339 [2024-11-26 04:41:28.306929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.339 [2024-11-26 04:41:28.307062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.339 [2024-11-26 04:41:28.307085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.339 [2024-11-26 04:41:28.307100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.339 [2024-11-26 04:41:28.309471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.339 [2024-11-26 04:41:28.318853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.339 [2024-11-26 04:41:28.319137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.319288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.319316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.339 [2024-11-26 04:41:28.319333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.339 [2024-11-26 04:41:28.319499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.339 [2024-11-26 04:41:28.319666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.339 [2024-11-26 04:41:28.319702] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.339 [2024-11-26 04:41:28.319721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.339 [2024-11-26 04:41:28.322130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.339 [2024-11-26 04:41:28.331403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.339 [2024-11-26 04:41:28.331732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.331915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.331942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.339 [2024-11-26 04:41:28.331959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.339 [2024-11-26 04:41:28.332110] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.339 [2024-11-26 04:41:28.332334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.339 [2024-11-26 04:41:28.332359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.339 [2024-11-26 04:41:28.332375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.339 [2024-11-26 04:41:28.334586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.339 [2024-11-26 04:41:28.343956] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.339 [2024-11-26 04:41:28.344326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.344470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.344497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.339 [2024-11-26 04:41:28.344515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.339 [2024-11-26 04:41:28.344680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.339 [2024-11-26 04:41:28.344897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.339 [2024-11-26 04:41:28.344923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.339 [2024-11-26 04:41:28.344940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.339 [2024-11-26 04:41:28.347297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.339 [2024-11-26 04:41:28.356359] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.339 [2024-11-26 04:41:28.356718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.356884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.356912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.339 [2024-11-26 04:41:28.356929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.339 [2024-11-26 04:41:28.357076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.339 [2024-11-26 04:41:28.357244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.339 [2024-11-26 04:41:28.357268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.339 [2024-11-26 04:41:28.357285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.339 [2024-11-26 04:41:28.359721] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.339 [2024-11-26 04:41:28.368752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.339 [2024-11-26 04:41:28.369164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.369315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.369343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.339 [2024-11-26 04:41:28.369377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.339 [2024-11-26 04:41:28.369560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.339 [2024-11-26 04:41:28.369705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.339 [2024-11-26 04:41:28.369742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.339 [2024-11-26 04:41:28.369759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.339 [2024-11-26 04:41:28.372164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.339 [2024-11-26 04:41:28.381285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.339 [2024-11-26 04:41:28.381602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.381747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.381777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.339 [2024-11-26 04:41:28.381795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.339 [2024-11-26 04:41:28.381960] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.339 [2024-11-26 04:41:28.382166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.339 [2024-11-26 04:41:28.382190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.339 [2024-11-26 04:41:28.382205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.339 [2024-11-26 04:41:28.384562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.339 [2024-11-26 04:41:28.393775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.339 [2024-11-26 04:41:28.394058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.394243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.394272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.339 [2024-11-26 04:41:28.394291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.339 [2024-11-26 04:41:28.394455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.339 [2024-11-26 04:41:28.394607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.339 [2024-11-26 04:41:28.394631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.339 [2024-11-26 04:41:28.394647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.339 [2024-11-26 04:41:28.396974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.339 [2024-11-26 04:41:28.406498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.339 [2024-11-26 04:41:28.406841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.407047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.339 [2024-11-26 04:41:28.407099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.339 [2024-11-26 04:41:28.407117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.339 [2024-11-26 04:41:28.407300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.339 [2024-11-26 04:41:28.407470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.339 [2024-11-26 04:41:28.407494] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.340 [2024-11-26 04:41:28.407509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.340 [2024-11-26 04:41:28.409816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.340 [2024-11-26 04:41:28.418879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.340 [2024-11-26 04:41:28.419180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.419321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.419351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.340 [2024-11-26 04:41:28.419369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.340 [2024-11-26 04:41:28.419552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.340 [2024-11-26 04:41:28.419751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.340 [2024-11-26 04:41:28.419776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.340 [2024-11-26 04:41:28.419792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.340 [2024-11-26 04:41:28.421944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.340 [2024-11-26 04:41:28.431539] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.340 [2024-11-26 04:41:28.431891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.432025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.432052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.340 [2024-11-26 04:41:28.432072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.340 [2024-11-26 04:41:28.432263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.340 [2024-11-26 04:41:28.432451] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.340 [2024-11-26 04:41:28.432475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.340 [2024-11-26 04:41:28.432491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.340 [2024-11-26 04:41:28.434903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.340 [2024-11-26 04:41:28.444264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.340 [2024-11-26 04:41:28.444560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.444714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.444741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.340 [2024-11-26 04:41:28.444758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.340 [2024-11-26 04:41:28.444955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.340 [2024-11-26 04:41:28.445142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.340 [2024-11-26 04:41:28.445166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.340 [2024-11-26 04:41:28.445182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.340 [2024-11-26 04:41:28.447755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.340 [2024-11-26 04:41:28.457020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.340 [2024-11-26 04:41:28.457337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.457450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.457480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.340 [2024-11-26 04:41:28.457498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.340 [2024-11-26 04:41:28.457645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.340 [2024-11-26 04:41:28.457788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.340 [2024-11-26 04:41:28.457813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.340 [2024-11-26 04:41:28.457829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.340 [2024-11-26 04:41:28.460032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.340 [2024-11-26 04:41:28.469371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.340 [2024-11-26 04:41:28.469707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.469886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.469936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.340 [2024-11-26 04:41:28.469954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.340 [2024-11-26 04:41:28.470143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.340 [2024-11-26 04:41:28.470330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.340 [2024-11-26 04:41:28.470354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.340 [2024-11-26 04:41:28.470370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.340 [2024-11-26 04:41:28.472691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.340 [2024-11-26 04:41:28.481962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.340 [2024-11-26 04:41:28.482269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.482438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.482466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.340 [2024-11-26 04:41:28.482484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.340 [2024-11-26 04:41:28.482648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.340 [2024-11-26 04:41:28.482853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.340 [2024-11-26 04:41:28.482879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.340 [2024-11-26 04:41:28.482895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.340 [2024-11-26 04:41:28.485228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.340 [2024-11-26 04:41:28.494756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.340 [2024-11-26 04:41:28.495110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.495263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.495293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.340 [2024-11-26 04:41:28.495311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.340 [2024-11-26 04:41:28.495476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.340 [2024-11-26 04:41:28.495627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.340 [2024-11-26 04:41:28.495652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.340 [2024-11-26 04:41:28.495668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.340 [2024-11-26 04:41:28.498097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.340 [2024-11-26 04:41:28.507362] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.340 [2024-11-26 04:41:28.507650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.507805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.507835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.340 [2024-11-26 04:41:28.507853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.340 [2024-11-26 04:41:28.508018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.340 [2024-11-26 04:41:28.508229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.340 [2024-11-26 04:41:28.508254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.340 [2024-11-26 04:41:28.508270] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.340 [2024-11-26 04:41:28.510637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.340 [2024-11-26 04:41:28.519991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.340 [2024-11-26 04:41:28.520356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.520538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.340 [2024-11-26 04:41:28.520579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.340 [2024-11-26 04:41:28.520595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.340 [2024-11-26 04:41:28.520786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.340 [2024-11-26 04:41:28.520938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.340 [2024-11-26 04:41:28.520963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.340 [2024-11-26 04:41:28.520978] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.340 [2024-11-26 04:41:28.523346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.340 [2024-11-26 04:41:28.532876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.341 [2024-11-26 04:41:28.533183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.341 [2024-11-26 04:41:28.533413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.341 [2024-11-26 04:41:28.533439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.341 [2024-11-26 04:41:28.533455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.341 [2024-11-26 04:41:28.533609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.341 [2024-11-26 04:41:28.533808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.341 [2024-11-26 04:41:28.533834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.341 [2024-11-26 04:41:28.533849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.341 [2024-11-26 04:41:28.536218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.341 [2024-11-26 04:41:28.545349] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.341 [2024-11-26 04:41:28.545656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.341 [2024-11-26 04:41:28.545846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.341 [2024-11-26 04:41:28.545874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.341 [2024-11-26 04:41:28.545890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.341 [2024-11-26 04:41:28.546084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.341 [2024-11-26 04:41:28.546265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.341 [2024-11-26 04:41:28.546295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.341 [2024-11-26 04:41:28.546312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.341 [2024-11-26 04:41:28.548762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.341 [2024-11-26 04:41:28.557761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.341 [2024-11-26 04:41:28.558097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.341 [2024-11-26 04:41:28.558213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.341 [2024-11-26 04:41:28.558254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.341 [2024-11-26 04:41:28.558270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.341 [2024-11-26 04:41:28.558449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.341 [2024-11-26 04:41:28.558655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.341 [2024-11-26 04:41:28.558679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.341 [2024-11-26 04:41:28.558707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.600 [2024-11-26 04:41:28.561095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.600 [2024-11-26 04:41:28.570258] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.600 [2024-11-26 04:41:28.570675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.600 [2024-11-26 04:41:28.570843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.600 [2024-11-26 04:41:28.570873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.600 [2024-11-26 04:41:28.570890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.600 [2024-11-26 04:41:28.571055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.600 [2024-11-26 04:41:28.571224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.600 [2024-11-26 04:41:28.571248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.600 [2024-11-26 04:41:28.571264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.600 [2024-11-26 04:41:28.573579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.600 [2024-11-26 04:41:28.582841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.600 [2024-11-26 04:41:28.583246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.600 [2024-11-26 04:41:28.583440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.600 [2024-11-26 04:41:28.583465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.600 [2024-11-26 04:41:28.583480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.600 [2024-11-26 04:41:28.583619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.600 [2024-11-26 04:41:28.583774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.600 [2024-11-26 04:41:28.583799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.600 [2024-11-26 04:41:28.583824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.600 [2024-11-26 04:41:28.586193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.600 [2024-11-26 04:41:28.595290] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.600 [2024-11-26 04:41:28.595735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.600 [2024-11-26 04:41:28.595839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.600 [2024-11-26 04:41:28.595867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.600 [2024-11-26 04:41:28.595885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.600 [2024-11-26 04:41:28.596068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.600 [2024-11-26 04:41:28.596238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.600 [2024-11-26 04:41:28.596262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.600 [2024-11-26 04:41:28.596278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.600 [2024-11-26 04:41:28.598590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.600 [2024-11-26 04:41:28.607993] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.600 [2024-11-26 04:41:28.608325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.600 [2024-11-26 04:41:28.608437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.600 [2024-11-26 04:41:28.608461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.600 [2024-11-26 04:41:28.608477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.600 [2024-11-26 04:41:28.608651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.600 [2024-11-26 04:41:28.608831] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.601 [2024-11-26 04:41:28.608857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.601 [2024-11-26 04:41:28.608873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.601 [2024-11-26 04:41:28.611122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.601 [2024-11-26 04:41:28.620712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.601 [2024-11-26 04:41:28.621013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.621195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.621222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.601 [2024-11-26 04:41:28.621254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.601 [2024-11-26 04:41:28.621440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.601 [2024-11-26 04:41:28.621620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.601 [2024-11-26 04:41:28.621645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.601 [2024-11-26 04:41:28.621661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.601 [2024-11-26 04:41:28.623919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.601 [2024-11-26 04:41:28.633582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.601 [2024-11-26 04:41:28.633890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.634089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.634119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.601 [2024-11-26 04:41:28.634150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.601 [2024-11-26 04:41:28.634279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.601 [2024-11-26 04:41:28.634450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.601 [2024-11-26 04:41:28.634475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.601 [2024-11-26 04:41:28.634491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.601 [2024-11-26 04:41:28.636924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.601 [2024-11-26 04:41:28.646160] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.601 [2024-11-26 04:41:28.646523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.646663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.646704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.601 [2024-11-26 04:41:28.646725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.601 [2024-11-26 04:41:28.646908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.601 [2024-11-26 04:41:28.647077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.601 [2024-11-26 04:41:28.647101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.601 [2024-11-26 04:41:28.647117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.601 [2024-11-26 04:41:28.649521] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.601 [2024-11-26 04:41:28.658616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.601 [2024-11-26 04:41:28.658950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.659164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.659219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.601 [2024-11-26 04:41:28.659237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.601 [2024-11-26 04:41:28.659401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.601 [2024-11-26 04:41:28.659589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.601 [2024-11-26 04:41:28.659612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.601 [2024-11-26 04:41:28.659628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.601 [2024-11-26 04:41:28.661877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.601 [2024-11-26 04:41:28.671145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.601 [2024-11-26 04:41:28.671390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.671555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.671584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.601 [2024-11-26 04:41:28.671602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.601 [2024-11-26 04:41:28.671777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.601 [2024-11-26 04:41:28.671911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.601 [2024-11-26 04:41:28.671935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.601 [2024-11-26 04:41:28.671950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.601 [2024-11-26 04:41:28.674427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.601 [2024-11-26 04:41:28.683744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.601 [2024-11-26 04:41:28.684093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.684271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.684316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.601 [2024-11-26 04:41:28.684335] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.601 [2024-11-26 04:41:28.684445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.601 [2024-11-26 04:41:28.684577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.601 [2024-11-26 04:41:28.684601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.601 [2024-11-26 04:41:28.684616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.601 [2024-11-26 04:41:28.686859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.601 [2024-11-26 04:41:28.696399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.601 [2024-11-26 04:41:28.696709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.696834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.696860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.601 [2024-11-26 04:41:28.696876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.601 [2024-11-26 04:41:28.697009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.601 [2024-11-26 04:41:28.697208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.601 [2024-11-26 04:41:28.697231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.601 [2024-11-26 04:41:28.697246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.601 [2024-11-26 04:41:28.699405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.601 [2024-11-26 04:41:28.708913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.601 [2024-11-26 04:41:28.709239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.709370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.709396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.601 [2024-11-26 04:41:28.709412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.601 [2024-11-26 04:41:28.709527] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.601 [2024-11-26 04:41:28.709757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.601 [2024-11-26 04:41:28.709780] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.601 [2024-11-26 04:41:28.709794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.601 [2024-11-26 04:41:28.711906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.601 [2024-11-26 04:41:28.721623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.601 [2024-11-26 04:41:28.721944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.722097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.601 [2024-11-26 04:41:28.722124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.601 [2024-11-26 04:41:28.722140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.601 [2024-11-26 04:41:28.722365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.601 [2024-11-26 04:41:28.722503] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.601 [2024-11-26 04:41:28.722523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.601 [2024-11-26 04:41:28.722536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.601 [2024-11-26 04:41:28.724851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.601 [2024-11-26 04:41:28.734186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.602 [2024-11-26 04:41:28.734500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.734625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.734655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.602 [2024-11-26 04:41:28.734673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.602 [2024-11-26 04:41:28.734882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.602 [2024-11-26 04:41:28.735076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.602 [2024-11-26 04:41:28.735100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.602 [2024-11-26 04:41:28.735115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.602 [2024-11-26 04:41:28.737458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.602 [2024-11-26 04:41:28.746823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.602 [2024-11-26 04:41:28.747153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.747270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.747304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.602 [2024-11-26 04:41:28.747324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.602 [2024-11-26 04:41:28.747506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.602 [2024-11-26 04:41:28.747675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.602 [2024-11-26 04:41:28.747715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.602 [2024-11-26 04:41:28.747747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.602 [2024-11-26 04:41:28.750044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.602 [2024-11-26 04:41:28.759609] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.602 [2024-11-26 04:41:28.759909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.760036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.760062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.602 [2024-11-26 04:41:28.760078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.602 [2024-11-26 04:41:28.760230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.602 [2024-11-26 04:41:28.760423] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.602 [2024-11-26 04:41:28.760443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.602 [2024-11-26 04:41:28.760456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.602 [2024-11-26 04:41:28.763038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.602 [2024-11-26 04:41:28.772245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.602 [2024-11-26 04:41:28.772566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.772752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.772778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.602 [2024-11-26 04:41:28.772794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.602 [2024-11-26 04:41:28.772959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.602 [2024-11-26 04:41:28.773126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.602 [2024-11-26 04:41:28.773146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.602 [2024-11-26 04:41:28.773177] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.602 [2024-11-26 04:41:28.775584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.602 [2024-11-26 04:41:28.784928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.602 [2024-11-26 04:41:28.785249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.785366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.785394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.602 [2024-11-26 04:41:28.785417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.602 [2024-11-26 04:41:28.785547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.602 [2024-11-26 04:41:28.785791] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.602 [2024-11-26 04:41:28.785815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.602 [2024-11-26 04:41:28.785829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.602 [2024-11-26 04:41:28.788326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.602 [2024-11-26 04:41:28.797761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.602 [2024-11-26 04:41:28.798147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.798294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.798324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.602 [2024-11-26 04:41:28.798342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.602 [2024-11-26 04:41:28.798506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.602 [2024-11-26 04:41:28.798755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.602 [2024-11-26 04:41:28.798778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.602 [2024-11-26 04:41:28.798792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.602 [2024-11-26 04:41:28.801138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.602 [2024-11-26 04:41:28.810263] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.602 [2024-11-26 04:41:28.810620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.810813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.602 [2024-11-26 04:41:28.810843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.602 [2024-11-26 04:41:28.810861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.602 [2024-11-26 04:41:28.810989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.602 [2024-11-26 04:41:28.811212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.602 [2024-11-26 04:41:28.811236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.602 [2024-11-26 04:41:28.811252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.602 [2024-11-26 04:41:28.813654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.862 [2024-11-26 04:41:28.822820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.862 [2024-11-26 04:41:28.823230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.862 [2024-11-26 04:41:28.823364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.862 [2024-11-26 04:41:28.823393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.862 [2024-11-26 04:41:28.823411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.862 [2024-11-26 04:41:28.823564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.862 [2024-11-26 04:41:28.823793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.862 [2024-11-26 04:41:28.823814] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.862 [2024-11-26 04:41:28.823827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.862 [2024-11-26 04:41:28.826319] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.862 [2024-11-26 04:41:28.835248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.862 [2024-11-26 04:41:28.835547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.862 [2024-11-26 04:41:28.835682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.862 [2024-11-26 04:41:28.835733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.862 [2024-11-26 04:41:28.835750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.862 [2024-11-26 04:41:28.835910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.862 [2024-11-26 04:41:28.836097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.863 [2024-11-26 04:41:28.836121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.863 [2024-11-26 04:41:28.836136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.863 [2024-11-26 04:41:28.838528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.863 [2024-11-26 04:41:28.847856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.863 [2024-11-26 04:41:28.848226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.848381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.848410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.863 [2024-11-26 04:41:28.848439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.863 [2024-11-26 04:41:28.848603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.863 [2024-11-26 04:41:28.848788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.863 [2024-11-26 04:41:28.848813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.863 [2024-11-26 04:41:28.848829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.863 [2024-11-26 04:41:28.851076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.863 [2024-11-26 04:41:28.860596] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.863 [2024-11-26 04:41:28.860874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.861040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.861069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.863 [2024-11-26 04:41:28.861087] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.863 [2024-11-26 04:41:28.861251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.863 [2024-11-26 04:41:28.861444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.863 [2024-11-26 04:41:28.861468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.863 [2024-11-26 04:41:28.861485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.863 [2024-11-26 04:41:28.863943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.863 [2024-11-26 04:41:28.873087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.863 [2024-11-26 04:41:28.873464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.873608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.873637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.863 [2024-11-26 04:41:28.873655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.863 [2024-11-26 04:41:28.873796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.863 [2024-11-26 04:41:28.873929] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.863 [2024-11-26 04:41:28.873953] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.863 [2024-11-26 04:41:28.873969] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.863 [2024-11-26 04:41:28.876298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.863 [2024-11-26 04:41:28.885598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.863 [2024-11-26 04:41:28.885877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.886029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.886058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.863 [2024-11-26 04:41:28.886076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.863 [2024-11-26 04:41:28.886259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.863 [2024-11-26 04:41:28.886445] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.863 [2024-11-26 04:41:28.886479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.863 [2024-11-26 04:41:28.886495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.863 [2024-11-26 04:41:28.888945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.863 [2024-11-26 04:41:28.898316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.863 [2024-11-26 04:41:28.898747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.898973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.899020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.863 [2024-11-26 04:41:28.899038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.863 [2024-11-26 04:41:28.899203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.863 [2024-11-26 04:41:28.899380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.863 [2024-11-26 04:41:28.899410] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.863 [2024-11-26 04:41:28.899426] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.863 [2024-11-26 04:41:28.901796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.863 [2024-11-26 04:41:28.910955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.863 [2024-11-26 04:41:28.911282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.911447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.911476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.863 [2024-11-26 04:41:28.911493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.863 [2024-11-26 04:41:28.911676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.863 [2024-11-26 04:41:28.911820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.863 [2024-11-26 04:41:28.911845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.863 [2024-11-26 04:41:28.911861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.863 [2024-11-26 04:41:28.914301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.863 [2024-11-26 04:41:28.923662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.863 [2024-11-26 04:41:28.923987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.924103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.924132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.863 [2024-11-26 04:41:28.924150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.863 [2024-11-26 04:41:28.924333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.863 [2024-11-26 04:41:28.924519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.863 [2024-11-26 04:41:28.924544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.863 [2024-11-26 04:41:28.924559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.863 [2024-11-26 04:41:28.926936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.863 [2024-11-26 04:41:28.936331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.863 [2024-11-26 04:41:28.936707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.936888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.936936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.863 [2024-11-26 04:41:28.936955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.863 [2024-11-26 04:41:28.937102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.863 [2024-11-26 04:41:28.937252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.863 [2024-11-26 04:41:28.937276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.863 [2024-11-26 04:41:28.937308] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.863 [2024-11-26 04:41:28.939741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.863 [2024-11-26 04:41:28.948920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.863 [2024-11-26 04:41:28.949243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.949385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.863 [2024-11-26 04:41:28.949414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.863 [2024-11-26 04:41:28.949432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.863 [2024-11-26 04:41:28.949597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.863 [2024-11-26 04:41:28.949759] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.864 [2024-11-26 04:41:28.949784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.864 [2024-11-26 04:41:28.949800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.864 [2024-11-26 04:41:28.952003] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.864 [2024-11-26 04:41:28.961646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.864 [2024-11-26 04:41:28.961946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:28.962142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:28.962193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.864 [2024-11-26 04:41:28.962211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.864 [2024-11-26 04:41:28.962340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.864 [2024-11-26 04:41:28.962491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.864 [2024-11-26 04:41:28.962515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.864 [2024-11-26 04:41:28.962530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.864 [2024-11-26 04:41:28.964818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.864 [2024-11-26 04:41:28.974298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.864 [2024-11-26 04:41:28.974640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:28.974774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:28.974804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.864 [2024-11-26 04:41:28.974822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.864 [2024-11-26 04:41:28.974987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.864 [2024-11-26 04:41:28.975156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.864 [2024-11-26 04:41:28.975181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.864 [2024-11-26 04:41:28.975197] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.864 [2024-11-26 04:41:28.977456] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.864 [2024-11-26 04:41:28.986794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.864 [2024-11-26 04:41:28.987059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:28.987175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:28.987204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.864 [2024-11-26 04:41:28.987222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.864 [2024-11-26 04:41:28.987369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.864 [2024-11-26 04:41:28.987537] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.864 [2024-11-26 04:41:28.987562] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.864 [2024-11-26 04:41:28.987578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.864 [2024-11-26 04:41:28.989720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.864 [2024-11-26 04:41:28.999449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.864 [2024-11-26 04:41:28.999747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:28.999851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:28.999881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.864 [2024-11-26 04:41:28.999896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.864 [2024-11-26 04:41:29.000055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.864 [2024-11-26 04:41:29.000207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.864 [2024-11-26 04:41:29.000230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.864 [2024-11-26 04:41:29.000247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.864 [2024-11-26 04:41:29.002579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.864 [2024-11-26 04:41:29.011974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.864 [2024-11-26 04:41:29.012304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:29.012424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:29.012453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.864 [2024-11-26 04:41:29.012471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.864 [2024-11-26 04:41:29.012653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.864 [2024-11-26 04:41:29.012850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.864 [2024-11-26 04:41:29.012875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.864 [2024-11-26 04:41:29.012891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.864 [2024-11-26 04:41:29.015274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.864 [2024-11-26 04:41:29.024611] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.864 [2024-11-26 04:41:29.024931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:29.025071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:29.025101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.864 [2024-11-26 04:41:29.025119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.864 [2024-11-26 04:41:29.025319] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.864 [2024-11-26 04:41:29.025434] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.864 [2024-11-26 04:41:29.025458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.864 [2024-11-26 04:41:29.025473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.864 [2024-11-26 04:41:29.027643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.864 [2024-11-26 04:41:29.036909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.864 [2024-11-26 04:41:29.037215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:29.037351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:29.037381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.864 [2024-11-26 04:41:29.037400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.864 [2024-11-26 04:41:29.037600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.864 [2024-11-26 04:41:29.037780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.864 [2024-11-26 04:41:29.037805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.864 [2024-11-26 04:41:29.037821] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.864 [2024-11-26 04:41:29.039952] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.864 [2024-11-26 04:41:29.049190] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.864 [2024-11-26 04:41:29.049544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:29.049681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:29.049732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.864 [2024-11-26 04:41:29.049749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.864 [2024-11-26 04:41:29.049908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.864 [2024-11-26 04:41:29.050075] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.864 [2024-11-26 04:41:29.050099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.864 [2024-11-26 04:41:29.050115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.864 [2024-11-26 04:41:29.052410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.864 [2024-11-26 04:41:29.061789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.864 [2024-11-26 04:41:29.062113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:29.062289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.864 [2024-11-26 04:41:29.062318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.864 [2024-11-26 04:41:29.062337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.864 [2024-11-26 04:41:29.062503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.864 [2024-11-26 04:41:29.062654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.864 [2024-11-26 04:41:29.062679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.864 [2024-11-26 04:41:29.062709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.864 [2024-11-26 04:41:29.065157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.864 [2024-11-26 04:41:29.074255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.864 [2024-11-26 04:41:29.074541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.865 [2024-11-26 04:41:29.074679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.865 [2024-11-26 04:41:29.074716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:49.865 [2024-11-26 04:41:29.074735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:49.865 [2024-11-26 04:41:29.074938] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:49.865 [2024-11-26 04:41:29.075124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.865 [2024-11-26 04:41:29.075148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.865 [2024-11-26 04:41:29.075164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.865 [2024-11-26 04:41:29.077442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.126 [2024-11-26 04:41:29.086734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.126 [2024-11-26 04:41:29.087123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.126 [2024-11-26 04:41:29.087336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.126 [2024-11-26 04:41:29.087383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.126 [2024-11-26 04:41:29.087401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.126 [2024-11-26 04:41:29.087619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.126 [2024-11-26 04:41:29.087806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.126 [2024-11-26 04:41:29.087832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.126 [2024-11-26 04:41:29.087848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.126 [2024-11-26 04:41:29.090156] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.126 [2024-11-26 04:41:29.099300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.126 [2024-11-26 04:41:29.099599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.126 [2024-11-26 04:41:29.099739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.126 [2024-11-26 04:41:29.099769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.126 [2024-11-26 04:41:29.099793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.126 [2024-11-26 04:41:29.099942] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.126 [2024-11-26 04:41:29.100129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.126 [2024-11-26 04:41:29.100153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.126 [2024-11-26 04:41:29.100169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.126 [2024-11-26 04:41:29.102535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.126 [2024-11-26 04:41:29.111868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.126 [2024-11-26 04:41:29.112146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.126 [2024-11-26 04:41:29.112286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.126 [2024-11-26 04:41:29.112315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.126 [2024-11-26 04:41:29.112332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.127 [2024-11-26 04:41:29.112498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.127 [2024-11-26 04:41:29.112648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.127 [2024-11-26 04:41:29.112681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.127 [2024-11-26 04:41:29.112710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.127 [2024-11-26 04:41:29.115024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.127 [2024-11-26 04:41:29.124281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.127 [2024-11-26 04:41:29.124571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.124735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.124762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.127 [2024-11-26 04:41:29.124779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.127 [2024-11-26 04:41:29.124878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.127 [2024-11-26 04:41:29.125026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.127 [2024-11-26 04:41:29.125064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.127 [2024-11-26 04:41:29.125079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.127 [2024-11-26 04:41:29.127394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.127 [2024-11-26 04:41:29.136717] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.127 [2024-11-26 04:41:29.137074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.137216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.137243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.127 [2024-11-26 04:41:29.137261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.127 [2024-11-26 04:41:29.137449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.127 [2024-11-26 04:41:29.137618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.127 [2024-11-26 04:41:29.137643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.127 [2024-11-26 04:41:29.137658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.127 [2024-11-26 04:41:29.139945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.127 [2024-11-26 04:41:29.149252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.127 [2024-11-26 04:41:29.149576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.149747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.149777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.127 [2024-11-26 04:41:29.149796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.127 [2024-11-26 04:41:29.149943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.127 [2024-11-26 04:41:29.150123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.127 [2024-11-26 04:41:29.150147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.127 [2024-11-26 04:41:29.150162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.127 [2024-11-26 04:41:29.152411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.127 [2024-11-26 04:41:29.161760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.127 [2024-11-26 04:41:29.162022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.162150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.162196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.127 [2024-11-26 04:41:29.162214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.127 [2024-11-26 04:41:29.162378] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.127 [2024-11-26 04:41:29.162583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.127 [2024-11-26 04:41:29.162607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.127 [2024-11-26 04:41:29.162622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.127 [2024-11-26 04:41:29.165089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.127 [2024-11-26 04:41:29.174224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.127 [2024-11-26 04:41:29.174523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.174650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.174678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.127 [2024-11-26 04:41:29.174706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.127 [2024-11-26 04:41:29.174837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.127 [2024-11-26 04:41:29.174997] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.127 [2024-11-26 04:41:29.175021] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.127 [2024-11-26 04:41:29.175037] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.127 [2024-11-26 04:41:29.177242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.127 [2024-11-26 04:41:29.186837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.127 [2024-11-26 04:41:29.187149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.187284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.187310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.127 [2024-11-26 04:41:29.187326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.127 [2024-11-26 04:41:29.187517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.127 [2024-11-26 04:41:29.187696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.127 [2024-11-26 04:41:29.187727] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.127 [2024-11-26 04:41:29.187746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.127 [2024-11-26 04:41:29.190222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.127 [2024-11-26 04:41:29.199199] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.127 [2024-11-26 04:41:29.199481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.199715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.199741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.127 [2024-11-26 04:41:29.199756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.127 [2024-11-26 04:41:29.199903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.127 [2024-11-26 04:41:29.200072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.127 [2024-11-26 04:41:29.200095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.127 [2024-11-26 04:41:29.200111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.127 [2024-11-26 04:41:29.202510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.127 [2024-11-26 04:41:29.211672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.127 [2024-11-26 04:41:29.211970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.212123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.212171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.127 [2024-11-26 04:41:29.212189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.127 [2024-11-26 04:41:29.212353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.127 [2024-11-26 04:41:29.212522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.127 [2024-11-26 04:41:29.212552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.127 [2024-11-26 04:41:29.212569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.127 [2024-11-26 04:41:29.214889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.127 [2024-11-26 04:41:29.224269] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.127 [2024-11-26 04:41:29.224608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.224754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.224785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.127 [2024-11-26 04:41:29.224802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.127 [2024-11-26 04:41:29.225022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.127 [2024-11-26 04:41:29.225209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.127 [2024-11-26 04:41:29.225233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.127 [2024-11-26 04:41:29.225249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.127 [2024-11-26 04:41:29.227579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.127 [2024-11-26 04:41:29.236960] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.127 [2024-11-26 04:41:29.237284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.237403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.127 [2024-11-26 04:41:29.237433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.127 [2024-11-26 04:41:29.237451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.127 [2024-11-26 04:41:29.237599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.127 [2024-11-26 04:41:29.237797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.128 [2024-11-26 04:41:29.237823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.128 [2024-11-26 04:41:29.237838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.128 [2024-11-26 04:41:29.240117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.128 [2024-11-26 04:41:29.249728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.128 [2024-11-26 04:41:29.250032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.250177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.250205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.128 [2024-11-26 04:41:29.250223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.128 [2024-11-26 04:41:29.250388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.128 [2024-11-26 04:41:29.250558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.128 [2024-11-26 04:41:29.250582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.128 [2024-11-26 04:41:29.250603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.128 [2024-11-26 04:41:29.252999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.128 [2024-11-26 04:41:29.262156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.128 [2024-11-26 04:41:29.262439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.262583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.262611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.128 [2024-11-26 04:41:29.262629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.128 [2024-11-26 04:41:29.262847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.128 [2024-11-26 04:41:29.262976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.128 [2024-11-26 04:41:29.262997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.128 [2024-11-26 04:41:29.263026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.128 [2024-11-26 04:41:29.265237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.128 [2024-11-26 04:41:29.274706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.128 [2024-11-26 04:41:29.275080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.275189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.275216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.128 [2024-11-26 04:41:29.275234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.128 [2024-11-26 04:41:29.275399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.128 [2024-11-26 04:41:29.275549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.128 [2024-11-26 04:41:29.275574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.128 [2024-11-26 04:41:29.275591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.128 [2024-11-26 04:41:29.277864] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.128 [2024-11-26 04:41:29.287545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.128 [2024-11-26 04:41:29.287876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.288028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.288058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.128 [2024-11-26 04:41:29.288076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.128 [2024-11-26 04:41:29.288277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.128 [2024-11-26 04:41:29.288466] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.128 [2024-11-26 04:41:29.288491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.128 [2024-11-26 04:41:29.288507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.128 [2024-11-26 04:41:29.290820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.128 [2024-11-26 04:41:29.300042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.128 [2024-11-26 04:41:29.300435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.300568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.300610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.128 [2024-11-26 04:41:29.300627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.128 [2024-11-26 04:41:29.300837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.128 [2024-11-26 04:41:29.301020] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.128 [2024-11-26 04:41:29.301046] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.128 [2024-11-26 04:41:29.301062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.128 [2024-11-26 04:41:29.303413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.128 [2024-11-26 04:41:29.312652] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.128 [2024-11-26 04:41:29.313004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.313147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.313195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.128 [2024-11-26 04:41:29.313214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.128 [2024-11-26 04:41:29.313397] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.128 [2024-11-26 04:41:29.313548] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.128 [2024-11-26 04:41:29.313574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.128 [2024-11-26 04:41:29.313590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.128 [2024-11-26 04:41:29.315727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.128 [2024-11-26 04:41:29.325170] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.128 [2024-11-26 04:41:29.325545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.325785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.325816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.128 [2024-11-26 04:41:29.325835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.128 [2024-11-26 04:41:29.325965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.128 [2024-11-26 04:41:29.326151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.128 [2024-11-26 04:41:29.326176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.128 [2024-11-26 04:41:29.326192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.128 [2024-11-26 04:41:29.328507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.128 [2024-11-26 04:41:29.337861] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.128 [2024-11-26 04:41:29.338183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.338351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.128 [2024-11-26 04:41:29.338381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.128 [2024-11-26 04:41:29.338399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.128 [2024-11-26 04:41:29.338565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.128 [2024-11-26 04:41:29.338748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.128 [2024-11-26 04:41:29.338774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.128 [2024-11-26 04:41:29.338791] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.128 [2024-11-26 04:41:29.341035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.390 [2024-11-26 04:41:29.350458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.390 [2024-11-26 04:41:29.350808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.350951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.350981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.390 [2024-11-26 04:41:29.350999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.390 [2024-11-26 04:41:29.351147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.390 [2024-11-26 04:41:29.351333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.390 [2024-11-26 04:41:29.351358] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.390 [2024-11-26 04:41:29.351375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.390 [2024-11-26 04:41:29.353708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.390 [2024-11-26 04:41:29.362922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.390 [2024-11-26 04:41:29.363229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.363367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.363394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.390 [2024-11-26 04:41:29.363412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.390 [2024-11-26 04:41:29.363631] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.390 [2024-11-26 04:41:29.363796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.390 [2024-11-26 04:41:29.363822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.390 [2024-11-26 04:41:29.363839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.390 [2024-11-26 04:41:29.366173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.390 [2024-11-26 04:41:29.375419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.390 [2024-11-26 04:41:29.375768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.375913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.375943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.390 [2024-11-26 04:41:29.375961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.390 [2024-11-26 04:41:29.376145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.390 [2024-11-26 04:41:29.376295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.390 [2024-11-26 04:41:29.376320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.390 [2024-11-26 04:41:29.376337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.390 [2024-11-26 04:41:29.378713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.390 [2024-11-26 04:41:29.388026] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.390 [2024-11-26 04:41:29.388343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.388448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.388475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.390 [2024-11-26 04:41:29.388492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.390 [2024-11-26 04:41:29.388657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.390 [2024-11-26 04:41:29.388786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.390 [2024-11-26 04:41:29.388810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.390 [2024-11-26 04:41:29.388826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.390 [2024-11-26 04:41:29.391160] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.390 [2024-11-26 04:41:29.400650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.390 [2024-11-26 04:41:29.400979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.401175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.401202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.390 [2024-11-26 04:41:29.401234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.390 [2024-11-26 04:41:29.401331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.390 [2024-11-26 04:41:29.401513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.390 [2024-11-26 04:41:29.401539] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.390 [2024-11-26 04:41:29.401555] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.390 [2024-11-26 04:41:29.403758] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.390 [2024-11-26 04:41:29.413372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.390 [2024-11-26 04:41:29.413749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.413892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.413925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.390 [2024-11-26 04:41:29.413944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.390 [2024-11-26 04:41:29.414127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.390 [2024-11-26 04:41:29.414314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.390 [2024-11-26 04:41:29.414339] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.390 [2024-11-26 04:41:29.414355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.390 [2024-11-26 04:41:29.416703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.390 [2024-11-26 04:41:29.425837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.390 [2024-11-26 04:41:29.426113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.426263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.426289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.390 [2024-11-26 04:41:29.426305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.390 [2024-11-26 04:41:29.426445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.390 [2024-11-26 04:41:29.426604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.390 [2024-11-26 04:41:29.426630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.390 [2024-11-26 04:41:29.426646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.390 [2024-11-26 04:41:29.428902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.390 [2024-11-26 04:41:29.438618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.390 [2024-11-26 04:41:29.438916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.439067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.439093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.390 [2024-11-26 04:41:29.439110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.390 [2024-11-26 04:41:29.439299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.390 [2024-11-26 04:41:29.439467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.390 [2024-11-26 04:41:29.439492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.390 [2024-11-26 04:41:29.439508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.390 [2024-11-26 04:41:29.442002] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.390 [2024-11-26 04:41:29.451023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.390 [2024-11-26 04:41:29.451333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.451452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.451479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.390 [2024-11-26 04:41:29.451502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.390 [2024-11-26 04:41:29.451699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.390 [2024-11-26 04:41:29.451834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.390 [2024-11-26 04:41:29.451855] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.390 [2024-11-26 04:41:29.451868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.390 [2024-11-26 04:41:29.454142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.390 [2024-11-26 04:41:29.463731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.390 [2024-11-26 04:41:29.464072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.464184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.390 [2024-11-26 04:41:29.464211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.390 [2024-11-26 04:41:29.464229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.390 [2024-11-26 04:41:29.464430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.391 [2024-11-26 04:41:29.464582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.391 [2024-11-26 04:41:29.464608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.391 [2024-11-26 04:41:29.464624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.391 [2024-11-26 04:41:29.466936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.391 [2024-11-26 04:41:29.476345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.391 [2024-11-26 04:41:29.476698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.476843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.476867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.391 [2024-11-26 04:41:29.476882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.391 [2024-11-26 04:41:29.477005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.391 [2024-11-26 04:41:29.477213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.391 [2024-11-26 04:41:29.477237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.391 [2024-11-26 04:41:29.477252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.391 [2024-11-26 04:41:29.479569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.391 [2024-11-26 04:41:29.488980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.391 [2024-11-26 04:41:29.489300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.489420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.489448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.391 [2024-11-26 04:41:29.489466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.391 [2024-11-26 04:41:29.489708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.391 [2024-11-26 04:41:29.489916] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.391 [2024-11-26 04:41:29.489942] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.391 [2024-11-26 04:41:29.489958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.391 [2024-11-26 04:41:29.492239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.391 [2024-11-26 04:41:29.501711] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.391 [2024-11-26 04:41:29.502018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.502159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.502188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.391 [2024-11-26 04:41:29.502206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.391 [2024-11-26 04:41:29.502371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.391 [2024-11-26 04:41:29.502503] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.391 [2024-11-26 04:41:29.502529] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.391 [2024-11-26 04:41:29.502546] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.391 [2024-11-26 04:41:29.504859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.391 [2024-11-26 04:41:29.514368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.391 [2024-11-26 04:41:29.514651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.514832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.514863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.391 [2024-11-26 04:41:29.514882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.391 [2024-11-26 04:41:29.515083] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.391 [2024-11-26 04:41:29.515199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.391 [2024-11-26 04:41:29.515225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.391 [2024-11-26 04:41:29.515241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.391 [2024-11-26 04:41:29.517505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.391 [2024-11-26 04:41:29.526909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.391 [2024-11-26 04:41:29.527265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.527441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.527470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.391 [2024-11-26 04:41:29.527488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.391 [2024-11-26 04:41:29.527636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.391 [2024-11-26 04:41:29.527840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.391 [2024-11-26 04:41:29.527864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.391 [2024-11-26 04:41:29.527880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.391 [2024-11-26 04:41:29.530215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.391 [2024-11-26 04:41:29.539519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.391 [2024-11-26 04:41:29.539846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.539986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.540016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.391 [2024-11-26 04:41:29.540034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.391 [2024-11-26 04:41:29.540235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.391 [2024-11-26 04:41:29.540370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.391 [2024-11-26 04:41:29.540395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.391 [2024-11-26 04:41:29.540411] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.391 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3040727 Killed "${NVMF_APP[@]}" "$@" 00:29:50.391 04:41:29 -- host/bdevperf.sh@36 -- # tgt_init 00:29:50.391 04:41:29 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:50.391 04:41:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:50.391 [2024-11-26 04:41:29.542700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.391 04:41:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:50.391 04:41:29 -- common/autotest_common.sh@10 -- # set +x 00:29:50.391 04:41:29 -- nvmf/common.sh@469 -- # nvmfpid=3041841 00:29:50.391 04:41:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:50.391 04:41:29 -- nvmf/common.sh@470 -- # waitforlisten 3041841 00:29:50.391 04:41:29 -- common/autotest_common.sh@829 -- # '[' -z 3041841 ']' 00:29:50.391 04:41:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:50.391 04:41:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:50.391 04:41:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:50.391 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:50.391 04:41:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:50.391 04:41:29 -- common/autotest_common.sh@10 -- # set +x 00:29:50.391 [2024-11-26 04:41:29.552223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.391 [2024-11-26 04:41:29.552558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.552758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.552785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.391 [2024-11-26 04:41:29.552802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.391 [2024-11-26 04:41:29.552982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.391 [2024-11-26 04:41:29.553134] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.391 [2024-11-26 04:41:29.553158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.391 [2024-11-26 04:41:29.553181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.391 [2024-11-26 04:41:29.555408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.391 [2024-11-26 04:41:29.564971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.391 [2024-11-26 04:41:29.565320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.565465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.565495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.391 [2024-11-26 04:41:29.565514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.391 [2024-11-26 04:41:29.565726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.391 [2024-11-26 04:41:29.565879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.391 [2024-11-26 04:41:29.565903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.391 [2024-11-26 04:41:29.565919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.391 [2024-11-26 04:41:29.568253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.391 [2024-11-26 04:41:29.577697] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.391 [2024-11-26 04:41:29.577993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.578108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.391 [2024-11-26 04:41:29.578138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.391 [2024-11-26 04:41:29.578155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.392 [2024-11-26 04:41:29.578320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.392 [2024-11-26 04:41:29.578506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.392 [2024-11-26 04:41:29.578530] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.392 [2024-11-26 04:41:29.578546] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.392 [2024-11-26 04:41:29.580926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.392 [2024-11-26 04:41:29.590335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.392 [2024-11-26 04:41:29.590612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.392 [2024-11-26 04:41:29.590746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.392 [2024-11-26 04:41:29.590776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.392 [2024-11-26 04:41:29.590794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.392 [2024-11-26 04:41:29.590977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.392 [2024-11-26 04:41:29.591110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.392 [2024-11-26 04:41:29.591133] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.392 [2024-11-26 04:41:29.591149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.392 [2024-11-26 04:41:29.591804] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:50.392 [2024-11-26 04:41:29.591876] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:50.392 [2024-11-26 04:41:29.593500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.392 [2024-11-26 04:41:29.603131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.392 [2024-11-26 04:41:29.603435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.392 [2024-11-26 04:41:29.603575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.392 [2024-11-26 04:41:29.603603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.392 [2024-11-26 04:41:29.603621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.392 [2024-11-26 04:41:29.603796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.392 [2024-11-26 04:41:29.603966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.392 [2024-11-26 04:41:29.603991] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.392 [2024-11-26 04:41:29.604008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.392 [2024-11-26 04:41:29.606392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.651 [2024-11-26 04:41:29.615813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.651 [2024-11-26 04:41:29.616114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.616267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.616308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.651 [2024-11-26 04:41:29.616325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.651 [2024-11-26 04:41:29.616450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.651 [2024-11-26 04:41:29.616610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.651 [2024-11-26 04:41:29.616636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.651 [2024-11-26 04:41:29.616652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.651 [2024-11-26 04:41:29.619069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.651 EAL: No free 2048 kB hugepages reported on node 1 00:29:50.651 [2024-11-26 04:41:29.628628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.651 [2024-11-26 04:41:29.628985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.629168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.629195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.651 [2024-11-26 04:41:29.629211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.651 [2024-11-26 04:41:29.629375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.651 [2024-11-26 04:41:29.629603] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.651 [2024-11-26 04:41:29.629633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.651 [2024-11-26 04:41:29.629651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.651 [2024-11-26 04:41:29.632194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.651 [2024-11-26 04:41:29.641279] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.651 [2024-11-26 04:41:29.641562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.641693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.641737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.651 [2024-11-26 04:41:29.641754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.651 [2024-11-26 04:41:29.641854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.651 [2024-11-26 04:41:29.642017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.651 [2024-11-26 04:41:29.642053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.651 [2024-11-26 04:41:29.642070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.651 [2024-11-26 04:41:29.644382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.651 [2024-11-26 04:41:29.653847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.651 [2024-11-26 04:41:29.654172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.654313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.654342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.651 [2024-11-26 04:41:29.654360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.651 [2024-11-26 04:41:29.654508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.651 [2024-11-26 04:41:29.654705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.651 [2024-11-26 04:41:29.654730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.651 [2024-11-26 04:41:29.654759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.651 [2024-11-26 04:41:29.657039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.651 [2024-11-26 04:41:29.662120] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:50.651 [2024-11-26 04:41:29.666415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.651 [2024-11-26 04:41:29.666786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.666915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.666940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.651 [2024-11-26 04:41:29.666957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.651 [2024-11-26 04:41:29.667154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.651 [2024-11-26 04:41:29.667306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.651 [2024-11-26 04:41:29.667338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.651 [2024-11-26 04:41:29.667355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.651 [2024-11-26 04:41:29.669782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.651 [2024-11-26 04:41:29.678974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.651 [2024-11-26 04:41:29.679460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.679604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.679634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.651 [2024-11-26 04:41:29.679654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.651 [2024-11-26 04:41:29.679893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.651 [2024-11-26 04:41:29.680069] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.651 [2024-11-26 04:41:29.680095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.651 [2024-11-26 04:41:29.680113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.651 [2024-11-26 04:41:29.682281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.651 [2024-11-26 04:41:29.691571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.651 [2024-11-26 04:41:29.691908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.692048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.651 [2024-11-26 04:41:29.692075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.651 [2024-11-26 04:41:29.692092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.651 [2024-11-26 04:41:29.692343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.651 [2024-11-26 04:41:29.692477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.651 [2024-11-26 04:41:29.692502] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.651 [2024-11-26 04:41:29.692518] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.652 [2024-11-26 04:41:29.694795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.652 [2024-11-26 04:41:29.703998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.652 [2024-11-26 04:41:29.704406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.704565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.704594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.652 [2024-11-26 04:41:29.704613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.652 [2024-11-26 04:41:29.704802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.652 [2024-11-26 04:41:29.705015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.652 [2024-11-26 04:41:29.705049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.652 [2024-11-26 04:41:29.705075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.652 [2024-11-26 04:41:29.707406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.652 [2024-11-26 04:41:29.716258] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.652 [2024-11-26 04:41:29.716752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.716913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.716940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.652 [2024-11-26 04:41:29.716959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.652 [2024-11-26 04:41:29.717166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.652 [2024-11-26 04:41:29.717337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.652 [2024-11-26 04:41:29.717362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.652 [2024-11-26 04:41:29.717382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.652 [2024-11-26 04:41:29.719749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.652 [2024-11-26 04:41:29.728775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.652 [2024-11-26 04:41:29.729131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.729274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.729305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.652 [2024-11-26 04:41:29.729325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.652 [2024-11-26 04:41:29.729494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.652 [2024-11-26 04:41:29.729697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.652 [2024-11-26 04:41:29.729723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.652 [2024-11-26 04:41:29.729756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.652 [2024-11-26 04:41:29.732038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.652 [2024-11-26 04:41:29.741404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.652 [2024-11-26 04:41:29.741836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.741954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.741998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.652 [2024-11-26 04:41:29.742017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.652 [2024-11-26 04:41:29.742201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.652 [2024-11-26 04:41:29.742352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.652 [2024-11-26 04:41:29.742377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.652 [2024-11-26 04:41:29.742394] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.652 [2024-11-26 04:41:29.744800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.652 [2024-11-26 04:41:29.751808] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:50.652 [2024-11-26 04:41:29.751937] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:50.652 [2024-11-26 04:41:29.751956] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:50.652 [2024-11-26 04:41:29.751969] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:50.652 [2024-11-26 04:41:29.752035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:50.652 [2024-11-26 04:41:29.752095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:50.652 [2024-11-26 04:41:29.752098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:50.652 [2024-11-26 04:41:29.753762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.652 [2024-11-26 04:41:29.754050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.754187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.754213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.652 [2024-11-26 04:41:29.754230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.652 [2024-11-26 04:41:29.754411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.652 [2024-11-26 04:41:29.754543] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.652 [2024-11-26 04:41:29.754564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.652 [2024-11-26 04:41:29.754578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.652 [2024-11-26 04:41:29.756625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.652 [2024-11-26 04:41:29.766078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.652 [2024-11-26 04:41:29.766547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.766738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.766766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.652 [2024-11-26 04:41:29.766785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.652 [2024-11-26 04:41:29.766959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.652 [2024-11-26 04:41:29.767171] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.652 [2024-11-26 04:41:29.767192] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.652 [2024-11-26 04:41:29.767208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.652 [2024-11-26 04:41:29.769232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.652 [2024-11-26 04:41:29.778292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.652 [2024-11-26 04:41:29.778794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.778928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.778954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.652 [2024-11-26 04:41:29.778973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.652 [2024-11-26 04:41:29.779155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.652 [2024-11-26 04:41:29.779287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.652 [2024-11-26 04:41:29.779308] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.652 [2024-11-26 04:41:29.779323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.652 [2024-11-26 04:41:29.781317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.652 [2024-11-26 04:41:29.790924] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.652 [2024-11-26 04:41:29.791444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.791633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.791660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.652 [2024-11-26 04:41:29.791696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.652 [2024-11-26 04:41:29.791823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.652 [2024-11-26 04:41:29.792049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.652 [2024-11-26 04:41:29.792071] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.652 [2024-11-26 04:41:29.792088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.652 [2024-11-26 04:41:29.794105] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.652 [2024-11-26 04:41:29.803241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.652 [2024-11-26 04:41:29.803608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.803767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.652 [2024-11-26 04:41:29.803795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.652 [2024-11-26 04:41:29.803815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.652 [2024-11-26 04:41:29.803939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.653 [2024-11-26 04:41:29.804115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.653 [2024-11-26 04:41:29.804137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.653 [2024-11-26 04:41:29.804152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.653 [2024-11-26 04:41:29.806499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.653 [2024-11-26 04:41:29.815595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.653 [2024-11-26 04:41:29.816076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.653 [2024-11-26 04:41:29.816227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.653 [2024-11-26 04:41:29.816254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.653 [2024-11-26 04:41:29.816274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.653 [2024-11-26 04:41:29.816464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.653 [2024-11-26 04:41:29.816625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.653 [2024-11-26 04:41:29.816649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.653 [2024-11-26 04:41:29.816680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.653 [2024-11-26 04:41:29.818745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.653 [2024-11-26 04:41:29.828078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.653 [2024-11-26 04:41:29.828544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.653 [2024-11-26 04:41:29.828661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.653 [2024-11-26 04:41:29.828700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.653 [2024-11-26 04:41:29.828722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.653 [2024-11-26 04:41:29.828873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.653 [2024-11-26 04:41:29.829099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.653 [2024-11-26 04:41:29.829121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.653 [2024-11-26 04:41:29.829136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.653 [2024-11-26 04:41:29.831341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.653 [2024-11-26 04:41:29.840552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.653 [2024-11-26 04:41:29.840878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.653 [2024-11-26 04:41:29.841015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.653 [2024-11-26 04:41:29.841042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.653 [2024-11-26 04:41:29.841058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.653 [2024-11-26 04:41:29.841207] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.653 [2024-11-26 04:41:29.841386] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.653 [2024-11-26 04:41:29.841407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.653 [2024-11-26 04:41:29.841421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.653 [2024-11-26 04:41:29.843468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.653 [2024-11-26 04:41:29.853079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.653 [2024-11-26 04:41:29.853441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.653 [2024-11-26 04:41:29.853586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.653 [2024-11-26 04:41:29.853616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.653 [2024-11-26 04:41:29.853633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.653 [2024-11-26 04:41:29.853776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.653 [2024-11-26 04:41:29.853927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.653 [2024-11-26 04:41:29.853957] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.653 [2024-11-26 04:41:29.853980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.653 [2024-11-26 04:41:29.856087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.653 [2024-11-26 04:41:29.865359] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.653 [2024-11-26 04:41:29.865599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.653 [2024-11-26 04:41:29.865742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.653 [2024-11-26 04:41:29.865769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.653 [2024-11-26 04:41:29.865785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.653 [2024-11-26 04:41:29.865950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.653 [2024-11-26 04:41:29.866084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.653 [2024-11-26 04:41:29.866121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.653 [2024-11-26 04:41:29.866134] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.653 [2024-11-26 04:41:29.868324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.913 [2024-11-26 04:41:29.877877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.913 [2024-11-26 04:41:29.878270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.913 [2024-11-26 04:41:29.878407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.913 [2024-11-26 04:41:29.878434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.913 [2024-11-26 04:41:29.878450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.913 [2024-11-26 04:41:29.878598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.913 [2024-11-26 04:41:29.878742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.913 [2024-11-26 04:41:29.878765] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.913 [2024-11-26 04:41:29.878778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.913 [2024-11-26 04:41:29.880744] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.913 [2024-11-26 04:41:29.890247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.913 [2024-11-26 04:41:29.890597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.913 [2024-11-26 04:41:29.890725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.913 [2024-11-26 04:41:29.890752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.913 [2024-11-26 04:41:29.890769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.913 [2024-11-26 04:41:29.890934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.913 [2024-11-26 04:41:29.891113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.913 [2024-11-26 04:41:29.891134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.913 [2024-11-26 04:41:29.891153] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.913 [2024-11-26 04:41:29.893230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.913 [2024-11-26 04:41:29.902625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.913 [2024-11-26 04:41:29.902953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.913 [2024-11-26 04:41:29.903091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.913 [2024-11-26 04:41:29.903118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.913 [2024-11-26 04:41:29.903135] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.913 [2024-11-26 04:41:29.903267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.913 [2024-11-26 04:41:29.903432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.913 [2024-11-26 04:41:29.903453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.913 [2024-11-26 04:41:29.903466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.913 [2024-11-26 04:41:29.905482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.913 [2024-11-26 04:41:29.914771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.913 [2024-11-26 04:41:29.915146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.913 [2024-11-26 04:41:29.915243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.913 [2024-11-26 04:41:29.915269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.913 [2024-11-26 04:41:29.915285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.913 [2024-11-26 04:41:29.915464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.913 [2024-11-26 04:41:29.915624] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.913 [2024-11-26 04:41:29.915650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.913 [2024-11-26 04:41:29.915663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.913 [2024-11-26 04:41:29.917777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.913 [2024-11-26 04:41:29.927147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.913 [2024-11-26 04:41:29.927429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.913 [2024-11-26 04:41:29.927558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.913 [2024-11-26 04:41:29.927584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.913 [2024-11-26 04:41:29.927600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.913 [2024-11-26 04:41:29.927741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.913 [2024-11-26 04:41:29.927846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.913 [2024-11-26 04:41:29.927868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.914 [2024-11-26 04:41:29.927882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.914 [2024-11-26 04:41:29.929948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.914 [2024-11-26 04:41:29.939351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.914 [2024-11-26 04:41:29.939665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:29.939782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:29.939809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.914 [2024-11-26 04:41:29.939826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.914 [2024-11-26 04:41:29.939991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.914 [2024-11-26 04:41:29.940126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.914 [2024-11-26 04:41:29.940147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.914 [2024-11-26 04:41:29.940161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.914 [2024-11-26 04:41:29.942109] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.914 [2024-11-26 04:41:29.951693] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.914 [2024-11-26 04:41:29.952029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:29.952162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:29.952189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.914 [2024-11-26 04:41:29.952205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.914 [2024-11-26 04:41:29.952354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.914 [2024-11-26 04:41:29.952515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.914 [2024-11-26 04:41:29.952536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.914 [2024-11-26 04:41:29.952550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.914 [2024-11-26 04:41:29.954446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.914 [2024-11-26 04:41:29.963966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.914 [2024-11-26 04:41:29.964381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:29.964488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:29.964513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.914 [2024-11-26 04:41:29.964529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.914 [2024-11-26 04:41:29.964702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.914 [2024-11-26 04:41:29.964878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.914 [2024-11-26 04:41:29.964900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.914 [2024-11-26 04:41:29.964914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.914 [2024-11-26 04:41:29.966926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.914 [2024-11-26 04:41:29.976275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.914 [2024-11-26 04:41:29.976614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:29.976771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:29.976798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.914 [2024-11-26 04:41:29.976814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.914 [2024-11-26 04:41:29.976963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.914 [2024-11-26 04:41:29.977147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.914 [2024-11-26 04:41:29.977169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.914 [2024-11-26 04:41:29.977183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.914 [2024-11-26 04:41:29.979241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.914 [2024-11-26 04:41:29.988437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.914 [2024-11-26 04:41:29.988775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:29.988945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:29.988971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.914 [2024-11-26 04:41:29.988992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.914 [2024-11-26 04:41:29.989188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.914 [2024-11-26 04:41:29.989366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.914 [2024-11-26 04:41:29.989388] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.914 [2024-11-26 04:41:29.989403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.914 [2024-11-26 04:41:29.991669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.914 [2024-11-26 04:41:30.000653] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.914 [2024-11-26 04:41:30.000975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:30.001105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:30.001130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.914 [2024-11-26 04:41:30.001146] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.914 [2024-11-26 04:41:30.001295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.914 [2024-11-26 04:41:30.001495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.914 [2024-11-26 04:41:30.001523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.914 [2024-11-26 04:41:30.001538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.914 [2024-11-26 04:41:30.003525] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.914 [2024-11-26 04:41:30.012899] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.914 [2024-11-26 04:41:30.013187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:30.013325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:30.013349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.914 [2024-11-26 04:41:30.013366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.914 [2024-11-26 04:41:30.013485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.914 [2024-11-26 04:41:30.013637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.914 [2024-11-26 04:41:30.013660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.914 [2024-11-26 04:41:30.013675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.914 [2024-11-26 04:41:30.015881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.914 [2024-11-26 04:41:30.025165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.914 [2024-11-26 04:41:30.025497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:30.025641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:30.025670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.914 [2024-11-26 04:41:30.025696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.914 [2024-11-26 04:41:30.025864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.914 [2024-11-26 04:41:30.026063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.914 [2024-11-26 04:41:30.026087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.914 [2024-11-26 04:41:30.026101] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.914 [2024-11-26 04:41:30.028171] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.914 [2024-11-26 04:41:30.037594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.914 [2024-11-26 04:41:30.037902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:30.038033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.914 [2024-11-26 04:41:30.038061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.914 [2024-11-26 04:41:30.038078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.914 [2024-11-26 04:41:30.038227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.914 [2024-11-26 04:41:30.038405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.914 [2024-11-26 04:41:30.038427] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.914 [2024-11-26 04:41:30.038441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.914 [2024-11-26 04:41:30.040464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.914 [2024-11-26 04:41:30.049941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.915 [2024-11-26 04:41:30.050202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.050295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.050320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.915 [2024-11-26 04:41:30.050342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.915 [2024-11-26 04:41:30.050541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.915 [2024-11-26 04:41:30.050707] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.915 [2024-11-26 04:41:30.050731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.915 [2024-11-26 04:41:30.050761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.915 [2024-11-26 04:41:30.052881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.915 [2024-11-26 04:41:30.062281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.915 [2024-11-26 04:41:30.062627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.062776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.062805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.915 [2024-11-26 04:41:30.062823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.915 [2024-11-26 04:41:30.062956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.915 [2024-11-26 04:41:30.063088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.915 [2024-11-26 04:41:30.063110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.915 [2024-11-26 04:41:30.063124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.915 [2024-11-26 04:41:30.065049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.915 [2024-11-26 04:41:30.074412] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.915 [2024-11-26 04:41:30.074700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.074871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.074898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.915 [2024-11-26 04:41:30.074915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.915 [2024-11-26 04:41:30.075015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.915 [2024-11-26 04:41:30.075150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.915 [2024-11-26 04:41:30.075173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.915 [2024-11-26 04:41:30.075188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.915 [2024-11-26 04:41:30.077395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.915 [2024-11-26 04:41:30.086789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.915 [2024-11-26 04:41:30.087056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.087153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.087180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.915 [2024-11-26 04:41:30.087197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.915 [2024-11-26 04:41:30.087351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.915 [2024-11-26 04:41:30.087504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.915 [2024-11-26 04:41:30.087527] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.915 [2024-11-26 04:41:30.087541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.915 [2024-11-26 04:41:30.089796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.915 [2024-11-26 04:41:30.099046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.915 [2024-11-26 04:41:30.099327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.099488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.099515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.915 [2024-11-26 04:41:30.099532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.915 [2024-11-26 04:41:30.099649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.915 [2024-11-26 04:41:30.099777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.915 [2024-11-26 04:41:30.099799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.915 [2024-11-26 04:41:30.099813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.915 [2024-11-26 04:41:30.101942] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.915 [2024-11-26 04:41:30.111092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.915 [2024-11-26 04:41:30.111370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.111523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.111551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.915 [2024-11-26 04:41:30.111568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.915 [2024-11-26 04:41:30.111788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.915 [2024-11-26 04:41:30.111958] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.915 [2024-11-26 04:41:30.111996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.915 [2024-11-26 04:41:30.112010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.915 [2024-11-26 04:41:30.113972] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.915 [2024-11-26 04:41:30.123652] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.915 [2024-11-26 04:41:30.123905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.124006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.915 [2024-11-26 04:41:30.124033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:50.915 [2024-11-26 04:41:30.124049] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:50.915 [2024-11-26 04:41:30.124182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:50.915 [2024-11-26 04:41:30.124321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.915 [2024-11-26 04:41:30.124344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.915 [2024-11-26 04:41:30.124373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.915 [2024-11-26 04:41:30.126258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.175 [2024-11-26 04:41:30.136089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.175 [2024-11-26 04:41:30.136388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.175 [2024-11-26 04:41:30.136499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.175 [2024-11-26 04:41:30.136525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.175 [2024-11-26 04:41:30.136542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.175 [2024-11-26 04:41:30.136642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.175 [2024-11-26 04:41:30.136821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.175 [2024-11-26 04:41:30.136859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.175 [2024-11-26 04:41:30.136873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.175 [2024-11-26 04:41:30.138905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.175 [2024-11-26 04:41:30.148485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.175 [2024-11-26 04:41:30.148840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.175 [2024-11-26 04:41:30.148946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.175 [2024-11-26 04:41:30.148971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.175 [2024-11-26 04:41:30.148987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.175 [2024-11-26 04:41:30.149184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.175 [2024-11-26 04:41:30.149350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.175 [2024-11-26 04:41:30.149373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.175 [2024-11-26 04:41:30.149387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.175 [2024-11-26 04:41:30.151537] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.175 [2024-11-26 04:41:30.160595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.175 [2024-11-26 04:41:30.160919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.175 [2024-11-26 04:41:30.161046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.175 [2024-11-26 04:41:30.161070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.175 [2024-11-26 04:41:30.161087] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.175 [2024-11-26 04:41:30.161219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.175 [2024-11-26 04:41:30.161401] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.175 [2024-11-26 04:41:30.161441] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.175 [2024-11-26 04:41:30.161457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.175 [2024-11-26 04:41:30.163608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.175 [2024-11-26 04:41:30.172903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.175 [2024-11-26 04:41:30.173179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.175 [2024-11-26 04:41:30.173305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.175 [2024-11-26 04:41:30.173332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.175 [2024-11-26 04:41:30.173349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.175 [2024-11-26 04:41:30.173450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.176 [2024-11-26 04:41:30.173631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.176 [2024-11-26 04:41:30.173651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.176 [2024-11-26 04:41:30.173665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.176 [2024-11-26 04:41:30.175869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.176 [2024-11-26 04:41:30.185367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.176 [2024-11-26 04:41:30.185667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.185789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.185815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.176 [2024-11-26 04:41:30.185831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.176 [2024-11-26 04:41:30.185980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.176 [2024-11-26 04:41:30.186115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.176 [2024-11-26 04:41:30.186136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.176 [2024-11-26 04:41:30.186150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.176 [2024-11-26 04:41:30.188203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.176 [2024-11-26 04:41:30.197682] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.176 [2024-11-26 04:41:30.197969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.198095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.198121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.176 [2024-11-26 04:41:30.198137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.176 [2024-11-26 04:41:30.198302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.176 [2024-11-26 04:41:30.198450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.176 [2024-11-26 04:41:30.198471] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.176 [2024-11-26 04:41:30.198490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.176 [2024-11-26 04:41:30.200707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.176 [2024-11-26 04:41:30.210115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.176 [2024-11-26 04:41:30.210416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.210539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.210565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.176 [2024-11-26 04:41:30.210582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.176 [2024-11-26 04:41:30.210725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.176 [2024-11-26 04:41:30.210878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.176 [2024-11-26 04:41:30.210901] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.176 [2024-11-26 04:41:30.210916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.176 [2024-11-26 04:41:30.213117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.176 [2024-11-26 04:41:30.222462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.176 [2024-11-26 04:41:30.222763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.222901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.222928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.176 [2024-11-26 04:41:30.222944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.176 [2024-11-26 04:41:30.223126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.176 [2024-11-26 04:41:30.223272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.176 [2024-11-26 04:41:30.223294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.176 [2024-11-26 04:41:30.223308] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.176 [2024-11-26 04:41:30.225420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.176 [2024-11-26 04:41:30.234560] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.176 [2024-11-26 04:41:30.234853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.234985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.235011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.176 [2024-11-26 04:41:30.235028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.176 [2024-11-26 04:41:30.235161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.176 [2024-11-26 04:41:30.235357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.176 [2024-11-26 04:41:30.235379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.176 [2024-11-26 04:41:30.235393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.176 [2024-11-26 04:41:30.237552] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.176 [2024-11-26 04:41:30.247000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.176 [2024-11-26 04:41:30.247347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.247473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.247500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.176 [2024-11-26 04:41:30.247517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.176 [2024-11-26 04:41:30.247618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.176 [2024-11-26 04:41:30.247780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.176 [2024-11-26 04:41:30.247802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.176 [2024-11-26 04:41:30.247816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.176 [2024-11-26 04:41:30.249866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.176 [2024-11-26 04:41:30.259404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.176 [2024-11-26 04:41:30.259659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.259775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.176 [2024-11-26 04:41:30.259800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.176 [2024-11-26 04:41:30.259816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.176 [2024-11-26 04:41:30.259982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.176 [2024-11-26 04:41:30.260117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.176 [2024-11-26 04:41:30.260140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.176 [2024-11-26 04:41:30.260155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.176 [2024-11-26 04:41:30.262221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.177 [2024-11-26 04:41:30.271589] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.177 [2024-11-26 04:41:30.271899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.272009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.272035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.177 [2024-11-26 04:41:30.272052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.177 [2024-11-26 04:41:30.272249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.177 [2024-11-26 04:41:30.272412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.177 [2024-11-26 04:41:30.272433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.177 [2024-11-26 04:41:30.272446] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.177 [2024-11-26 04:41:30.274596] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.177 [2024-11-26 04:41:30.283839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.177 [2024-11-26 04:41:30.284152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.284282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.284309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.177 [2024-11-26 04:41:30.284325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.177 [2024-11-26 04:41:30.284474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.177 [2024-11-26 04:41:30.284622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.177 [2024-11-26 04:41:30.284643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.177 [2024-11-26 04:41:30.284672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.177 [2024-11-26 04:41:30.286763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.177 [2024-11-26 04:41:30.296191] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.177 [2024-11-26 04:41:30.296509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.296633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.296659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.177 [2024-11-26 04:41:30.296676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.177 [2024-11-26 04:41:30.296882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.177 [2024-11-26 04:41:30.297045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.177 [2024-11-26 04:41:30.297065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.177 [2024-11-26 04:41:30.297079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.177 [2024-11-26 04:41:30.299294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.177 [2024-11-26 04:41:30.308643] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.177 [2024-11-26 04:41:30.308949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.309087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.309113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.177 [2024-11-26 04:41:30.309129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.177 [2024-11-26 04:41:30.309309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.177 [2024-11-26 04:41:30.309492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.177 [2024-11-26 04:41:30.309514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.177 [2024-11-26 04:41:30.309528] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.177 [2024-11-26 04:41:30.311628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.177 [2024-11-26 04:41:30.320935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.177 [2024-11-26 04:41:30.321224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.321356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.321382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.177 [2024-11-26 04:41:30.321398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.177 [2024-11-26 04:41:30.321529] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.177 [2024-11-26 04:41:30.321735] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.177 [2024-11-26 04:41:30.321773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.177 [2024-11-26 04:41:30.321787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.177 [2024-11-26 04:41:30.323817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.177 [2024-11-26 04:41:30.333312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.177 [2024-11-26 04:41:30.333656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.333785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.333812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.177 [2024-11-26 04:41:30.333829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.177 [2024-11-26 04:41:30.334010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.177 [2024-11-26 04:41:30.334218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.177 [2024-11-26 04:41:30.334239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.177 [2024-11-26 04:41:30.334264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.177 [2024-11-26 04:41:30.336480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.177 [2024-11-26 04:41:30.345593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.177 [2024-11-26 04:41:30.345903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.346012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.177 [2024-11-26 04:41:30.346038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.177 [2024-11-26 04:41:30.346054] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.177 [2024-11-26 04:41:30.346235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.177 [2024-11-26 04:41:30.346413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.178 [2024-11-26 04:41:30.346433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.178 [2024-11-26 04:41:30.346447] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.178 [2024-11-26 04:41:30.348712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.178 [2024-11-26 04:41:30.357766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.178 [2024-11-26 04:41:30.358138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.178 [2024-11-26 04:41:30.358281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.178 [2024-11-26 04:41:30.358310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.178 [2024-11-26 04:41:30.358327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.178 [2024-11-26 04:41:30.358443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.178 [2024-11-26 04:41:30.358638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.178 [2024-11-26 04:41:30.358659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.178 [2024-11-26 04:41:30.358696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.178 [2024-11-26 04:41:30.360779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.178 [2024-11-26 04:41:30.370071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.178 [2024-11-26 04:41:30.370358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.178 [2024-11-26 04:41:30.370462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.178 [2024-11-26 04:41:30.370487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.178 [2024-11-26 04:41:30.370503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.178 [2024-11-26 04:41:30.370619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.178 [2024-11-26 04:41:30.370828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.178 [2024-11-26 04:41:30.370851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.178 [2024-11-26 04:41:30.370864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.178 [2024-11-26 04:41:30.372836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.178 [2024-11-26 04:41:30.382325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.178 [2024-11-26 04:41:30.382675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.178 [2024-11-26 04:41:30.382847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.178 [2024-11-26 04:41:30.382874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.178 [2024-11-26 04:41:30.382890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.178 [2024-11-26 04:41:30.383069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.178 [2024-11-26 04:41:30.383230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.178 [2024-11-26 04:41:30.383251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.178 [2024-11-26 04:41:30.383265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.178 [2024-11-26 04:41:30.385238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.178 [2024-11-26 04:41:30.394799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.178 [2024-11-26 04:41:30.395086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.178 [2024-11-26 04:41:30.395214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.178 [2024-11-26 04:41:30.395239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.178 [2024-11-26 04:41:30.395260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.178 [2024-11-26 04:41:30.395441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.178 [2024-11-26 04:41:30.395622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.178 [2024-11-26 04:41:30.395651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.178 [2024-11-26 04:41:30.395665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.437 [2024-11-26 04:41:30.397799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.437 [2024-11-26 04:41:30.407148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.437 [2024-11-26 04:41:30.407446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.437 [2024-11-26 04:41:30.407573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.437 [2024-11-26 04:41:30.407600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.437 [2024-11-26 04:41:30.407616] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.437 [2024-11-26 04:41:30.407790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.437 [2024-11-26 04:41:30.407985] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.437 [2024-11-26 04:41:30.408008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.437 [2024-11-26 04:41:30.408021] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.437 [2024-11-26 04:41:30.410111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.437 [2024-11-26 04:41:30.419459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.437 [2024-11-26 04:41:30.419797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.437 [2024-11-26 04:41:30.419953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.437 [2024-11-26 04:41:30.419979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.437 [2024-11-26 04:41:30.419994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.437 [2024-11-26 04:41:30.420159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.437 [2024-11-26 04:41:30.420336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.437 [2024-11-26 04:41:30.420357] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.437 [2024-11-26 04:41:30.420371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.437 [2024-11-26 04:41:30.422329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.437 [2024-11-26 04:41:30.431853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.437 [2024-11-26 04:41:30.432169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.437 [2024-11-26 04:41:30.432286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.437 [2024-11-26 04:41:30.432313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.437 [2024-11-26 04:41:30.432329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.437 [2024-11-26 04:41:30.432451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.437 [2024-11-26 04:41:30.432648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.437 [2024-11-26 04:41:30.432669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.437 [2024-11-26 04:41:30.432682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.438 [2024-11-26 04:41:30.434657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.438 [2024-11-26 04:41:30.444110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.438 [2024-11-26 04:41:30.444469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.444571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.444597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.438 [2024-11-26 04:41:30.444614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.438 [2024-11-26 04:41:30.444788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.438 [2024-11-26 04:41:30.444941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.438 [2024-11-26 04:41:30.444963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.438 [2024-11-26 04:41:30.444978] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.438 [2024-11-26 04:41:30.446871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.438 [2024-11-26 04:41:30.456373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.438 [2024-11-26 04:41:30.456694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.456796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.456823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.438 [2024-11-26 04:41:30.456839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.438 [2024-11-26 04:41:30.456987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.438 [2024-11-26 04:41:30.457150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.438 [2024-11-26 04:41:30.457171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.438 [2024-11-26 04:41:30.457184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.438 [2024-11-26 04:41:30.459235] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.438 [2024-11-26 04:41:30.468841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.438 [2024-11-26 04:41:30.469217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.469325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.469349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.438 [2024-11-26 04:41:30.469365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.438 [2024-11-26 04:41:30.469513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.438 [2024-11-26 04:41:30.469693] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.438 [2024-11-26 04:41:30.469730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.438 [2024-11-26 04:41:30.469745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.438 [2024-11-26 04:41:30.471827] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.438 [2024-11-26 04:41:30.481131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.438 [2024-11-26 04:41:30.481393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.481521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.481546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.438 [2024-11-26 04:41:30.481562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.438 [2024-11-26 04:41:30.481718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.438 [2024-11-26 04:41:30.481886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.438 [2024-11-26 04:41:30.481907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.438 [2024-11-26 04:41:30.481922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.438 [2024-11-26 04:41:30.483855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.438 [2024-11-26 04:41:30.493411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.438 [2024-11-26 04:41:30.493737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.493895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.493921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.438 [2024-11-26 04:41:30.493938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.438 [2024-11-26 04:41:30.494103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.438 [2024-11-26 04:41:30.494294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.438 [2024-11-26 04:41:30.494315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.438 [2024-11-26 04:41:30.494329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.438 [2024-11-26 04:41:30.496406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.438 [2024-11-26 04:41:30.505840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.438 [2024-11-26 04:41:30.506154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.506280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.506307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.438 [2024-11-26 04:41:30.506323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.438 [2024-11-26 04:41:30.506503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.438 [2024-11-26 04:41:30.506666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.438 [2024-11-26 04:41:30.506713] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.438 [2024-11-26 04:41:30.506729] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.438 [2024-11-26 04:41:30.508898] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.438 [2024-11-26 04:41:30.518028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.438 [2024-11-26 04:41:30.518310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.518462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.518487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.438 [2024-11-26 04:41:30.518504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.438 [2024-11-26 04:41:30.518669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.438 [2024-11-26 04:41:30.518828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.438 [2024-11-26 04:41:30.518850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.438 [2024-11-26 04:41:30.518865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.438 [2024-11-26 04:41:30.521055] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.438 [2024-11-26 04:41:30.530458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.438 [2024-11-26 04:41:30.530777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.530876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.530901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.438 [2024-11-26 04:41:30.530918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.438 [2024-11-26 04:41:30.531099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.438 [2024-11-26 04:41:30.531251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.438 [2024-11-26 04:41:30.531272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.438 [2024-11-26 04:41:30.531286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.438 [2024-11-26 04:41:30.533497] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.438 04:41:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:51.438 04:41:30 -- common/autotest_common.sh@862 -- # return 0 00:29:51.438 04:41:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:51.438 04:41:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:51.438 04:41:30 -- common/autotest_common.sh@10 -- # set +x 00:29:51.438 [2024-11-26 04:41:30.542962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.438 [2024-11-26 04:41:30.543319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.543449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.438 [2024-11-26 04:41:30.543476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.438 [2024-11-26 04:41:30.543493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.438 [2024-11-26 04:41:30.543641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.438 [2024-11-26 04:41:30.543803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.438 [2024-11-26 04:41:30.543826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.438 [2024-11-26 04:41:30.543840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.439 [2024-11-26 04:41:30.545718] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.439 [2024-11-26 04:41:30.555556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.439 [2024-11-26 04:41:30.555879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.555979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.556016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.439 [2024-11-26 04:41:30.556032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.439 [2024-11-26 04:41:30.556211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.439 [2024-11-26 04:41:30.556358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.439 [2024-11-26 04:41:30.556380] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.439 [2024-11-26 04:41:30.556394] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.439 [2024-11-26 04:41:30.558342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.439 04:41:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:51.439 04:41:30 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:51.439 04:41:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.439 04:41:30 -- common/autotest_common.sh@10 -- # set +x 00:29:51.439 [2024-11-26 04:41:30.565774] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:51.439 [2024-11-26 04:41:30.567801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.439 [2024-11-26 04:41:30.568058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.568210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.568237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.439 [2024-11-26 04:41:30.568253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.439 [2024-11-26 04:41:30.568369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.439 [2024-11-26 04:41:30.568513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.439 [2024-11-26 04:41:30.568534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.439 [2024-11-26 04:41:30.568563] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.439 [2024-11-26 04:41:30.570604] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.439 04:41:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.439 04:41:30 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:51.439 04:41:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.439 04:41:30 -- common/autotest_common.sh@10 -- # set +x 00:29:51.439 [2024-11-26 04:41:30.580044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.439 [2024-11-26 04:41:30.580353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.580504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.580537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.439 [2024-11-26 04:41:30.580554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.439 [2024-11-26 04:41:30.580670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.439 [2024-11-26 04:41:30.580834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.439 [2024-11-26 04:41:30.580856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.439 [2024-11-26 04:41:30.580870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.439 [2024-11-26 04:41:30.582818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.439 [2024-11-26 04:41:30.592330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.439 [2024-11-26 04:41:30.592619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.592769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.592798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.439 [2024-11-26 04:41:30.592815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.439 [2024-11-26 04:41:30.592997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.439 [2024-11-26 04:41:30.593139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.439 [2024-11-26 04:41:30.593160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.439 [2024-11-26 04:41:30.593173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.439 [2024-11-26 04:41:30.595381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.439 [2024-11-26 04:41:30.604707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.439 [2024-11-26 04:41:30.605181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.605340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.605367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.439 [2024-11-26 04:41:30.605385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.439 [2024-11-26 04:41:30.605555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.439 [2024-11-26 04:41:30.605777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.439 [2024-11-26 04:41:30.605800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.439 [2024-11-26 04:41:30.605816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.439 [2024-11-26 04:41:30.607909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.439 Malloc0 00:29:51.439 04:41:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.439 [2024-11-26 04:41:30.617024] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.439 04:41:30 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:51.439 04:41:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.439 [2024-11-26 04:41:30.617360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 04:41:30 -- common/autotest_common.sh@10 -- # set +x 00:29:51.439 [2024-11-26 04:41:30.617478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.617505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.439 [2024-11-26 04:41:30.617523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.439 [2024-11-26 04:41:30.617646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.439 [2024-11-26 04:41:30.617821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.439 [2024-11-26 04:41:30.617844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.439 [2024-11-26 04:41:30.617860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.439 [2024-11-26 04:41:30.619956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.439 04:41:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.439 04:41:30 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:51.439 04:41:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.439 04:41:30 -- common/autotest_common.sh@10 -- # set +x 00:29:51.439 [2024-11-26 04:41:30.629622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.439 [2024-11-26 04:41:30.629898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.630032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:51.439 [2024-11-26 04:41:30.630058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xadd1d0 with addr=10.0.0.2, port=4420 00:29:51.439 [2024-11-26 04:41:30.630074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xadd1d0 is same with the state(5) to be set 00:29:51.439 [2024-11-26 04:41:30.630189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xadd1d0 (9): Bad file descriptor 00:29:51.439 [2024-11-26 04:41:30.630356] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:51.439 [2024-11-26 04:41:30.630392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:51.439 [2024-11-26 04:41:30.630406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:51.439 04:41:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.439 [2024-11-26 04:41:30.632603] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:51.439 04:41:30 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:51.439 04:41:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.439 04:41:30 -- common/autotest_common.sh@10 -- # set +x 00:29:51.439 [2024-11-26 04:41:30.636420] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:51.439 04:41:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.439 04:41:30 -- host/bdevperf.sh@38 -- # wait 3041154 00:29:51.439 [2024-11-26 04:41:30.642153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:51.697 [2024-11-26 04:41:30.672907] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:59.819 00:29:59.819 Latency(us) 00:29:59.819 [2024-11-26T03:41:39.046Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:59.820 [2024-11-26T03:41:39.046Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:59.820 Verification LBA range: start 0x0 length 0x4000 00:29:59.820 Nvme1n1 : 15.01 9164.07 35.80 15716.82 0.00 5129.42 734.25 20486.07 00:29:59.820 [2024-11-26T03:41:39.046Z] =================================================================================================================== 00:29:59.820 [2024-11-26T03:41:39.046Z] Total : 9164.07 35.80 15716.82 0.00 5129.42 734.25 20486.07 00:30:00.085 04:41:39 -- host/bdevperf.sh@39 -- # sync 00:30:00.085 04:41:39 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:00.085 04:41:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.085 04:41:39 -- common/autotest_common.sh@10 -- # set +x 00:30:00.086 04:41:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.086 04:41:39 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:00.086 04:41:39 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:00.086 04:41:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:00.086 04:41:39 -- nvmf/common.sh@116 -- # sync 00:30:00.086 04:41:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:00.086 04:41:39 -- nvmf/common.sh@119 -- # set +e 00:30:00.086 04:41:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:00.086 04:41:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:00.086 rmmod nvme_tcp 00:30:00.086 rmmod nvme_fabrics 00:30:00.086 rmmod nvme_keyring 00:30:00.086 04:41:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:00.086 04:41:39 -- nvmf/common.sh@123 -- # set -e 00:30:00.086 04:41:39 -- nvmf/common.sh@124 -- # return 0 00:30:00.086 04:41:39 -- nvmf/common.sh@477 -- # '[' -n 3041841 ']' 00:30:00.086 04:41:39 -- nvmf/common.sh@478 -- # killprocess 3041841 00:30:00.086 04:41:39 -- common/autotest_common.sh@936 -- # '[' -z 3041841 ']' 00:30:00.086 04:41:39 -- common/autotest_common.sh@940 -- # kill -0 3041841 00:30:00.086 04:41:39 -- common/autotest_common.sh@941 -- # uname 00:30:00.086 04:41:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:00.086 04:41:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3041841 00:30:00.086 04:41:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:00.086 04:41:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:00.086 04:41:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3041841' 00:30:00.086 killing process with pid 3041841 00:30:00.086 04:41:39 -- common/autotest_common.sh@955 -- # kill 3041841 00:30:00.086 04:41:39 -- common/autotest_common.sh@960 -- # wait 3041841 00:30:00.354 04:41:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:00.354 04:41:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:00.354 04:41:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:00.354 04:41:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:00.354 04:41:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:00.354 04:41:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:00.354 04:41:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:00.354 04:41:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:02.890 04:41:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:02.890 00:30:02.890 real 0m22.989s 00:30:02.890 user 1m2.174s 00:30:02.890 sys 0m4.212s 00:30:02.890 04:41:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:02.890 04:41:41 -- common/autotest_common.sh@10 -- # set +x 00:30:02.890 ************************************ 00:30:02.890 END TEST nvmf_bdevperf 00:30:02.890 ************************************ 00:30:02.890 04:41:41 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:02.890 04:41:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:02.890 04:41:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:02.890 04:41:41 -- common/autotest_common.sh@10 -- # set +x 00:30:02.890 ************************************ 00:30:02.890 START TEST nvmf_target_disconnect 00:30:02.890 ************************************ 00:30:02.890 04:41:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:02.890 * Looking for test storage... 00:30:02.890 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:02.890 04:41:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:02.890 04:41:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:02.890 04:41:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:02.890 04:41:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:02.890 04:41:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:02.890 04:41:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:02.890 04:41:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:02.890 04:41:41 -- scripts/common.sh@335 -- # IFS=.-: 00:30:02.890 04:41:41 -- scripts/common.sh@335 -- # read -ra ver1 00:30:02.890 04:41:41 -- scripts/common.sh@336 -- # IFS=.-: 00:30:02.890 04:41:41 -- scripts/common.sh@336 -- # read -ra ver2 00:30:02.890 04:41:41 -- scripts/common.sh@337 -- # local 'op=<' 00:30:02.890 04:41:41 -- scripts/common.sh@339 -- # ver1_l=2 00:30:02.890 04:41:41 -- scripts/common.sh@340 -- # ver2_l=1 00:30:02.890 04:41:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:02.890 04:41:41 -- scripts/common.sh@343 -- # case "$op" in 00:30:02.890 04:41:41 -- scripts/common.sh@344 -- # : 1 00:30:02.890 04:41:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:02.890 04:41:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:02.890 04:41:41 -- scripts/common.sh@364 -- # decimal 1 00:30:02.890 04:41:41 -- scripts/common.sh@352 -- # local d=1 00:30:02.890 04:41:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:02.890 04:41:41 -- scripts/common.sh@354 -- # echo 1 00:30:02.890 04:41:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:02.890 04:41:41 -- scripts/common.sh@365 -- # decimal 2 00:30:02.890 04:41:41 -- scripts/common.sh@352 -- # local d=2 00:30:02.890 04:41:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:02.890 04:41:41 -- scripts/common.sh@354 -- # echo 2 00:30:02.890 04:41:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:02.890 04:41:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:02.891 04:41:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:02.891 04:41:41 -- scripts/common.sh@367 -- # return 0 00:30:02.891 04:41:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:02.891 04:41:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:02.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:02.891 --rc genhtml_branch_coverage=1 00:30:02.891 --rc genhtml_function_coverage=1 00:30:02.891 --rc genhtml_legend=1 00:30:02.891 --rc geninfo_all_blocks=1 00:30:02.891 --rc geninfo_unexecuted_blocks=1 00:30:02.891 00:30:02.891 ' 00:30:02.891 04:41:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:02.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:02.891 --rc genhtml_branch_coverage=1 00:30:02.891 --rc genhtml_function_coverage=1 00:30:02.891 --rc genhtml_legend=1 00:30:02.891 --rc geninfo_all_blocks=1 00:30:02.891 --rc geninfo_unexecuted_blocks=1 00:30:02.891 00:30:02.891 ' 00:30:02.891 04:41:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:02.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:02.891 --rc genhtml_branch_coverage=1 00:30:02.891 --rc genhtml_function_coverage=1 00:30:02.891 --rc genhtml_legend=1 00:30:02.891 --rc geninfo_all_blocks=1 00:30:02.891 --rc geninfo_unexecuted_blocks=1 00:30:02.891 00:30:02.891 ' 00:30:02.891 04:41:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:02.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:02.891 --rc genhtml_branch_coverage=1 00:30:02.891 --rc genhtml_function_coverage=1 00:30:02.891 --rc genhtml_legend=1 00:30:02.891 --rc geninfo_all_blocks=1 00:30:02.891 --rc geninfo_unexecuted_blocks=1 00:30:02.891 00:30:02.891 ' 00:30:02.891 04:41:41 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:02.891 04:41:41 -- nvmf/common.sh@7 -- # uname -s 00:30:02.891 04:41:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:02.891 04:41:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:02.891 04:41:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:02.891 04:41:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:02.891 04:41:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:02.891 04:41:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:02.891 04:41:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:02.891 04:41:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:02.891 04:41:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:02.891 04:41:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:02.891 04:41:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:02.891 04:41:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:02.891 04:41:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:02.891 04:41:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:02.891 04:41:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:02.891 04:41:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:02.891 04:41:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:02.891 04:41:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:02.891 04:41:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:02.891 04:41:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:02.891 04:41:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:02.891 04:41:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:02.891 04:41:41 -- paths/export.sh@5 -- # export PATH 00:30:02.891 04:41:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:02.891 04:41:41 -- nvmf/common.sh@46 -- # : 0 00:30:02.891 04:41:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:02.891 04:41:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:02.891 04:41:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:02.891 04:41:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:02.891 04:41:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:02.891 04:41:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:02.891 04:41:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:02.891 04:41:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:02.891 04:41:41 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:02.891 04:41:41 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:02.891 04:41:41 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:02.891 04:41:41 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:02.891 04:41:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:02.891 04:41:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:02.891 04:41:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:02.891 04:41:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:02.891 04:41:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:02.891 04:41:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:02.891 04:41:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:02.891 04:41:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:02.891 04:41:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:02.891 04:41:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:02.891 04:41:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:02.891 04:41:41 -- common/autotest_common.sh@10 -- # set +x 00:30:04.794 04:41:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:04.795 04:41:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:04.795 04:41:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:04.795 04:41:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:04.795 04:41:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:04.795 04:41:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:04.795 04:41:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:04.795 04:41:43 -- nvmf/common.sh@294 -- # net_devs=() 00:30:04.795 04:41:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:04.795 04:41:43 -- nvmf/common.sh@295 -- # e810=() 00:30:04.795 04:41:43 -- nvmf/common.sh@295 -- # local -ga e810 00:30:04.795 04:41:43 -- nvmf/common.sh@296 -- # x722=() 00:30:04.795 04:41:43 -- nvmf/common.sh@296 -- # local -ga x722 00:30:04.795 04:41:43 -- nvmf/common.sh@297 -- # mlx=() 00:30:04.795 04:41:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:04.795 04:41:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:04.795 04:41:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:04.795 04:41:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:04.795 04:41:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:04.795 04:41:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:04.795 04:41:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:04.795 04:41:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:04.795 04:41:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:04.795 04:41:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:04.795 04:41:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:04.795 04:41:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:04.795 04:41:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:04.795 04:41:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:04.795 04:41:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:04.795 04:41:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:04.795 04:41:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:04.795 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:04.795 04:41:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:04.795 04:41:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:04.795 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:04.795 04:41:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:04.795 04:41:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:04.795 04:41:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:04.795 04:41:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:04.795 04:41:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:04.795 04:41:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:04.795 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:04.795 04:41:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:04.795 04:41:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:04.795 04:41:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:04.795 04:41:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:04.795 04:41:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:04.795 04:41:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:04.795 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:04.795 04:41:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:04.795 04:41:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:04.795 04:41:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:04.795 04:41:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:04.795 04:41:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:04.795 04:41:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:04.795 04:41:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:04.795 04:41:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:04.795 04:41:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:04.795 04:41:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:04.795 04:41:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:04.795 04:41:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:04.795 04:41:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:04.795 04:41:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:04.795 04:41:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:04.795 04:41:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:04.795 04:41:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:04.795 04:41:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:04.795 04:41:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:04.795 04:41:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:04.795 04:41:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:04.795 04:41:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:04.795 04:41:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:04.795 04:41:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:04.795 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:04.795 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:30:04.795 00:30:04.795 --- 10.0.0.2 ping statistics --- 00:30:04.795 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:04.795 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:30:04.795 04:41:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:04.795 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:04.795 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:30:04.795 00:30:04.795 --- 10.0.0.1 ping statistics --- 00:30:04.795 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:04.795 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:30:04.795 04:41:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:04.795 04:41:43 -- nvmf/common.sh@410 -- # return 0 00:30:04.795 04:41:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:04.795 04:41:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:04.795 04:41:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:04.795 04:41:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:04.795 04:41:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:04.795 04:41:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:04.795 04:41:43 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:04.795 04:41:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:04.795 04:41:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:04.795 04:41:43 -- common/autotest_common.sh@10 -- # set +x 00:30:04.795 ************************************ 00:30:04.795 START TEST nvmf_target_disconnect_tc1 00:30:04.795 ************************************ 00:30:04.795 04:41:43 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:04.795 04:41:43 -- host/target_disconnect.sh@32 -- # set +e 00:30:04.795 04:41:43 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:04.795 EAL: No free 2048 kB hugepages reported on node 1 00:30:04.795 [2024-11-26 04:41:43.935621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.795 [2024-11-26 04:41:43.935843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.795 [2024-11-26 04:41:43.935876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe64270 with addr=10.0.0.2, port=4420 00:30:04.795 [2024-11-26 04:41:43.935914] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:04.795 [2024-11-26 04:41:43.935941] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:04.795 [2024-11-26 04:41:43.935957] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:04.795 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:04.795 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:04.795 Initializing NVMe Controllers 00:30:04.795 04:41:43 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:04.795 04:41:43 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:04.795 04:41:43 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:04.795 04:41:43 -- common/autotest_common.sh@1142 -- # return 0 00:30:04.795 04:41:43 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:04.795 04:41:43 -- host/target_disconnect.sh@41 -- # set -e 00:30:04.795 00:30:04.795 real 0m0.085s 00:30:04.795 user 0m0.028s 00:30:04.795 sys 0m0.056s 00:30:04.795 04:41:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:04.795 04:41:43 -- common/autotest_common.sh@10 -- # set +x 00:30:04.795 ************************************ 00:30:04.795 END TEST nvmf_target_disconnect_tc1 00:30:04.795 ************************************ 00:30:04.795 04:41:43 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:04.795 04:41:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:04.795 04:41:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:04.795 04:41:43 -- common/autotest_common.sh@10 -- # set +x 00:30:04.795 ************************************ 00:30:04.795 START TEST nvmf_target_disconnect_tc2 00:30:04.795 ************************************ 00:30:04.796 04:41:43 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:04.796 04:41:43 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:04.796 04:41:43 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:04.796 04:41:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:04.796 04:41:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:04.796 04:41:43 -- common/autotest_common.sh@10 -- # set +x 00:30:04.796 04:41:43 -- nvmf/common.sh@469 -- # nvmfpid=3045040 00:30:04.796 04:41:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:04.796 04:41:43 -- nvmf/common.sh@470 -- # waitforlisten 3045040 00:30:04.796 04:41:43 -- common/autotest_common.sh@829 -- # '[' -z 3045040 ']' 00:30:04.796 04:41:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:04.796 04:41:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:04.796 04:41:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:04.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:04.796 04:41:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:04.796 04:41:43 -- common/autotest_common.sh@10 -- # set +x 00:30:04.796 [2024-11-26 04:41:44.014136] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:04.796 [2024-11-26 04:41:44.014214] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:05.055 EAL: No free 2048 kB hugepages reported on node 1 00:30:05.055 [2024-11-26 04:41:44.077800] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:05.055 [2024-11-26 04:41:44.162257] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:05.055 [2024-11-26 04:41:44.162407] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:05.055 [2024-11-26 04:41:44.162424] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:05.055 [2024-11-26 04:41:44.162437] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:05.055 [2024-11-26 04:41:44.162532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:05.055 [2024-11-26 04:41:44.162596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:05.055 [2024-11-26 04:41:44.162661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:05.055 [2024-11-26 04:41:44.162664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:05.991 04:41:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:05.991 04:41:44 -- common/autotest_common.sh@862 -- # return 0 00:30:05.991 04:41:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:05.991 04:41:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:05.991 04:41:44 -- common/autotest_common.sh@10 -- # set +x 00:30:05.991 04:41:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:05.991 04:41:45 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:05.991 04:41:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:05.991 04:41:45 -- common/autotest_common.sh@10 -- # set +x 00:30:05.991 Malloc0 00:30:05.991 04:41:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:05.991 04:41:45 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:05.991 04:41:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:05.991 04:41:45 -- common/autotest_common.sh@10 -- # set +x 00:30:05.991 [2024-11-26 04:41:45.039495] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:05.991 04:41:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:05.991 04:41:45 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:05.991 04:41:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:05.991 04:41:45 -- common/autotest_common.sh@10 -- # set +x 00:30:05.991 04:41:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:05.991 04:41:45 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:05.991 04:41:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:05.991 04:41:45 -- common/autotest_common.sh@10 -- # set +x 00:30:05.991 04:41:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:05.991 04:41:45 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:05.991 04:41:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:05.991 04:41:45 -- common/autotest_common.sh@10 -- # set +x 00:30:05.991 [2024-11-26 04:41:45.067818] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:05.991 04:41:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:05.991 04:41:45 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:05.991 04:41:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:05.991 04:41:45 -- common/autotest_common.sh@10 -- # set +x 00:30:05.991 04:41:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:05.991 04:41:45 -- host/target_disconnect.sh@50 -- # reconnectpid=3045196 00:30:05.991 04:41:45 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:05.991 04:41:45 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:05.991 EAL: No free 2048 kB hugepages reported on node 1 00:30:07.897 04:41:47 -- host/target_disconnect.sh@53 -- # kill -9 3045040 00:30:07.897 04:41:47 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 [2024-11-26 04:41:47.092195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 [2024-11-26 04:41:47.092484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Write completed with error (sct=0, sc=8) 00:30:07.897 starting I/O failed 00:30:07.897 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 [2024-11-26 04:41:47.092831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Read completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 Write completed with error (sct=0, sc=8) 00:30:07.898 starting I/O failed 00:30:07.898 [2024-11-26 04:41:47.093148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:07.898 [2024-11-26 04:41:47.093429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.093602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.093649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.093764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.093901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.093927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.094038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.094169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.094195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.094328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.094516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.094560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.094706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.094843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.094869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.094972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.095100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.095127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.095253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.095381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.095408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.095538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.095670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.095705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.095807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.095913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.095941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.096095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.096220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.096247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.096375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.096504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.096530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.096627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.096737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.096765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.096872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.096968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.096994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.097086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.097189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.097215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.097370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.097499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.898 [2024-11-26 04:41:47.097525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.898 qpair failed and we were unable to recover it. 00:30:07.898 [2024-11-26 04:41:47.097649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.097763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.097790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.097883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.097986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.098012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.098109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.098265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.098291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.098514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.098606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.098632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.098766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.098867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.098893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.099100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.099280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.099306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.099428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.099557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.099582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.099706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.099804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.099830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.099927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.100025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.100067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.100153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.100284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.100310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.100437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.100566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.100594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.100736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.100865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.100891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.100993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.101146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.101172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.101329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.101481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.101508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.101637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.101740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.101767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.101867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.101990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.102016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.102140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.102229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.102254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.102380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.102509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.102535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.102659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.102797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.102828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.102928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.103074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.103101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.103259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.103414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.103442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.103564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.103697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.103724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.103869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.103960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.103986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.104108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.104229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.104255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.104410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.104541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.104567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.104663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.104792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.104819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.104944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.105089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.105115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.105246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.105371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.105398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.899 qpair failed and we were unable to recover it. 00:30:07.899 [2024-11-26 04:41:47.105516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.899 [2024-11-26 04:41:47.105615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.105646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.105763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.105871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.105897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.106024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.106153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.106179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.106282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.106412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.106438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.106567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.106670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.106714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.106854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.106981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.107008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.107255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.107435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.107460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.107606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.107728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.107754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.107860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.107991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.108017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.108139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.108244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.108272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.108428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.108558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.108589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.108721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.108817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.108843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.108990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.109105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.109131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.109259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.109365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.109392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.109501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.109657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.109683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.109844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.109983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.110026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.110139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.110281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.110307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.110433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.110557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.110583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.110707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.110793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.110819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.110942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.111059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.111085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.111203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.111367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.111398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.111525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.111651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.111677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.111788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.111911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.111937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.112064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.112169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.112195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.112327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.112447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.112473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.112632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.112769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.112798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.112891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.113036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.113080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.113205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.113374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.113401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.900 qpair failed and we were unable to recover it. 00:30:07.900 [2024-11-26 04:41:47.113525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.900 [2024-11-26 04:41:47.113663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.113720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.113875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.114021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.114047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.114197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.114351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.114377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.114537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.114697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.114724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.114858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.114962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.114987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.115141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.115235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.115263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.115389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.115486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.115513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.115637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.115745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.115771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.115898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.116001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.116027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.116181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.116307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.116333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.116432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.116550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.116575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.116726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.116827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.116853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.116956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.117053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.901 [2024-11-26 04:41:47.117079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:07.901 qpair failed and we were unable to recover it. 00:30:07.901 [2024-11-26 04:41:47.117177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.117328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.117355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.176 qpair failed and we were unable to recover it. 00:30:08.176 [2024-11-26 04:41:47.117479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.117609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.117635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.176 qpair failed and we were unable to recover it. 00:30:08.176 [2024-11-26 04:41:47.117793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.117921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.117947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.176 qpair failed and we were unable to recover it. 00:30:08.176 [2024-11-26 04:41:47.118105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.118203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.118232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.176 qpair failed and we were unable to recover it. 00:30:08.176 [2024-11-26 04:41:47.118362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.118485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.118511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.176 qpair failed and we were unable to recover it. 00:30:08.176 [2024-11-26 04:41:47.118652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.118781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.118825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.176 qpair failed and we were unable to recover it. 00:30:08.176 [2024-11-26 04:41:47.119012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.119157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.176 [2024-11-26 04:41:47.119185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.176 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.119316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.119467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.119495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.119594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.119745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.119771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.119881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.119980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.120007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.120139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.120244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.120273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.120426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.120542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.120570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.120730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.120886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.120912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.121020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.121172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.121199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.121300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.121452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.121479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.121638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.121777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.121804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.121933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.122035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.122062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.122215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.122369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.122396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.122528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.122683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.122717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.122869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.123080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.123108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.123242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.123393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.123419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.123523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.123671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.123705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.123840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.123978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.124005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.124133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.124261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.124288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.124393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.124485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.124509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.124629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.124773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.124817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.124936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.125093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.125137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.125243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.125375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.125402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.125565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.125665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.125699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.125854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.125990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.126017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.126111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.126261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.126288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.126447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.126563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.126590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.126693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.126829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.126855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.126981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.127127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.127171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.177 qpair failed and we were unable to recover it. 00:30:08.177 [2024-11-26 04:41:47.127329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.177 [2024-11-26 04:41:47.127454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.127481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.127608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.127768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.127794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.127899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.128079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.128128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.128257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.128379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.128407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.128565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.128695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.128734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.128922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.129054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.129081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.129191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.129312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.129340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.129461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.129554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.129580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.129718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.129857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.129883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.130057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.130209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.130236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.130366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.130514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.130541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.130711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.130866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.130909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.131051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.131189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.131216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.131369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.131469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.131497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.131621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.131735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.131762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.131867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.132059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.132103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.132246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.132402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.132433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.132592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.132720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.132751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.132905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.133030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.133062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.133234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.133355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.133382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.133540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.133695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.133723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.133818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.133986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.134013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.134176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.134318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.134347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.134510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.134631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.134660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.134819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.134973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.134999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.135121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.135292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.135321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.135469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.135630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.135659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.135788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.135939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.135981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.178 qpair failed and we were unable to recover it. 00:30:08.178 [2024-11-26 04:41:47.136140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.136318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.178 [2024-11-26 04:41:47.136348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.136496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.136626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.136652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.136812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.136934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.136960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.137094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.137215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.137242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.137365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.137467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.137493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.137650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.137792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.137819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.137972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.138070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.138098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.138294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.138420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.138447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.138569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.138669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.138705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.138838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.138944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.138973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.139124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.139244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.139271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.139426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.139576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.139603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.139765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.139868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.139894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.140025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.140178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.140204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.140360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.140488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.140514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.140634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.140765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.140791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.140944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.141084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.141111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.141270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.141398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.141427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.141556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.141658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.141684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.141830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.141953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.141980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.142109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.142227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.142254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.142409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.142540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.142566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.142669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.142792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.142820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.142986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.143171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.143198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.143330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.143505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.143534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.143635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.143739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.143781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.143944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.144090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.144120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.179 [2024-11-26 04:41:47.144278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.144409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.179 [2024-11-26 04:41:47.144438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.179 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.144611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.144795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.144822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.144971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.145125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.145152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.145322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.145460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.145490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.145626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.145779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.145806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.145907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.146036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.146063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.146215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.146343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.146386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.146525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.146657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.146693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.146845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.146973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.146999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.147103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.147248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.147274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.147413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.147524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.147553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.147739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.147892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.147922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.148073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.148206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.148249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.148414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.148549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.148578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.148730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.148826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.148853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.148977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.149132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.149159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.149284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.149412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.149439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.149603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.149770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.149797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.149969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.150108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.150137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.150236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.150367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.150396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.150526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.150678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.150734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.150889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.151015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.151062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.151228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.151364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.151392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.151506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.151638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.151667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.151812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.151937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.151964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.152110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.152275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.152316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.152447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.152611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.152640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.152796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.152942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.152969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.180 [2024-11-26 04:41:47.153155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.153291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.180 [2024-11-26 04:41:47.153334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.180 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.153487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.153640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.153666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.153812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.153966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.153992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.154111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.154294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.154326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.154478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.154600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.154630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.154789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.154893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.154919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.155024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.155145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.155174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.155319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.155441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.155467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.155587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.155709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.155746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.155904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.156047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.156076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.156240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.156370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.156400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.156553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.156706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.156760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.156905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.157013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.157039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.157191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.157360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.157394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.157532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.157670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.157705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.157816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.157936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.157963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.158081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.158198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.158228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.158404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.158584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.158613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.158750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.158919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.158944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.159069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.159200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.159227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.159375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.159526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.159570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.159682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.159868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.159894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.160041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.160175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.181 [2024-11-26 04:41:47.160204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.181 qpair failed and we were unable to recover it. 00:30:08.181 [2024-11-26 04:41:47.160377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.160498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.160525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.160678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.160828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.160856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.161019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.161160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.161189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.161333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.161433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.161461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.161609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.161712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.161753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.161926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.162096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.162126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.162274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.162395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.162422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.162546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.162694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.162725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.162857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.163000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.163047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.163202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.163353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.163380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.163556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.163700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.163741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.163884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.164056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.164085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.164232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.164333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.164360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.164552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.164672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.164708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.164810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.164952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.164987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.165100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.165201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.165228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.165396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.165575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.165602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.165738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.165902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.165930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.166060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.166216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.166243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.166396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.166521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.166548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.166645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.166839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.166869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.166988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.167142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.167169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.167364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.167491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.167518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.167613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.167765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.167795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.167905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.168058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.168086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.168236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.168399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.168429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.168562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.168711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.168746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.168898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.168997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.169024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.182 qpair failed and we were unable to recover it. 00:30:08.182 [2024-11-26 04:41:47.169168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.182 [2024-11-26 04:41:47.169268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.169296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.169445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.169623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.169650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.169766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.169896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.169924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.170111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.170239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.170268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.170372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.170485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.170514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.170627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.170789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.170815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.170945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.171044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.171070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.171200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.171319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.171346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.171495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.171648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.171698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.171862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.171995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.172021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.172156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.172301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.172330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.172499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.172588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.172613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.172798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.172939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.172972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.173088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.173255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.173285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.173429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.173532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.173559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.173683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.173838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.173866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.173974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.174139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.174168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.174341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.174469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.174495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.174672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.174869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.174898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.175069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.175235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.175264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.175409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.175564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.175591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.175743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.175904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.175932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.176085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.176214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.176243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.176396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.176526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.176552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.176704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.176837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.176865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.177035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.177176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.177205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.177363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.177519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.177545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.183 [2024-11-26 04:41:47.177698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.177874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.183 [2024-11-26 04:41:47.177900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.183 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.178018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.178128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.178154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.178276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.178393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.178419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.178536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.178673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.178709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.178843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.178986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.179015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.179164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.179289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.179315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.179467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.179601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.179630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.179797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.179933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.179961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.180085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.180215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.180240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.180360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.180482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.180507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.180634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.180730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.180756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.180885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.181011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.181037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.181180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.181290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.181319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.181422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.181568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.181594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.181725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.181853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.181879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.182005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.182139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.182167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.182330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.182487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.182517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.182645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.182819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.182846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.182973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.183095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.183121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.183255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.183354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.183400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.183570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.183668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.183701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.183803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.183896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.183922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.184067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.184244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.184269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.184392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.184548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.184574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.184705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.184833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.184859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.185017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.185302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.185356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.185494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.185641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.185670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.185848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.185950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.185993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.186154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.186263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.186291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.184 qpair failed and we were unable to recover it. 00:30:08.184 [2024-11-26 04:41:47.186415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.184 [2024-11-26 04:41:47.186566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.186592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.186695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.186795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.186821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.186946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.187055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.187080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.187202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.187306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.187333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.187454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.187606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.187635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.187781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.187903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.187929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.188087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.188238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.188282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.188430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.188589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.188620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.188749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.188855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.188880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.189044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.189204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.189229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.189354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.189480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.189507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.189626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.189719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.189745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.189867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.189954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.189979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.190151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.190287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.190316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.190429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.190532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.190561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.190709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.190839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.190865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.191011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.191156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.191182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.191310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.191402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.191428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.191523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.191675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.191709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.191806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.191931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.191956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.192073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.192228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.192254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.192425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.192555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.192584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.192742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.192894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.192920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.193019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.193198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.193227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.193403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.193526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.193552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.193678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.193859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.193885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.194031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.194194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.194223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.185 qpair failed and we were unable to recover it. 00:30:08.185 [2024-11-26 04:41:47.194372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.185 [2024-11-26 04:41:47.194472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.194499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.194609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.194735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.194761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.194889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.195038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.195066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.195234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.195388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.195431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.195564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.195747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.195774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.195924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.196015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.196040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.196136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.196237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.196263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.196379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.196557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.196586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.196752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.196876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.196902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.197056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.197185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.197226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.197335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.197440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.197468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.197635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.197792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.197819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.197919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.198035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.198060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.198170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.198301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.198329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.198468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.198589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.198615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.198768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.198885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.198911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.199086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.199192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.199220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.199353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.199458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.199489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.199665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.199763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.199789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.199879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.200052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.200081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.200231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.200407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.200435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.200626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.200785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.200813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.200938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.201098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.201124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.201276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.201427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.201453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.186 qpair failed and we were unable to recover it. 00:30:08.186 [2024-11-26 04:41:47.201576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.186 [2024-11-26 04:41:47.201728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.201754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.201876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.202020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.202048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.202146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.202307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.202335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.202508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.202624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.202649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.202833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.202974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.203002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.203161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.203293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.203322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.203501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.203605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.203631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.203763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.203889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.203920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.204050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.204198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.204228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.204378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.204507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.204533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.204640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.204824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.204851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.204943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.205066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.205108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.205252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.205402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.205427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.205565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.205739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.205766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.205855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.206005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.206030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.206185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.206312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.206355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.206497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.206667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.206726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.206848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.206944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.206970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.207101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.207198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.207225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.207351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.207521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.207549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.207692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.207867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.207896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.208055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.208174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.208199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.208341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.208505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.208533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.208634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.208739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.208768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.208893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.208994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.209021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.209169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.209317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.209342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.209494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.209625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.209653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.209800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.209898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.209923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.187 qpair failed and we were unable to recover it. 00:30:08.187 [2024-11-26 04:41:47.210021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.187 [2024-11-26 04:41:47.210146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.210171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.210323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.210425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.210450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.210579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.210728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.210754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.210896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.211037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.211064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.211205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.211304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.211330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.211482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.211611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.211636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.211761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.211881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.211907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.212032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.212134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.212159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.212312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.212411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.212437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.212556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.212696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.212725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.212832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.213001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.213029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.213168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.213322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.213347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.213527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.213666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.213698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.213792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.213914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.213942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.214034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.214154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.214180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.214345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.214510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.214538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.214720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.214848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.214877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.215023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.215186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.215227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.215340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.215447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.215476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.215615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.215745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.215773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.215889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.216042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.216071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.216219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.216366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.216392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.216520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.216632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.216660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.216799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.216955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.216980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.217133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.217269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.217297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.217403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.217567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.217595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.217705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.217800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.217825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.217970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.218111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.218136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.188 qpair failed and we were unable to recover it. 00:30:08.188 [2024-11-26 04:41:47.218288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.188 [2024-11-26 04:41:47.218403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.218432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.218620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.218743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.218785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.218931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.219060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.219085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.219264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.219402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.219429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.219569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.219683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.219715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.219869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.220003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.220032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.220143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.220245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.220273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.220385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.220501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.220526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.220652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.220786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.220815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.220955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.221091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.221119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.221229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.221346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.221371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.221494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.221637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.221665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.221803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.221920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.221948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.222071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.222177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.222203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.222348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.222519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.222544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.222632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.222732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.222759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.222908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.222992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.223018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.223154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.223319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.223347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.223457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.223599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.223624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.223755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.223883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.223909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.224029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.224147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.224173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.224299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.224422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.224452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.224636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.224758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.224784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.224948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.225078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.225106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.225272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.225378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.225406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.225551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.225674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.225707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.225802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.225984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.226009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.226158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.226306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.226334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.226445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.226530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.226556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.189 qpair failed and we were unable to recover it. 00:30:08.189 [2024-11-26 04:41:47.226713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.189 [2024-11-26 04:41:47.226852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.226880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.227031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.227182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.227208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.227360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.227485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.227511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.227613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.227732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.227761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.227925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.228099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.228126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.228281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.228371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.228397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.228490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.228657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.228683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.228790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.228906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.228931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.229050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.229141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.229166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.229275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.229455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.229483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.229631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.229780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.229806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.229930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.230078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.230103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.230255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.230396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.230424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.230597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.230721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.230747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.230846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.230978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.231010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.231154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.231268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.231298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.231435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.231598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.231627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.231779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.231904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.231929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.232073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.232215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.232242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.232370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.232547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.232573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.232696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.232826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.232852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.232988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.233129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.233157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.233291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.233392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.233421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.233571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.233705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.233731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.190 qpair failed and we were unable to recover it. 00:30:08.190 [2024-11-26 04:41:47.233885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.234049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.190 [2024-11-26 04:41:47.234077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.234218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.234384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.234409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.234503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.234630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.234656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.234816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.234933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.234958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.235088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.235207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.235232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.235357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.235478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.235504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.235629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.235827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.235853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.236007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.236114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.236142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.236285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.236415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.236440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.236619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.236769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.236795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.236947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.237115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.237140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.237271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.237425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.237450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.237543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.237695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.237721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.237825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.237950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.237976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.238102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.238229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.238254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.238374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.238506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.238535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.238703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.238864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.238892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.239011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.239158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.239184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.239359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.239493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.239522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.239691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.239822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.239850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.239984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.240073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.240098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.240270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.240413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.240441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.240575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.240735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.240763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.240931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.241059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.241102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.241242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.241353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.241381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.241515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.241691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.241717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.241868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.241997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.242022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.242143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.242270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.191 [2024-11-26 04:41:47.242298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.191 qpair failed and we were unable to recover it. 00:30:08.191 [2024-11-26 04:41:47.242433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.242600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.242628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.242744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.242896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.242921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.243101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.243207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.243235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.243402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.243544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.243573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.243683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.243809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.243834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.243985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.244110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.244138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.244290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.244414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.244439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.244591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.244715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.244758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.244889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.245016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.245044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.245147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.245323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.245349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.245454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.245607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.245632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.245762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.245882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.245908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.246067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.246190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.246218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.246368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.246528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.246557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.246680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.246826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.246854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.246985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.247119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.247146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.247245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.247355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.247380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.247529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.247668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.247702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.247838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.247966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.247993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.248140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.248264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.248289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.248465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.248579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.248608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.248791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.248940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.248965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.249129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.249225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.249250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.249367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.249529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.249557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.249660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.249811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.249839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.249966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.250093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.250119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.250245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.250362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.250387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.250533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.250708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.250738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.192 [2024-11-26 04:41:47.250889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.251021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.192 [2024-11-26 04:41:47.251046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.192 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.251169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.251295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.251320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.251494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.251636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.251664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.251800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.251956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.251982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.252084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.252208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.252233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.252380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.252540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.252567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.252698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.252854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.252880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.253021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.253199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.253225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.253382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.253528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.253556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.253731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.253861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.253903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.254052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.254159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.254184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.254274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.254392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.254417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.254555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.254673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.254703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.254834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.254992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.255019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.255127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.255264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.255291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.255433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.255555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.255580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.255734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.255900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.255929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.256039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.256183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.256212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.256358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.256481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.256507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.256684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.256790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.256818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.256968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.257097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.257123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.257219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.257343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.257369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.257489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.257657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.257683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.257823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.257910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.257936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.258083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.258209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.258235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.258355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.258444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.258470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.258598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.258721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.258752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.258882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.259009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.259036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.193 [2024-11-26 04:41:47.259196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.259335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.193 [2024-11-26 04:41:47.259364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.193 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.259508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.259668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.259703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.259875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.259975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.260001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.260166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.260317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.260342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.260444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.260588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.260616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.260758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.260905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.260930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.261100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.261246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.261271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.261425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.261567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.261595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.261738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.261837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.261862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.261967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.262069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.262096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.262278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.262371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.262400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.262573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.262727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.262753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.262912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.263050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.263079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.263215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.263345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.263373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.263544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.263712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.263740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.263882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.264008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.264036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.264176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.264283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.264311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.264449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.264566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.264592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.264735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.264879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.264905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.265028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.265145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.265171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.265286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.265377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.265403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.265539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.265650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.265675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.265778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.265895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.265920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.266072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.266188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.266214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.266353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.266456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.266485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.266594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.266762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.266789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.266908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.267031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.267058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.267189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.267367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.267396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.267502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.267657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.194 [2024-11-26 04:41:47.267682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.194 qpair failed and we were unable to recover it. 00:30:08.194 [2024-11-26 04:41:47.267817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.267969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.268010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.268145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.268313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.268341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.268472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.268607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.268636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.268765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.268892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.268917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.269081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.269243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.269272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.269435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.269588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.269614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.269766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.269879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.269905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.270026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.270166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.270194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.270358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.270486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.270515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.270632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.270734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.270761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.270851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.270951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.270977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.271082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.271221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.271249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.271421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.271515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.271540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.271702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.271834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.271860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.271972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.272106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.272136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.272252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.272370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.272395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.272529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.272696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.272726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.272830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.272946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.272975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.273120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.273250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.273275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.273423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.273584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.273612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.273741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.273908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.273941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.274059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.274209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.274234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.274374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.274495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.274523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.195 [2024-11-26 04:41:47.274627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.274791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.195 [2024-11-26 04:41:47.274820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.195 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.274955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.275071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.275096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.275245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.275380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.275408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.275561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.275713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.275739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.275833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.275949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.275974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.276118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.276259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.276287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.276456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.276616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.276643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.276767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.276893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.276919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.277042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.277182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.277209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.277347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.277483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.277510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.277630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.277726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.277751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.277874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.278000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.278025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.278131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.278291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.278319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.278470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.278588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.278613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.278756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.278888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.278931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.279080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.279267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.279292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.279417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.279535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.279560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.279657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.279787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.279812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.279935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.280035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.280060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.280185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.280305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.280331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.280450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.280607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.280632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.280781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.280936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.280961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.281083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.281180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.281206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.281337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.281456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.281481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.281583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.281735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.281777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.281910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.282060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.282102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.282267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.282409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.282436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.282535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.282669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.282729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.196 [2024-11-26 04:41:47.282877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.283001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.196 [2024-11-26 04:41:47.283026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.196 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.283144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.283250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.283278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.283379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.283518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.283545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.283669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.283793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.283819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.283922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.284015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.284041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.284137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.284255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.284281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.284435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.284524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.284549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.284702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.284825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.284850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.285009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.285108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.285136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.285253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.285408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.285433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.285574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.285746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.285774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.285872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.286035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.286063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.286231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.286351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.286376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.286504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.286594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.286638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.286813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.286917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.286942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.287042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.287188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.287214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.287352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.287484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.287512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.287618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.287754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.287783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.287969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.288085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.288110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.288231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.288410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.288434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.288524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.288692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.288725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.288878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.289004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.289029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.289150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.289277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.289305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.289446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.289628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.289653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.289758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.289864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.289889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.289988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.290137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.290165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.290300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.290438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.290466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.290608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.290764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.290790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.290925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.291057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.197 [2024-11-26 04:41:47.291085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.197 qpair failed and we were unable to recover it. 00:30:08.197 [2024-11-26 04:41:47.291219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.291348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.291376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.291526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.291622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.291649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.291833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.291948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.291976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.292082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.292191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.292219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.292357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.292484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.292510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.292630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.292742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.292771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.292900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.293044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.293069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.293222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.293321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.293348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.293506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.293661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.293692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.293823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.293922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.293947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.294067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.294197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.294222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.294380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.294559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.294584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.294719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.294862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.294892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.295046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.295164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.295189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.295288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.295438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.295464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.295590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.295712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.295738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.295864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.295958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.295983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.296102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.296280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.296308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.296448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.296610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.296638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.296788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.296884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.296909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.297027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.297175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.297200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.297348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.297514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.297539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.297654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.297750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.297776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.297893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.297997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.298024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.298159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.298311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.298336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.298460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.298590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.298615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.298747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.298883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.298912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.299059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.299170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.299197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.198 [2024-11-26 04:41:47.299331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.299431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.198 [2024-11-26 04:41:47.299456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.198 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.299586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.299736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.299765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.299865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.300003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.300030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.300169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.300265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.300290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.300407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.300520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.300567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.300699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.300838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.300865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.301011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.301125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.301151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.301242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.301354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.301383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.301522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.301639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.301668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.301802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.301959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.301985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.302077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.302167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.302192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.302344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.302445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.302470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.302621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.302814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.302843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.303015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.303105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.303130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.303283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.303400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.303425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.303583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.303716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.303742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.303863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.303956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.303984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.304152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.304305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.304330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.304479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.304581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.304606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.304715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.304839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.304882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.305018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.305145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.305173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.305311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.305465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.305507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.305667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.305810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.305838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.305984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.306113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.306138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.306271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.306389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.306415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.306577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.306713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.306742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.306848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.306987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.307015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.307192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.307310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.307335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.307525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.307672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.199 [2024-11-26 04:41:47.307708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.199 qpair failed and we were unable to recover it. 00:30:08.199 [2024-11-26 04:41:47.307827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.307962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.307990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.308128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.308275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.308301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.308395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.308516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.308541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.308700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.308844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.308872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.309020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.309121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.309147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.309269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.309410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.309435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.309589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.309708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.309734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.309864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.309981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.310006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.310154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.310313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.310341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.310446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.310579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.310607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.310791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.310945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.310970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.311103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.311200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.311226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.311353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.311492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.311520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.311663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.311836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.311878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.312023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.312238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.312263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.312390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.312540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.312568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.312746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.312868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.312894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.313053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.313191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.313219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.313360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.313510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.313535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.313682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.313818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.313843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.313940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.314061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.314086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.314265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.314410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.314438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.314590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.314712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.314738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.200 qpair failed and we were unable to recover it. 00:30:08.200 [2024-11-26 04:41:47.314831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.314984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.200 [2024-11-26 04:41:47.315009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.315150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.315280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.315308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.315481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.315604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.315631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.315783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.315946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.315979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.316160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.316255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.316280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.316411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.316510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.316535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.316692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.316843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.316868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.316993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.317096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.317121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.317223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.317343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.317369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.317518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.317712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.317738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.317838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.317934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.317959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.318077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.318205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.318230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.318382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.318555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.318583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.318711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.318827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.318855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.318990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.319088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.319113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.319263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.319391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.319419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.319581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.319715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.319744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.319886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.319983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.320008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.320160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.320252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.320277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.320363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.320486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.320512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.320663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.320765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.320791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.320917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.321084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.321113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.321279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.321454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.321480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.321635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.321805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.321834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.321971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.322100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.322128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.322266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.322401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.322429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.322575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.322670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.322703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.322796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.322925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.322967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.323144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.323294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.201 [2024-11-26 04:41:47.323319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.201 qpair failed and we were unable to recover it. 00:30:08.201 [2024-11-26 04:41:47.323442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.323561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.323587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.323713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.323849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.323878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.323991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.324131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.324159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.324304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.324435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.324460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.324586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.324674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.324721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.324896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.325051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.325076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.325195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.325284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.325309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.325484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.325625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.325655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.325781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.325907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.325933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.326038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.326154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.326180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.326275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.326421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.326449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.326559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.326740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.326766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.326861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.326995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.327020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.327167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.327293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.327321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.327450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.327579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.327608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.327719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.327829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.327855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.327980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.328064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.328090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.328280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.328433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.328459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.328583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.328709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.328736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.328912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.329036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.329064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.329193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.329319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.329346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.329520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.329669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.329715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.329880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.329982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.330009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.330177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.330314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.330356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.330484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.330640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.330680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.330840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.330995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.331024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.331166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.331299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.331327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.202 qpair failed and we were unable to recover it. 00:30:08.202 [2024-11-26 04:41:47.331449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.202 [2024-11-26 04:41:47.331572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.331598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.331756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.331899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.331928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.332090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.332259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.332284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.332437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.332560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.332585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.332674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.332805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.332831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.332964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.333086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.333112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.333206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.333330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.333356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.333505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.333605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.333633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.333781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.333873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.333899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.334011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.334163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.334188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.334343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.334501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.334529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.334697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.334804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.334829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.334958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.335081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.335107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.335203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.335315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.335343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.335509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.335674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.335707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.335836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.335954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.335980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.336077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.336200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.336226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.336385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.336508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.336535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.336729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.336830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.336855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.336982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.337146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.337174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.337273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.337407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.337435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.337595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.337723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.337749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.337903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.338076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.338101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.338191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.338327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.338356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.338471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.338567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.338593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.338755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.338932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.338958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.339082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.339200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.339228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.203 qpair failed and we were unable to recover it. 00:30:08.203 [2024-11-26 04:41:47.339367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.339473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.203 [2024-11-26 04:41:47.339498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.339628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.339753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.339779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.339878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.340006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.340033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.340147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.340265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.340291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.340439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.340562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.340588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.340715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.340832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.340857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.340954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.341093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.341118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.341243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.341377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.341407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.341546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.341656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.341702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.341820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.341950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.341976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.342095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.342205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.342233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.342372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.342535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.342564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.342710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.342865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.342894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.343091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.343193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.343218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.343344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.343498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.343525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.343614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.343761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.343788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.343912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.344013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.344041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.344220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.344322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.344348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.344474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.344602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.344627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.344792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.344906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.344935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.345071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.345197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.345226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.345378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.345501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.345527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.345676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.345837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.345865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.345974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.346083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.346111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.346252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.346372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.346398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.346555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.346714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.346743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.346872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.347010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.347039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.347212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.347339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.204 [2024-11-26 04:41:47.347365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.204 qpair failed and we were unable to recover it. 00:30:08.204 [2024-11-26 04:41:47.347509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.347647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.347675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.347829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.347950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.347975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.348101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.348234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.348260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.348394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.348529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.348557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.348698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.348830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.348858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.348979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.349104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.349130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.349256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.349347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.349373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.349489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.349663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.349697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.349811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.349933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.349958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.350119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.350256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.350286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.350423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.350592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.350618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.350740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.350858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.350884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.350994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.351129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.351157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.351314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.351446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.351472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.351591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.351695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.351722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.351872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.351973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.351998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.352091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.352214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.352243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.352387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.352516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.352541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.352635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.352727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.352754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.352881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.352975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.353019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.353144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.353268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.353294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.353390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.353556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.353584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.353697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.353825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.353853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.353956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.354047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.354073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.205 qpair failed and we were unable to recover it. 00:30:08.205 [2024-11-26 04:41:47.354189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.205 [2024-11-26 04:41:47.354316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.354345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.354455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.354600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.354629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.354745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.354870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.354896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.355052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.355193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.355222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.355321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.355432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.355461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.355606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.355725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.355752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.355919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.356055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.356083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.356237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.356367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.356393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.356495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.356619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.356645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.356746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.356843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.356869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.356996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.357177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.357203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.357324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.357472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.357502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.357648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.357749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.357777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.357910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.358054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.358082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.358252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.358386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.358410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.358564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.359952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.359989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.360176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.360340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.360367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.360498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.360600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.360626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.360761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.360879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.360923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.361044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.361168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.361196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.361342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.361447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.361474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.361597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.361714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.361741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.361878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.361988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.362017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.362147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.362287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.362316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.362488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.362605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.362648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.362773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.362873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.362901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.363042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.363142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.363170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.363285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.363375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.363401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.206 qpair failed and we were unable to recover it. 00:30:08.206 [2024-11-26 04:41:47.363537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.363648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.206 [2024-11-26 04:41:47.363677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.363802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.363907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.363935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.364106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.364242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.364267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.364408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.364570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.364599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.364753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.364902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.364927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.365062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.365162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.365189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.365316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.365452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.365480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.365610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.365745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.365773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.365902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.366053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.366079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.366180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.366345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.366374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.366542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.366644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.366673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.366798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.366909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.366935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.367030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.367151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.367181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.367293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.367426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.367454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.367602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.367723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.367749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.367866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.367967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.367995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.368132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.368250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.368278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.368451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.368575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.368600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.368728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.368873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.368901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.369045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.369153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.369182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.369361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.369487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.369513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.369694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.369802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.369830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.369975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.370137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.370165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.370346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.370474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.370516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.370650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.370761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.370790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.370939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.371041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.371066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.371186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.371279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.371304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.371396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.371548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.371576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.371710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.371825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.371854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.207 qpair failed and we were unable to recover it. 00:30:08.207 [2024-11-26 04:41:47.371973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.207 [2024-11-26 04:41:47.372095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.372120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.372242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.372408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.372436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.372554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.372732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.372762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.372874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.372977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.373003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.373094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.373245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.373274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.373434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.373536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.373569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.373718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.373813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.373839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.373962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.374098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.374126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.374266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.374398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.374427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.374602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.374724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.374750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.374877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.375032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.375058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.375186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.375323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.375351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.375469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.375585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.375610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.375738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.375851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.375879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.376013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.376143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.376172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.376317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.376439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.376464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.376563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.376671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.376728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.376834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.376941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.376970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.377087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.377242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.377268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.377377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.377506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.377534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.377668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.377811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.377839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.377987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.378088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.378113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.378231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.378348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.378374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.378534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.378635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.378662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.378817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.378923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.378948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.379052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.379146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.379174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.379299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.379463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.379491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.379644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.379751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.379777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.379872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.379982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.208 [2024-11-26 04:41:47.380011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.208 qpair failed and we were unable to recover it. 00:30:08.208 [2024-11-26 04:41:47.380128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.380276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.380301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.209 qpair failed and we were unable to recover it. 00:30:08.209 [2024-11-26 04:41:47.380429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.380556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.380584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.209 qpair failed and we were unable to recover it. 00:30:08.209 [2024-11-26 04:41:47.380737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.380884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.380909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.209 qpair failed and we were unable to recover it. 00:30:08.209 [2024-11-26 04:41:47.381028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.381166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.381191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.209 qpair failed and we were unable to recover it. 00:30:08.209 [2024-11-26 04:41:47.381331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.381481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.381506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.209 qpair failed and we were unable to recover it. 00:30:08.209 [2024-11-26 04:41:47.381677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.381825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.381850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.209 qpair failed and we were unable to recover it. 00:30:08.209 [2024-11-26 04:41:47.381987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.382076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.209 [2024-11-26 04:41:47.382102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.209 qpair failed and we were unable to recover it. 00:30:08.209 [2024-11-26 04:41:47.382255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.486 [2024-11-26 04:41:47.382355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.486 [2024-11-26 04:41:47.382381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.486 qpair failed and we were unable to recover it. 00:30:08.486 [2024-11-26 04:41:47.382517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.486 [2024-11-26 04:41:47.382652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.486 [2024-11-26 04:41:47.382680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.486 qpair failed and we were unable to recover it. 00:30:08.486 [2024-11-26 04:41:47.382789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.486 [2024-11-26 04:41:47.382930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.486 [2024-11-26 04:41:47.382958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.486 qpair failed and we were unable to recover it. 00:30:08.486 [2024-11-26 04:41:47.383076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.486 [2024-11-26 04:41:47.383201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.486 [2024-11-26 04:41:47.383226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.486 qpair failed and we were unable to recover it. 00:30:08.486 [2024-11-26 04:41:47.383380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.486 [2024-11-26 04:41:47.383559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.486 [2024-11-26 04:41:47.383584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.486 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.383709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.383804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.383845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.383963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.384084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.384110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.384255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.384362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.384391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.384536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.384633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.384658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.384787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.384888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.384914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.385028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.385119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.385149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.385326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.385454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.385482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.385628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.385715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.385742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.385859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.386030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.386055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.386203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.386298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.386324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.386420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.386573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.386598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.386739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.386893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.386919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.387048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.387140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.387165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.387323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.387453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.387479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.387606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.387741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.387770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.387927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.388046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.388072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.388205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.388343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.388368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.388528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.388652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.388679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.388831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.388973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.389001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.389143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.389270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.389297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.389475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.389640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.389668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.389812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.389943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.389971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.390119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.390245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.390270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.390444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.390553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.390581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.390732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.390836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.390864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.391002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.391148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.391174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.391301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.391421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.391449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.391582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.391694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.391724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.391847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.391977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.392003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.392123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.392251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.392276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.392401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.392582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.392607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.392748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.392894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.392923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.393067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.393160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.393186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.393361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.393502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.393530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.393636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.393795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.393824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.393930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.394044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.394073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.394226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.394348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.394374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.394478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.394645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.394672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.487 qpair failed and we were unable to recover it. 00:30:08.487 [2024-11-26 04:41:47.394831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.487 [2024-11-26 04:41:47.394953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.394982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.395116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.395244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.395273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.395389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.395539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.395565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.395718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.395830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.395858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.395991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.396086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.396127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.396241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.396405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.396433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.396608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.396717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.396743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.396885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.396988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.397017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.397187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.397320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.397346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.397486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.397623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.397651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.397816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.397905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.397931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.398027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.398155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.398183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.398317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.398454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.398482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.398620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.398751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.398779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.398904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.399030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.399055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.399173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.399280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.399310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.399446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.399595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.399621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.399722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.399859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.399885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.400042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.400131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.400160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.400274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.400410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.400438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.400573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.400750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.400776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.400874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.400993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.401018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.401182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.401335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.401360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.401517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.401627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.401655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.401790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.401926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.401954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.402091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.402221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.402249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.402399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.402526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.402551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.402660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.402788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.402818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.402915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.403076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.403104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.403261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.403380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.403405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.403504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.403624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.403650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.403810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.403992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.404024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.404207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.404378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.404403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.404505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.404601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.404626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.404757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.404844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.404870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.404972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.405106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.405135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.405275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.405414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.405442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.405593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.405719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.405745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.488 qpair failed and we were unable to recover it. 00:30:08.488 [2024-11-26 04:41:47.405847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.488 [2024-11-26 04:41:47.405938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.405963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.406066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.406187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.406213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.406352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.406514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.406542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.406680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.406858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.406883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.407035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.407129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.407155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.407285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.407402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.407428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.407553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.407648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.407676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.407869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.408006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.408032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.408125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.408275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.408300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.408408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.408584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.408610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.408730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.408881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.408906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.409050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.409185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.409214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.409325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.409427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.409452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.409597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.409781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.409807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.409933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.410023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.410065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.410232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.410405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.410431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.410547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.410669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.410699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.410823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.410991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.411019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.411133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.411237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.411266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.411402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.411547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.411572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.411728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.411821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.411847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.411962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.412125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.412158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.412288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.412424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.412449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.412579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.412734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.412762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.412889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.412974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.413000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.413147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.413276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.413302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.413476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.413618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.413646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.413774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.413874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.413901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.414022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.414182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.414208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.414355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.414534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.414560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.414650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.414807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.414833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.414986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.415112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.415145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.415263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.415384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.415409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.415508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.415675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.415732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.415877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.416022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.416050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.416189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.416323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.489 [2024-11-26 04:41:47.416351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.489 qpair failed and we were unable to recover it. 00:30:08.489 [2024-11-26 04:41:47.416474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.416629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.416654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.416788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.416928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.416957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.417123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.417257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.417285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.417423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.417554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.417581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.417736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.417859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.417884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.418001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.418157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.418183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.418315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.418480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.418509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.418637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.418751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.418780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.418909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.419056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.419082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.419176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.419272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.419297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.419414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.419505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.419531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.419657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.419786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.419813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.419968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.420090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.420115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.420235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.420381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.420409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.420572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.420697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.420723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.420853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.420951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.420977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.421109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.421199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.421225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.421375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.421520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.421545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.421675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.421802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.421828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.421932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.422066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.422094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.422245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.422350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.422375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.422526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.422664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.422697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.422817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.422919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.422944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.423060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.423205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.423232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.423354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.423481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.490 [2024-11-26 04:41:47.423508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.490 qpair failed and we were unable to recover it. 00:30:08.490 [2024-11-26 04:41:47.423609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.423727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.423753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.423867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.424016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.424045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.424188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.424313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.424339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.424465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.424615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.424640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.424819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.424915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.424941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.425062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.425205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.425233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.425369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.425532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.425559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.425731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.425868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.425910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.426051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.426189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.426218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.426326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.426453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.426481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.426644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.426758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.426787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.426935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.427039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.427069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.427186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.427365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.427391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.427521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.427616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.427657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.427809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.427910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.427935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.428070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.428197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.428222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.428314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.428464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.428493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.428662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.428830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.428859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.428987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.429134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.429160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.429310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.429461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.429487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.429624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.429756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.429782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.429906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.430106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.430157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.430302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.430455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.430483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.430630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.430760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.430786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.430887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.431043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.431071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.431196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.431383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.431412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.431529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.431655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.431684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.431846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.431940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.431966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.432087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.432186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.432212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.432304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.432434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.432476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.432625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.432753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.432782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.432906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.433032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.433059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.433210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.433322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.433351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.491 qpair failed and we were unable to recover it. 00:30:08.491 [2024-11-26 04:41:47.433494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.491 [2024-11-26 04:41:47.433627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.433655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.433781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.433878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.433905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.434054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.434155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.434182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.434329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.434456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.434482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.434621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.434761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.434790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.434899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.435033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.435061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.435243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.435409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.435438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.435569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.435731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.435761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.435875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.435982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.436011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.436178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.436292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.436320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.436439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.436590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.436616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.436745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.436839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.436865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.437010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.437178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.437224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.437350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.437480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.437509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.437641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.437772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.437799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.437898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.438022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.438048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.438165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.438266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.438294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.438433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.438572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.438601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.438726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.438856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.438882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.438987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.439097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.439122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.439242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.439337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.439362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.439515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.439642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.439668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.439816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.439947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.439973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.440124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.440262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.440292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.440502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.440634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.440662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.440807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.440938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.440964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.441129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.441233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.441259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.441426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.441528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.441556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.441693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.441872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.441898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.442048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.442179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.442209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.442334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.442457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.442482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.442604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.442750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.442776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.442875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.443023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.443049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.443167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.443267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.443292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.492 qpair failed and we were unable to recover it. 00:30:08.492 [2024-11-26 04:41:47.443411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.443612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.492 [2024-11-26 04:41:47.443638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.443778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.443904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.443933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.444076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.444181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.444208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.444349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.444515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.444543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.444696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.444815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.444841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.444979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.445108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.445136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.445280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.445413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.445443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.445584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.445695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.445725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.445830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.445977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.446002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.446108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.446206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.446231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.446337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.446459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.446486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.446652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.446788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.446817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.446961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.447084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.447109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.447262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.447359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.447386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.447538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.447679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.447732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.447888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.448038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.448064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.448167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.448265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.448290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.448416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.448520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.448545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.448700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.448836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.448864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.449027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.449168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.449196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.449335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.449470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.449496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.449643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.449820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.449849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.449949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.450050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.450079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.450258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.450378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.450404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.450495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.450649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.450675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.450836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.450944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.450972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.451145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.451309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.451338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.451490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.451651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.451679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.451854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.451972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.451997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.452113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.452256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.452285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.452404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.452570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.452596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.452716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.452861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.452890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.453042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.453167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.453192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.493 qpair failed and we were unable to recover it. 00:30:08.493 [2024-11-26 04:41:47.453333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.453474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.493 [2024-11-26 04:41:47.453502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.453647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.453761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.453791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.453924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.454135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.454163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.454302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.454426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.454455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.454566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.454703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.454731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.454836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.454973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.455001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.455133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.455240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.455268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.455420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.455540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.455565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.455679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.455805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.455834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.455946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.456081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.456110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.456275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.456413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.456442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.456587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.456716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.456743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.456869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.456995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.457024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.457163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.457329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.457361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.457500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.457610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.457639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.457770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.457890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.457916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.458062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.458168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.458196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.458366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.458525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.458551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.458703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.458845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.458873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.459023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.459173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.459199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.459388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.459589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.459614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.459748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.459889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.459917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.460057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.460194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.460222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.460393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.460516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.460541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.460702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.460817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.460845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.460975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.461132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.461160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.494 qpair failed and we were unable to recover it. 00:30:08.494 [2024-11-26 04:41:47.461300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.461435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.494 [2024-11-26 04:41:47.461465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.461638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.461760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.461787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.461930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.462034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.462063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.462193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.462330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.462359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.462495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.462614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.462639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.462764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.462895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.462920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.463021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.463145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.463171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.463323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.463456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.463481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.463579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.463714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.463743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.463871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.463967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.463993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.464162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.464295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.464324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.464488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.464617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.464645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.464781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.464908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.464934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.465031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.465168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.465194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.465315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.465475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.465500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.465660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.465777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.465806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.465951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.466088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.466114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.466248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.466374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.466400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.466573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.466676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.466713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.466849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.466961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.466990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.467143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.467276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.467302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.467425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.467547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.467572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.467699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.467851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.467877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.468011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.468154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.468182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.468314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.468476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.468505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.468643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.468776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.468803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.468939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.469067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.469096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.469212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.469317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.469346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.469509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.469672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.469713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.469829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.469990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.470016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.470216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.470341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.470368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.470524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.470659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.470695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.470840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.470950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.470979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.471127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.471255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.471279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.471431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.471540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.471568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.471721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.471893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.471919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-11-26 04:41:47.472048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.495 [2024-11-26 04:41:47.472172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.472198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.472322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.472446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.472471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.472614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.472712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.472741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.472881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.472985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.473014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.473174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.473305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.473333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.473481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.473579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.473604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.473757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.473873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.473901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.474064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.474176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.474205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.474335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.474494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.474522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.474670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.474849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.474879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.475022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.475125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.475155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.475281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.475444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.475469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.475573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.475702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.475747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.475872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.476023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.476049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.476170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.476334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.476362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.476501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.476641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.476670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.476813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.476929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.476957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.477096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.477219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.477244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.477385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.477520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.477549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.477677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.477793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.477821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.477920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.478083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.478112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.478235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.478355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.478381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.478515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.478668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.478699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.478810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.478928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.478953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.479108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.479221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.479250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.479424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.479550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.479576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.479731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.479889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.479916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.480115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.480377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.480424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.480553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.480694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.480722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.480880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.481004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.481029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.481147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.481290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.481318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.481483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.481610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.481636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.481745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.481909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.481938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.482060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.482155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.482182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.482332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.482435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.482461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-11-26 04:41:47.482610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.482727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.496 [2024-11-26 04:41:47.482756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.482891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.482995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.483023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.483164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.483315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.483340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.483466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.483582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.483608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.483713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.483809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.483835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.483922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.484049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.484074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.484195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.484316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.484342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.484479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.484599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.484625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.484769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.484892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.484922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.485089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.485253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.485286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.485450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.485541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.485566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.485709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.485838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.485866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.486042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.486137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.486162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.486333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.486438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.486467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.486606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.486712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.486738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.486866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.486987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.487016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.487159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.487299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.487326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.487419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.487563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.487592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.487736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.487886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.487912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.488077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.488208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.488233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.488324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.488443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.488468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.488590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.488695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.488721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.488853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.488946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.488971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.489107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.489251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.489279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.489423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.489565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.489590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.489716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.489842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.489867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.489985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.490139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.490164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.490313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.490451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.490481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.490655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.490810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.490836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.490995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.491138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.491166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.491339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.491465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.491490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.491670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.491799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.491829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.492008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.492158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.492183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.492336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.492451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.492479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.492591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.492710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.492737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.492839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.492938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.492966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.493109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.493250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.497 [2024-11-26 04:41:47.493276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.497 qpair failed and we were unable to recover it. 00:30:08.497 [2024-11-26 04:41:47.493372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.493487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.493530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.493657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.493785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.493811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.493976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.494118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.494147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.494279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.494423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.494451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.494581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.494700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.494733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.494857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.494983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.495009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.495130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.495268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.495296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.495476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.495576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.495601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.495724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.495821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.495847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.496012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.496110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.496135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.496254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.496391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.496419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.496552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.496705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.496732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.496829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.496981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.497011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.497170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.497298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.497338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.497484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.497608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.497634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.497731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.497828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.497853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.497961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.498079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.498108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.498255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.498346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.498372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.498504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.498652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.498678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.498818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.498929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.498957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.499073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.499217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.499243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.499344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.499443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.499469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.499585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.499707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.499742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.499849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.500025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.500051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.500149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.500276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.500301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.500455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.500545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.500570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.500661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.500851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.500877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.500964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.501150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.501196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.501303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.501406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.501435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.501582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.501734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.501761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.501888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.502032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.502060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.502240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.502333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.502358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.498 qpair failed and we were unable to recover it. 00:30:08.498 [2024-11-26 04:41:47.502476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.502629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.498 [2024-11-26 04:41:47.502655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.502759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.502861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.502887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.502978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.503079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.503107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.503248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.503378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.503420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.503551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.503700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.503730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.503877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.504030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.504056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.504170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.504300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.504328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.504459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.504616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.504641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.504749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.504866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.504892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.504989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.505140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.505165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.505305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.505413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.505441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.505552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.505683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.505718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.505838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.505970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.506000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.506152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.506279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.506304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.506444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.506576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.506604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.506738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.506857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.506883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.507036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.507176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.507204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.507323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.507446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.507472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.507611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.507775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.507804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.507935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.508050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.508078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.508208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.508345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.508374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.508529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.508627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.508653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.508796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.508905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.508933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.509066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.509203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.509232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.509393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.509524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.509552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.509696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.509824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.509849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.510010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.510107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.510132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.510261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.510384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.510410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.510580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.510721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.510750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.510898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.511019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.511044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.511189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.511310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.511335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.511425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.511588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.511620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.511751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.511887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.511915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.512068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.512219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.512244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.512371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.512497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.512523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.512622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.512748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.512774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.499 qpair failed and we were unable to recover it. 00:30:08.499 [2024-11-26 04:41:47.512881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.499 [2024-11-26 04:41:47.513000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.513025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.513125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.513217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.513242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.513364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.513461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.513490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.513629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.513797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.513826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.513964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.514105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.514134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.514254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.514390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.514416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.514562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.514703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.514732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.514847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.514988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.515014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.515109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.515207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.515234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.515386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.515514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.515541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.515718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.515852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.515877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.515998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.516116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.516142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.516293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.516454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.516482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.516622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.516720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.516747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.516901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.517034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.517064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.517200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.517324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.517354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.517489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.517582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.517610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.517797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.517928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.517954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.518104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.518254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.518279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.518415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.518518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.518546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.518691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.518825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.518853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.518968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.519114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.519140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.519288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.519445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.519473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.519683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.519833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.519862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.519994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.520157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.520185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.520308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.520404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.520430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.520574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.520734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.520763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.520868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.521031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.521059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.521211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.521304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.521330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.521479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.521575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.521601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.521782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.521893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.521921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.522050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.522184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.522212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.522374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.522512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.522540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.500 [2024-11-26 04:41:47.522659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.522784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.500 [2024-11-26 04:41:47.522809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.500 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.522983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.523122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.523150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.523298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.523425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.523451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.523624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.523769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.523798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.523973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.524090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.524116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.524236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.524374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.524402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.524540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.524640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.524668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.524806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.524952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.524980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.525124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.525249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.525274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.525497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.525633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.525661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.525814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x749e00 is same with the state(5) to be set 00:30:08.501 [2024-11-26 04:41:47.526006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.526128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.526160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.526321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.526442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.526468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.526619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.526741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.526772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.526956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.527107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.527133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.527255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.527383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.527408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.527515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.527660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.527690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.527820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.527974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.527999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.528096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.528213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.528239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.528363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.528498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.528524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.528702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.528873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.528916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.529044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.529170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.529196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.529351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.529474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.529500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.529645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.529796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.529825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.529947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.530072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.530098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.530247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.530400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.530441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.530573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.530742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.530769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.530865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.530985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.501 [2024-11-26 04:41:47.531011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.501 qpair failed and we were unable to recover it. 00:30:08.501 [2024-11-26 04:41:47.531152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.531298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.531326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.531466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.531611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.531639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.531784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.531881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.531907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.532008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.532106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.532132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.532260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.532404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.532433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.532573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.532696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.532723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.532849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.532952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.532985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.533148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.533285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.533313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.533482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.533579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.533605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.533758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.533858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.533886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.534021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.534153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.534181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.534334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.534457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.534483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.534629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.534762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.534791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.534946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.535067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.535093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.535243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.535392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.535436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.535565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.535705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.535734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.535872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.536007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.536036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.536159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.536310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.536335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.536482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.536650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.536676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.536816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.536936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.536961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.537093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.537215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.537241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.537400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.537542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.537570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.537692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.537828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.537858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.538003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.538097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.538123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.538265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.538407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.538435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.538571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.538679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.538726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.538857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.539010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.539035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.539182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.539393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.539421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.539585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.539720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.539750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.539895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.539994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.502 [2024-11-26 04:41:47.540020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.502 qpair failed and we were unable to recover it. 00:30:08.502 [2024-11-26 04:41:47.540148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.540238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.540280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.540422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.540591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.540617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.540772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.540905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.540931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.541046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.541179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.541207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.541310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.541446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.541475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.541622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.541754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.541781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.541912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.542037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.542065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.542164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.542306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.542336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.542489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.542605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.542630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.542737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.542854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.542881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.543089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.543217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.543245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.543364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.543465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.543493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.543600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.543724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.543751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.543878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.544034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.544060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.544225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.544355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.544381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.544533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.544664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.544696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.544836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.544941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.544970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.545145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.545245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.545275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.545407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.545538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.545564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.545664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.545808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.545837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.545980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.546084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.546109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.546214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.546333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.546359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.546464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.546605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.546648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.546757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.546880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.546906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.547052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.547190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.547220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.547350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.547498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.547526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.547657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.547795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.547821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.548000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.548116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.548148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.548279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.548435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.548460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.548581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.548699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.548726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.548867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.548995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.549023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.549158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.549295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.549324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.549498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.549621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.549646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.503 qpair failed and we were unable to recover it. 00:30:08.503 [2024-11-26 04:41:47.549810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.503 [2024-11-26 04:41:47.549979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.550006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.550113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.550250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.550278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.550419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.550548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.550574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.550716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.550820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.550849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.550977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.551109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.551137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.551260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.551385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.551410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.551543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.551677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.551712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.551854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.551990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.552018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.552157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.554826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.554855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.554973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.555072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.555100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.555225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.555379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.555405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.555531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.555618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.555644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.555812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.555928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.555956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.556105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.556206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.556232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.556348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.556476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.556503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.556681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.556855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.556883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.557048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.557212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.557240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.557378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.557530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.557555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.557710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.557874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.557903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.558068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.558211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.558239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.558410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.558537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.558563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.558716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.558849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.558877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.559013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.559154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.559182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.559289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.559395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.559422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.559530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.559648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.559673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.559857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.559989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.560018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.560161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.560252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.560277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.560405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.560501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.560527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.560642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.560749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.560775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.560894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.561115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.561143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.561243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.561391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.561418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.561575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.561701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.561727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.561880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.562089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.562136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.562355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.562526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.504 [2024-11-26 04:41:47.562554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.504 qpair failed and we were unable to recover it. 00:30:08.504 [2024-11-26 04:41:47.562661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.562796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.562822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.562912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.563043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.563073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.563220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.563381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.563409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.563542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.563676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.563711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.563830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.563927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.563952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.564129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.564301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.564330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.564433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.564545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.564570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.564721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.564838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.564880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.565028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.565134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.565175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.565298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.565412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.565440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.565599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.565730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.565757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.565963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.566126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.566182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.566318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.566443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.566471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.566618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.566739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.566765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.566885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.567002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.567031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.567135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.567308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.567334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.567459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.567560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.567586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.567714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.567856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.567885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.567991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.568125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.568154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.568300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.568406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.568432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.568588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.568694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.568720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.568840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.568957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.568985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.569126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.569245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.569271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.569390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.569551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.569580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.569720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.569829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.569858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.569980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.570106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.570132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.570217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.570343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.570369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.570496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.570640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.570668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.570823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.570925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.570951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.571114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.571274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.571302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.571467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.571607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.571636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.571792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.571891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.571917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.572063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.572169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.572197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.505 qpair failed and we were unable to recover it. 00:30:08.505 [2024-11-26 04:41:47.572341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.572474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.505 [2024-11-26 04:41:47.572502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.572642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.572746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.572772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.572915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.573018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.573046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.573188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.573285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.573314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.573490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.573642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.573667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.573856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.573990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.574018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.574160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.574267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.574295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.574437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.574559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.574587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.574781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.574910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.574936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.575035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.575161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.575186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.575315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.575453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.575478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.575633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.575809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.575835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.575925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.576050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.576077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.576203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.576293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.576321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.576442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.576569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.576595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.576697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.576811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.576839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.577015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.577140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.577166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.577319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.577459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.577487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.577624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.577755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.577784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.577941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.578103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.578132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.578252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.578414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.578443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.578574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.578720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.578749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.578921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.579037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.579063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.579214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.579346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.579375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.579473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.579599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.579627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.579738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.579842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.579869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.580018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.580135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.580160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.580253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.580422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.580450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.580595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.580710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.580737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.580910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.581044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.581072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.506 [2024-11-26 04:41:47.581222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.581359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.506 [2024-11-26 04:41:47.581387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.506 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.581510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.581635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.581663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.581787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.581922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.581952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.582103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.582265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.582290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.582441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.582570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.582610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.582778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.582907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.582935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.583034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.583211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.583237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.583387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.583539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.583582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.583719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.583836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.583864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.584007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.584141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.584169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.584302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.584391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.584417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.584564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.584729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.584759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.584893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.584996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.585026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.585173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.585304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.585330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.585486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.585603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.585631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.585789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.585907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.585935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.586040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.586191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.586218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.586337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.586476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.586504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.586614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.586779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.586808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.586955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.587108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.587133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.587348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.587455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.587481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.587623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.587795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.587821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.587975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.588106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.588147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.588280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.588423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.588451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.588586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.588714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.588743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.588863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.588990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.589015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.589154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.589281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.589310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.589445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.589556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.589584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.589727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.589823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.589849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.589997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.590165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.590193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.590336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.590486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.590518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.590669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.590772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.590798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.590921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.591024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.591052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.591180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.591311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.591339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.507 qpair failed and we were unable to recover it. 00:30:08.507 [2024-11-26 04:41:47.591511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.507 [2024-11-26 04:41:47.591605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.591630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.591768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.591886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.591911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.592028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.592150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.592175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.592328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.592449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.592474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.592621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.592755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.592783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.592940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.593087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.593113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.593260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.593381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.593411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.593528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.593666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.593701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.593808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.593975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.594000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.594127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.594247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.594272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.594397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.594566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.594594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.594714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.594857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.594884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.595011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.595136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.595162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.595285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.595453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.595479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.595633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.595748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.595775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.595884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.595976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.596003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.596135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.596306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.596332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.596451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.596579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.596605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.596707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.596839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.596864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.597014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.597177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.597206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.597309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.597440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.597468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.597596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.597716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.597742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.597863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.597954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.597979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.598107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.598273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.598301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.598446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.598547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.598573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.598701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.598801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.598827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.598957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.599059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.599101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.599216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.599343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.599369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.599481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.599633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.599661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.599846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.599971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.600014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.600141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.600266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.600292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.600444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.600594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.600623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.600803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.600907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.600932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.508 [2024-11-26 04:41:47.601034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.601183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.508 [2024-11-26 04:41:47.601209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.508 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.601368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.601491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.601517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.601608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.601788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.601817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.601954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.602050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.602075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.602221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.602320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.602348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.602516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.602649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.602678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.602830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.602953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.602978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.603101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.603263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.603292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.603426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.603591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.603619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.603791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.603881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.603907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.604046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.604181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.604211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.604351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.604494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.604522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.604643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.604744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.604771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.604924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.605088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.605116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.605246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.605430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.605460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.605584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.605714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.605741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.605883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.605991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.606020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.606124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.606309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.606335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.606493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.606630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.606656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.606786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.606932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.606960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.607097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.607242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.607270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.607441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.607558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.607583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.607724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.607832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.607860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.607997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.608149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.608175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.608325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.608440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.608465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.608610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.608706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.608734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.608881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.609061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.609133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.609309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.609454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.609496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.609632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.609768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.609797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.609933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.610067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.610095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.610238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.610337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.610362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.610456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.610595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.610623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.610757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.610924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.610952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.611129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.611280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.611325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.509 qpair failed and we were unable to recover it. 00:30:08.509 [2024-11-26 04:41:47.611462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.509 [2024-11-26 04:41:47.611642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.611667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.611809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.611952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.611982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.612130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.612278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.612304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.612433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.612600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.612628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.612767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.612934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.612962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.613103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.613225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.613251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.613407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.613557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.613582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.613757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.613855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.613883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.614022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.614149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.614174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.614280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.614411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.614439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.614582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.614702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.614729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.614826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.614947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.614972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.615121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.615284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.615312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.615494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.615621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.615648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.615785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.615919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.615946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.616044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.616213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.616242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.616388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.616524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.616552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.616698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.616847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.616872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.617028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.617156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.617184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.617359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.617504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.617529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.617651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.617783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.617810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.617923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.618062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.618091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.618229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.618366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.618394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.618543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.618667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.618716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.618843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.618947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.618977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.619113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.619282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.619310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.619445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.619572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.619598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.619761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.619889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.619915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.510 qpair failed and we were unable to recover it. 00:30:08.510 [2024-11-26 04:41:47.620068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.620210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.510 [2024-11-26 04:41:47.620238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.620407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.620537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.620563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.620677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.620847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.620876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.621014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.621142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.621189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.621344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.621463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.621488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.621669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.621805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.621833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.621940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.622078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.622107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.622220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.622316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.622342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.622512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.622637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.622665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.622803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.622939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.622969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.623092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.623239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.623264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.623395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.623509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.623537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.623701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.623850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.623878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.624020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.624141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.624166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.624344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.624469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.624498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.624632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.624763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.624793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.624940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.625059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.625085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.625235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.625371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.625399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.625515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.625678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.625713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.625831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.625938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.625964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.626084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.626208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.626233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.626328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.626488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.626513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.626641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.626768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.626795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.626946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.627087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.627113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.627239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.627366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.627392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.627509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.627625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.627651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.627832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.627988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.628014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.628140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.628235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.628278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.628387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.628517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.628542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.628662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.628820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.628864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.629006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.629138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.629167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.511 qpair failed and we were unable to recover it. 00:30:08.511 [2024-11-26 04:41:47.629373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.511 [2024-11-26 04:41:47.629540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.629568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.629699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.629802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.629831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.630039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.630175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.630205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.630350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.630508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.630534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.630703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.630855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.630881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.631017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.631168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.631194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.631318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.631420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.631445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.631547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.631663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.631730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.631901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.632105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.632131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.632235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.632355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.632381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.632536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.632641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.632669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.632813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.632948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.632976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.633125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.633248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.633274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.633392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.633602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.633636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.633809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.633926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.633954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.634096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.634190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.634216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.634325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.634500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.634527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.634654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.634788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.634814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.634944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.635094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.635135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.635264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.635400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.635429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.635555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.635657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.635692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.635840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.635959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.635985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.636176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.636303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.636328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.636517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.636612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.636646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.512 [2024-11-26 04:41:47.636781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.636932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.512 [2024-11-26 04:41:47.636957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.512 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.637140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.637230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.637256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.637407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.637525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.637550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.637683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.637839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.637881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.638023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.638165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.638193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.638330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.638479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.638505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.638642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.638773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.638815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.638947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.639082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.639110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.639220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.639312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.639339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.639484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.639611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.639637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.639800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.639930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.639958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.640071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.640230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.640259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.640380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.640509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.640535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.640697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.640848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.640877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.641017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.641222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.641247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.641369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.641494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.641520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.641671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.641790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.641819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.641947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.642083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.642111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.642265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.642365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.642392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.642519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.642696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.642725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.642866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.643031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.643059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.643195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.643318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.643345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.513 [2024-11-26 04:41:47.643443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.643645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.513 [2024-11-26 04:41:47.643673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.513 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.643845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.643982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.644010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.644151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.644246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.644272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.644398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.644545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.644573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.644674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.644792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.644820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.644992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.645143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.645185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.645288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.645454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.645482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.645620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.645727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.645770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.645922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.646024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.646050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.646172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.646301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.646329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.646473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.646621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.646646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.646816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.646985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.647014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.647187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.647378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.647403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.647504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.647627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.647653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.647758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.647875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.647901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.648011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.648159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.648184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.648317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.648413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.648456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.648623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.648718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.648744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.648886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.649015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.649048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.649182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.649309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.649338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.649474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.649598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.649624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.514 [2024-11-26 04:41:47.649766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.649911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.514 [2024-11-26 04:41:47.649939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.514 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.650071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.650199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.650227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.650400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.650487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.650513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.650670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.650803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.650829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.650961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.651066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.651094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.651229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.651352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.651379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.651515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.651613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.651641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.651789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.651886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.651912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.652064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.652156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.652184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.652341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.652489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.652515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.652665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.652782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.652810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.652924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.653051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.653076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.653198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.653339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.653369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.653500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.653634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.653662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.653828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.653979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.654020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.654148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.654285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.654313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.654450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.654578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.654607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.654737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.654869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.654895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.655032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.655138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.655166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.515 qpair failed and we were unable to recover it. 00:30:08.515 [2024-11-26 04:41:47.655309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.655410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.515 [2024-11-26 04:41:47.655438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.655642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.655832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.655862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.655970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.656107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.656135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.656265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.656400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.656428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.656596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.656730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.656756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.656900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.657044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.657072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.657213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.657350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.657378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.657526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.657657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.657682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.657843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.658046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.658074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.658245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.658452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.658480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.658632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.658750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.658777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.658897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.659050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.659076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.659196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.659371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.659396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.659488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.659692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.659735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.659880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.660006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.660031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.660199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.660299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.660328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.660456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.660548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.660573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.660724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.660924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.660949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.661076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.661214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.661244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.661390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.661521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.661547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.661653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.661769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.661799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.661943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.662085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.662113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.516 qpair failed and we were unable to recover it. 00:30:08.516 [2024-11-26 04:41:47.662258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.662381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.516 [2024-11-26 04:41:47.662406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.662556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.662713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.662740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.662882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.662982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.663010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.663149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.663273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.663299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.663517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.663642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.663667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.663798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.663964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.663993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.664141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.664258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.664284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.664378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.664526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.664556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.664702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.664842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.664870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.665004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.665123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.665149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.665300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.665411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.665441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.665606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.665772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.665801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.665935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.666087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.666127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.666267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.666398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.666426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.666591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.666697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.666726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.666871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.666992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.667018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.667137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.667315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.667341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.667434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.667566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.667594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.667713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.667814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.667841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.667945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.668135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.668161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.668260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.668439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.668468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.517 qpair failed and we were unable to recover it. 00:30:08.517 [2024-11-26 04:41:47.668614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.668736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.517 [2024-11-26 04:41:47.668762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.668872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.669005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.669030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.669193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.669305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.669333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.669483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.669635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.669661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.669782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.669991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.670020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.670156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.670315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.670343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.670470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.670568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.670594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.670707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.670820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.670846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.671016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.671154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.671182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.671333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.671425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.671450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.671578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.671717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.671745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.671875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.672044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.672073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.672195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.672310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.672336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.672426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.672598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.672626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.672761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.672904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.672930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.673084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.673241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.673267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.673359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.673489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.673515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.673682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.673853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.673881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.674033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.674181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.674206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.674331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.674429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.674456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.674597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.674738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.674768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.674911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.675043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.675069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.518 [2024-11-26 04:41:47.675196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.675292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.518 [2024-11-26 04:41:47.675334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.518 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.675488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.675638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.675663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.675755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.675855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.675881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.676031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.676175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.676203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.676343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.676489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.676515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.676666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.676773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.676803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.676948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.677059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.677087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.677260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.677361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.677389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.677529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.677644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.677670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.677790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.677921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.677950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.678092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.678211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.678237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.678357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.678506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.678531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.678680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.678816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.678845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.678982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.679111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.679139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.679286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.679402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.679427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.679568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.679666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.679706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.679873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.679986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.680015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.680136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.680237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.680262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.680431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.680542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.680571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.680750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.680876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.680901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.681022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.681141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.681167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.681258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.681383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.681408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.519 qpair failed and we were unable to recover it. 00:30:08.519 [2024-11-26 04:41:47.681545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.681650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.519 [2024-11-26 04:41:47.681678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.681892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.682046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.682071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.682197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.682297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.682323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.682455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.682591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.682619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.682766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.682890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.682915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.683055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.683218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.683246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.683386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.683516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.683544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.683694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.683787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.683812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.683922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.684049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.684077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.684177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.684317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.684346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.684487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.684610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.684636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.684767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.684908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.684936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.685072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.685208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.685237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.685384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.685510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.685535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.685668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.685848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.685877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.686004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.686138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.686178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.686304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.686520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.686548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.686676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.686783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.686811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.686918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.687060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.687086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.687208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.687336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.687361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.687565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.687743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.687769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.520 [2024-11-26 04:41:47.687918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.688054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.520 [2024-11-26 04:41:47.688082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.520 qpair failed and we were unable to recover it. 00:30:08.521 [2024-11-26 04:41:47.688253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.521 [2024-11-26 04:41:47.688376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.521 [2024-11-26 04:41:47.688402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.521 qpair failed and we were unable to recover it. 00:30:08.521 [2024-11-26 04:41:47.688574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.521 [2024-11-26 04:41:47.688705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.521 [2024-11-26 04:41:47.688734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.521 qpair failed and we were unable to recover it. 00:30:08.521 [2024-11-26 04:41:47.688866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.521 [2024-11-26 04:41:47.688971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.521 [2024-11-26 04:41:47.689001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.521 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.689135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.689285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.689310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.689457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.689589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.689618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.689752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.689891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.689919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.690032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.690138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.690164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.690267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.690393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.690436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.690597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.690715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.690744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.690889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.691014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.691040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.691152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.691315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.691344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.691471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.691604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.691633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.691808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.691914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.691944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.692076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.692236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.692264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.692387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.692536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.692562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.692710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.692804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.692829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.692991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.693141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.693167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.693288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.693432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.693458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.693555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.693756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.693782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.845 qpair failed and we were unable to recover it. 00:30:08.845 [2024-11-26 04:41:47.693923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.845 [2024-11-26 04:41:47.694083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.694111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.694221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.694338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.694364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.694472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.694598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.694623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.694737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.694848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.694876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.695005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.695173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.695202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.695338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.695486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.695511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.695627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.695744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.695773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.695917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.696024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.696053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.696223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.696346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.696371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.696594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.696755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.696784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.696914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.697051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.697079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.697193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.697293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.697320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.697437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.697573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.697601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.697731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.697833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.697862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.697992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.698118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.698144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.698234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.698334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.698360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.698457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.698598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.698626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.698765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.698862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.698887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.699028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.699162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.699190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.699295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.699439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.699467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.699611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.699730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.699756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.699905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.700007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.700035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.700177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.700306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.700334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.700453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.700581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.700607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.700738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.700870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.700899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.701045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.701169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.701196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.701313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.701405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.701431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.701567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.701673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.701709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.846 qpair failed and we were unable to recover it. 00:30:08.846 [2024-11-26 04:41:47.701857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.846 [2024-11-26 04:41:47.701958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.701984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.702112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.702240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.702266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.702391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.702522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.702549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.702709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.702843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.702871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.702998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.703094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.703119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.703304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.703450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.703476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.703611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.703750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.703779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.703891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.704012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.704038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.704178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.704289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.704318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.704456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.704600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.704629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.704740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.704859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.704885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.704986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.705086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.705113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.705235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.705371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.705398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.705523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.705615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.705640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.705780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.705910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.705938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.706101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.706241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.706270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.706411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.706533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.706564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.706736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.706913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.706939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.707034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.707172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.707200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.707345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.707444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.707469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.707605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.707704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.707733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.707874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.708004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.708032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.708174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.708296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.708321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.708441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.708570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.708614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.708732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.708874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.708902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.709040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.709165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.709192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.709340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.709468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.709496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.847 qpair failed and we were unable to recover it. 00:30:08.847 [2024-11-26 04:41:47.709635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.847 [2024-11-26 04:41:47.709773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.709803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.709927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.710050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.710076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.710231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.710352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.710378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.710582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.710758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.710784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.710939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.711060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.711101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.711238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.711383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.711407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.711528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.711619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.711644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.711805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.711931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.711958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.712103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.712243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.712272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.712374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.712473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.712501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.712714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.712835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.712860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.712956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.713048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.713074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.713226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.713332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.713360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.713533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.713648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.713673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.713832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.713936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.713964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.714137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.714260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.714285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.714485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.714646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.714674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.714835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.714996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.715024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.715155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.715292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.715321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.715473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.715622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.715648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.715829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.715947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.715975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.716139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.716280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.716306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.716458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.716575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.716601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.716762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.716943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.716968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.848 [2024-11-26 04:41:47.717122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.717264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.848 [2024-11-26 04:41:47.717292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.848 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.717465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.717561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.717586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.717699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.717840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.717868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.718023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.718147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.718173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.718325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.718431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.718456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.718605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.718770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.718796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.718946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.719088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.719121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.719289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.719412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.719438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.719623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.719776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.719803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.720026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.720290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.720341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.720491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.720627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.720652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.720780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.720900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.720928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.721088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.721205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.721233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.721353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.721482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.721507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.721661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.721853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.721879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.721983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.722154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.722182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.722358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.722477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.722507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.722659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.722819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.722849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.723015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.723154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.723182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.723332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.723452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.723477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.723661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.723792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.723818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.723941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.724025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.724050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.724138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.724266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.724291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.724430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.724565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.724594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.724724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.724831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.724875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.725007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.725097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.725122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.725287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.725447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.725475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.849 [2024-11-26 04:41:47.725609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.725748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.849 [2024-11-26 04:41:47.725776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.849 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.725897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.726020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.726046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.726181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.726392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.726420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.726548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.726693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.726722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.726895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.727023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.727049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.727161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.727331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.727357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.727475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.727607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.727636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.727764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.727920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.727946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.728066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.728155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.728180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.728306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.728423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.728453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.728604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.728731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.728758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.728915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.729087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.729116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.729254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.729391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.729421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.729567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.729692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.729718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.729841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.729986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.730015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.730174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.730314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.730343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.730491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.730621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.730647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.730783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.730957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.730985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.731123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.731286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.731314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.731458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.731595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.731621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.731784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.731925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.731953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.850 qpair failed and we were unable to recover it. 00:30:08.850 [2024-11-26 04:41:47.732127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.850 [2024-11-26 04:41:47.732268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.732296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.732407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.732531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.732556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.732661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.732795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.732821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.732918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.733071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.733099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.733225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.733356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.733382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.733548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.733698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.733727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.733867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.733998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.734026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.734171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.734287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.734313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.734455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.734587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.734616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.734795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.734925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.734957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.735073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.735209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.735235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.735377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.735520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.735547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.735710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.735814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.735844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.735984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.736076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.736102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.736207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.736341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.736369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.736506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.736671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.736706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.736860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.736957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.736982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.737096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.737237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.737266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.737363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.737474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.737502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.737657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.737795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.737821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.737961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.738125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.738153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.738287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.738415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.738443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.738615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.738765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.738808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.738943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.739049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.739077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.739217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.739342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.739368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.739485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.739599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.739624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.739763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.739902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.739932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.851 qpair failed and we were unable to recover it. 00:30:08.851 [2024-11-26 04:41:47.740102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.851 [2024-11-26 04:41:47.740229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.740255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.740387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.740513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.740541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.740641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.740785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.740811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.740936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.741117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.741145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.741272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.741389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.741415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.741509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.741605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.741630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.741777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.741899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.741924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.742043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.742162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.742187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.742340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.742436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.742463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.742619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.742779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.742809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.742928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.743031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.743056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.743190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.743369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.743395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.743515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.743692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.743721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.743859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.744005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.744031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.744174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.744316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.744344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.744479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.744650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.744676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.744833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.744960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.744985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.745178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.745296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.745321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.745447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.745570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.745596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.745697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.745790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.745816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.745921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.746018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.746043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.746162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.746291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.746334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.746501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.746625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.746652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.746773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.746908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.746936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.747107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.747191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.747216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.747341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.747466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.747491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.747634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.747733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.747762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.852 [2024-11-26 04:41:47.747871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.748002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.852 [2024-11-26 04:41:47.748031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.852 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.748136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.748268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.748294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.748437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.748536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.748564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.748709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.748872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.748900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.749008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.749159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.749185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.749301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.749462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.749490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.749602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.749744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.749774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.749925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.750043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.750068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.750173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.750273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.750301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.750433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.750560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.750589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.750767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.750863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.750889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.750992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.751108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.751136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.751279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.751379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.751407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.751542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.751641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.751667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.751792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.751933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.751962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.752122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.752286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.752314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.752440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.752555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.752580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.752694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.752870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.752895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.752987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.753138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.753163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.753259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.753347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.753372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.753492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.753608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.753636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.753774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.753901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.753929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.754106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.754228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.754253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.754403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.754580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.754605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.754731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.754901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.754929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.755101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.755222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.755247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.755409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.755506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.755532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.755717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.755845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.755870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.755988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.756083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.756108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.853 qpair failed and we were unable to recover it. 00:30:08.853 [2024-11-26 04:41:47.756226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.756326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.853 [2024-11-26 04:41:47.756351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.756479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.756597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.756623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.756712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.756813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.756839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.756968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.757112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.757140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.757271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.757431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.757459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.757627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.757727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.757755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.757871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.757980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.758008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.758131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.758226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.758255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.758424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.758521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.758547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.758723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.758871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.758896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.759046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.759192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.759222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.759373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.759500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.759525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.759635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.759736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.759765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.759902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.760035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.760063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.760238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.760339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.760365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.760455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.760608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.760635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.760827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.760954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.760980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.761076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.761161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.761187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.761312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.761493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.761523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.761643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.761774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.761802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.761898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.762016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.762041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.762226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.762349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.762375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.762520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.762671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.762704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.762834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.762919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.762945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.763116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.763293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.763319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.763444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.763590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.763618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.763732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.763860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.763885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.763984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.764103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.764131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.764291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.764429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.854 [2024-11-26 04:41:47.764462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.854 qpair failed and we were unable to recover it. 00:30:08.854 [2024-11-26 04:41:47.764613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.764734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.764760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.764884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.764984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.765025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.765134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.765236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.765264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.765433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.765533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.765559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.765713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.765814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.765839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.765965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.766063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.766105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.766257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.766380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.766421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.766554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.766696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.766725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.766872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.767006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.767034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.767152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.767298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.767323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.767474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.767600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.767628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.767729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.767835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.767861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.767993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.768119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.768145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.768295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.768461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.768487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.768607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.768706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.768732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.768860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.768962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.768988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.769099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.769242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.769271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.769368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.769498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.769526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.769683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.769801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.769827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.769991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.770090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.770118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.770265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.770390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.770417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.770544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.770700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.770744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.770860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.771020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.771049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.771179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.771356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.771382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.771531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.771653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.855 [2024-11-26 04:41:47.771678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.855 qpair failed and we were unable to recover it. 00:30:08.855 [2024-11-26 04:41:47.771855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.771999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.772028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.772193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.772329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.772357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.772471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.772590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.772615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.772734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.772872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.772900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.773004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.773148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.773176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.773338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.773465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.773491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.773636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.773741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.773770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.773940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.774062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.774088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.774238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.774329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.774354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.774484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.774620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.774648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.774797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.774910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.774939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.775108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.775203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.775229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.775383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.775518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.775545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.775636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.775786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.775813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.775933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.776051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.776077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.776228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.776373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.776406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.776504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.776597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.776625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.776832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.776928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.776954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.777102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.777210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.777235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.777327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.777489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.777514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.777663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.777795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.777820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.778045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.778184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.778212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.778316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.778476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.778504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.778648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.778750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.778776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.778892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.779031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.779060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.779189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.779318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.779346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.779500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.779623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.779649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.779828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.779968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.779996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.856 qpair failed and we were unable to recover it. 00:30:08.856 [2024-11-26 04:41:47.780158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.780291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.856 [2024-11-26 04:41:47.780320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.780496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.780671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.780707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.780810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.780907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.780935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.781043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.781179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.781209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.781348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.781463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.781488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.781617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.781722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.781751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.781899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.782000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.782026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.782149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.782299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.782324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.782503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.782599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.782627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.782769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.782899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.782925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.783051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.783148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.783173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.783313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.783444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.783473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.783620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.783754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.783783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.783956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.784077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.784102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.784261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.784431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.784456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.784587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.784702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.784729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.784878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.785004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.785031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.785173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.785300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.785328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.785498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.785629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.785657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.785793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.785895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.785922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.786044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.786206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.786233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.786349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.786497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.786523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.786614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.786726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.786752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.786900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.787048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.787073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.787229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.787370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.787399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.787539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.787642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.787667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.787830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.787921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.787947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.788065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.788200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.788230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.788374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.788494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.788519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.857 qpair failed and we were unable to recover it. 00:30:08.857 [2024-11-26 04:41:47.788696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.857 [2024-11-26 04:41:47.788829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.788857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.788993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.789155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.789183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.789324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.789424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.789451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.789564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.789713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.789738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.789863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.789976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.790005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.790168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.790315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.790340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.790520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.790626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.790655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.790812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.790972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.791013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.791162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.791298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.791324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.791425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.791564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.791597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.791750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.791876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.791902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.792003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.792100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.792125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.792221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.792376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.792405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.792538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.792643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.792672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.792802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.792931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.792957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.793078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.793198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.793227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.793377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.793517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.793545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.793720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.793875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.793904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.794008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.794158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.794184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.794302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.794393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.794420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.794548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.794649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.794675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.794854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.794955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.794983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.795121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.795288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.795313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.795440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.795555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.795581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.795720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.795839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.795867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.796006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.796136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.796164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.796317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.796433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.796459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.796562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.796703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.796732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.858 qpair failed and we were unable to recover it. 00:30:08.858 [2024-11-26 04:41:47.796871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.796976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.858 [2024-11-26 04:41:47.797006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.797165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.797293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.797319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.797445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.797595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.797623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.797755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.797893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.797921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.798049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.798176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.798201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.798302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.798405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.798432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.798532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.798639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.798667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.798802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.798953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.798978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.799151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.799284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.799312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.799488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.799642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.799667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.799769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.799889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.799915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.800085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.800212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.800241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.800378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.800518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.800547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.800724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.800822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.800848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.800977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.801076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.801105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.801269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.801415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.801440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.801561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.801655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.801681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.801786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.801940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.801965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.802100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.802235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.802263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.802414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.802503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.802528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.802678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.802818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.802849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.802984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.803094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.803122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.803271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.803388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.803417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.803561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.803710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.803736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.859 [2024-11-26 04:41:47.803870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.803958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.859 [2024-11-26 04:41:47.803984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.859 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.804155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.804254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.804280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.804379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.804516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.804544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.804677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.804843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.804872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.805020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.805167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.805193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.805316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.805492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.805520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.805692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.805845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.805870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.805969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.806091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.806116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.806258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.806426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.806456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.806592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.806727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.806756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.806882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.806969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.806995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.807090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.807251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.807279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.807387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.807491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.807519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.807634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.807730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.807756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.807899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.808046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.808089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.808179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.808315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.808343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.808517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.808668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.808718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.808850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.808978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.809006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.809169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.809297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.809325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.809476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.809595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.809620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.809772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.809862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.809888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.810006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.810182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.810210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.810380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.810502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.810528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.810681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.810841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.810866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.811005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.811160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.811188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.811360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.811488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.811514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.811643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.811830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.811857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.811972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.812118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.812146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.812280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.812380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.812406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.860 qpair failed and we were unable to recover it. 00:30:08.860 [2024-11-26 04:41:47.812558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.860 [2024-11-26 04:41:47.812720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.812750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.812870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.813031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.813059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.813232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.813350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.813375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.813551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.813725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.813751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.813878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.814029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.814055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.814204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.814298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.814324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.814430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.814563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.814592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.814764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.814887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.814913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.815069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.815171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.815198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.815385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.815534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.815559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.815677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.815804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.815832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.815955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.816076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.816102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.816250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.816396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.816424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.816591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.816711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.816741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.816892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.817044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.817070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.817208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.817349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.817378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.817483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.817582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.817627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.817753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.817903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.817928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.818073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.818204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.818232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.818369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.818530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.818558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.818707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.818837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.818870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.818993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.819080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.819106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.819196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.819292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.819318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.819441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.819565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.819591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.819713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.819834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.819860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.819976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.820100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.820126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.820242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.820356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.861 [2024-11-26 04:41:47.820381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.861 qpair failed and we were unable to recover it. 00:30:08.861 [2024-11-26 04:41:47.820553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.820661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.820697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.820800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.820930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.820959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.821134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.821263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.821289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.821446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.821582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.821611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.821757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.821884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.821913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.822066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.822217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.822243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.822360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.822481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.822507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.822599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.822708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.822734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.822857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.822984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.823010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.823116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.823279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.823308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.823437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.823569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.823597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.823746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.823900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.823925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.824092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.824268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.824294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.824418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.824553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.824582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.824728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.824876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.824902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.825047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.825225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.825250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.825353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.825497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.825526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.825696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.825825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.825850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.825995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.826132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.826161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.826322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.826501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.826527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.826646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.826759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.826786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.826951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.827076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.827104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.827274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.827375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.827401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.827525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.827609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.827634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.827744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.827835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.827862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.827983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.828121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.828147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.862 qpair failed and we were unable to recover it. 00:30:08.862 [2024-11-26 04:41:47.828266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.828386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.862 [2024-11-26 04:41:47.828412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.828524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.828655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.828683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.828855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.828996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.829025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.829163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.829285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.829310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.829456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.829609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.829634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.829797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.829919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.829945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.830094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.830240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.830266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.830407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.830535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.830563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.830667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.830807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.830837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.830981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.831101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.831127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.831260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.831412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.831438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.831560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.831683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.831734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.831917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.832044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.832071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.832236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.832339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.832365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.832481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.832637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.832662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.832850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.832998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.833041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.833206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.833340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.833369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.833497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.833651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.833676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.833787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.833914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.833944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.834104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.834251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.834280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.834427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.834598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.834626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.834809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.834957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.834985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.835112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.835242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.835271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.835404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.835504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.835532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.835654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.835779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.835805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.835924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.836033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.836062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.836191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.836352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.836381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.863 [2024-11-26 04:41:47.836528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.836679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.863 [2024-11-26 04:41:47.836711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.863 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.836887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.837042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.837069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.837198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.837350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.837375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.837500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.837656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.837682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.837856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.837973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.837999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.838149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.838290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.838318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.838434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.838551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.838577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.838707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.838834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.838862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.838977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.839120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.839148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.839326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.839418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.839444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.839612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.839748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.839779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.839920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.840084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.840112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.840228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.840347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.840373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.840499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.840663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.840725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.840863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.840995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.841024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.841168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.841316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.841341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.841467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.841621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.841646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.841747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.841899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.841925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.842050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.842202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.842243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.842410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.842552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.842578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.842704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.842874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.842902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.843021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.843141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.843167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.843279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.843415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.843444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.843555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.843722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.843751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.843901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.844008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.844034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.864 [2024-11-26 04:41:47.844132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.844271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.864 [2024-11-26 04:41:47.844299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.864 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.844445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.844550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.844580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.844757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.844861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.844887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.845017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.845164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.845189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.845364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.845525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.845551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.845677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.845771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.845797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.845894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.846018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.846044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.846140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.846245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.846275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.846426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.846553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.846579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.846709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.846813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.846842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.846981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.847113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.847142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.847287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.847407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.847433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.847617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.847776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.847802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.847939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.848043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.848073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.848225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.848373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.848399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.848517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.848653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.848681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.848827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.848987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.849016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.849166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.849314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.849345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.849499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.849593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.849619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.849745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.849864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.849893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.850038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.850163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.850188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.850336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.850473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.850502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.850594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.850747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.850776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.850929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.851026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.851052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.851160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.851250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.851278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.851419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.851531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.851560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.851682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.851817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.851843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.851979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.852096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.852122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.852235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.852415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.852444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.865 qpair failed and we were unable to recover it. 00:30:08.865 [2024-11-26 04:41:47.852556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.865 [2024-11-26 04:41:47.852680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.852713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.852857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.852993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.853021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.853158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.853298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.853326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.853472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.853633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.853658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.853785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.853910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.853938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.854075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.854231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.854260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.854387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.854537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.854562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.854673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.854789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.854818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.854948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.855087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.855116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.855264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.855413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.855455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.855601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.855705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.855735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.855853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.855992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.856020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.856145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.856270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.856296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.856394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.856480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.856505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.856632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.856744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.856773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.856915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.857015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.857041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.857164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.857257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.857284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.857391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.857559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.857588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.857736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.857842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.857868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.857996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.858153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.858179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.858298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.858420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.858445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.858542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.858634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.858659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.858812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.858958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.858987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.859114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.859226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.859255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.859396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.859492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.859517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.859625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.859756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.859786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.859883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.860050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.860079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.860243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.860365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.860392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.860522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.860659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.866 [2024-11-26 04:41:47.860684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.866 qpair failed and we were unable to recover it. 00:30:08.866 [2024-11-26 04:41:47.860819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.860909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.860939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.861062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.861186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.861211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.861335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.861469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.861498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.861638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.861821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.861847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.862003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.862172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.862201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.862330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.862459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.862488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.862619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.862729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.862759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.862913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.863018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.863044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.863163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.863266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.863307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.863447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.863558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.863588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.863741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.863851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.863877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.863984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.864070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.864096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.864232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.864377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.864405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.864582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.864702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.864728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.864882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.865016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.865044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.865171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.865335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.865363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.865486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.865606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.865632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.865747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.865882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.865910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.866020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.866160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.866188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.866365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.866518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.866562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.866696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.866832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.866860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.867041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.867165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.867192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.867319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.867455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.867481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.867610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.867710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.867739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.867901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.868080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.868105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.868259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.868386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.868427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.868557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.868697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.868727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.868833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.868971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.869000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.867 qpair failed and we were unable to recover it. 00:30:08.867 [2024-11-26 04:41:47.869147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.867 [2024-11-26 04:41:47.869249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.869275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.869457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.869607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.869634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.869753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.869904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.869931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.870062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.870210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.870251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.870358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.870454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.870482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.870611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.870725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.870755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.870920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.871045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.871071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.871161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.871247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.871273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.871399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.871526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.871555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.871730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.871858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.871885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.872034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.872169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.872197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.872304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.872411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.872439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.872559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.872651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.872677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.872811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.872964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.872990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.873163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.873321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.873349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.873497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.873614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.873639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.873792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.873963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.873990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.874141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.874315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.874344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.874498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.874605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.874630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.874748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.874860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.874889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.875023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.875135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.875163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.875290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.875440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.875466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.875586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.875729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.875759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.875909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.876058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.876087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.876237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.876328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.876354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.876480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.876614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.876642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.876820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.876944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.876970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.877132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.877237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.877263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.877370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.877459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.868 [2024-11-26 04:41:47.877484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.868 qpair failed and we were unable to recover it. 00:30:08.868 [2024-11-26 04:41:47.877636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.877770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.877799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.877919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.878049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.878074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.878192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.878292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.878321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.878449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.878583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.878611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.878771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.878893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.878919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.879031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.879162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.879191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.879369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.879495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.879521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.879645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.879782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.879809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.879958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.880107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.880133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.880244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.880363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.880389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.880552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.880672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.880723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.880862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.880975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.881003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.881133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.881269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.881298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.881418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.881515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.881541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.881636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.881769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.881796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.881897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.882007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.882036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.882185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.882308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.882336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.882483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.882620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.882649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.882751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.882870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.882896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.883016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.883166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.883192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.883339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.883513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.883539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.883642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.883775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.883803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.883959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.884062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.884088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.884266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.884399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.884427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.884533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.884666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.869 [2024-11-26 04:41:47.884702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.869 qpair failed and we were unable to recover it. 00:30:08.869 [2024-11-26 04:41:47.884852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.884979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.885006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.885153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.885298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.885325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.885473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.885595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.885623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.885771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.885873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.885898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.886070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.886221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.886247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.886348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.886495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.886520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.886648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.886754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.886781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.886928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.887068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.887094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.887210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.887365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.887391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.887512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.887666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.887697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.887848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.887958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.887991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.888111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.888246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.888276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.888410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.888529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.888555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.888703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.888851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.888879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.889019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.889148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.889176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.889289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.889394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.889420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.889544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.889635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.889661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.889823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.889914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.889940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.890066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.890193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.890220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.890335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.890436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.890465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.890576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.890713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.890747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.890901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.891057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.891098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.891240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.891342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.891371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.891531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.891670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.891723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.891836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.891926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.891952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.892052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.892170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.892214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.870 qpair failed and we were unable to recover it. 00:30:08.870 [2024-11-26 04:41:47.892343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.870 [2024-11-26 04:41:47.892480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.892506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.892611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.892731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.892758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.892857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.893034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.893063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.893200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.893329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.893358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.893511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.893645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.893671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.893874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.894050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.894076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.894202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.894344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.894372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.894495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.894615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.894640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.894751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.894906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.894933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.895075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.895211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.895239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.895358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.895466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.895492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.895616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.895742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.895769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.895919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.896010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.896036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.896188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.896314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.896357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.896507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.896631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.896657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.896759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.896845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.896870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.897002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.897096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.897122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.897220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.897341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.897366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.897496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.897639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.897668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.897822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.897949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.897975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.898101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.898211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.898240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.898377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.898515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.898543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.898719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.898824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.898850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.898948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.899074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.899100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.899189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.899328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.899356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.899531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.899667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.899734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.871 qpair failed and we were unable to recover it. 00:30:08.871 [2024-11-26 04:41:47.899876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.871 [2024-11-26 04:41:47.900006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.900034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.900138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.900279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.900307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.900413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.900566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.900592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.900729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.900836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.900865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.901000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.901163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.901192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.901331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.901454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.901480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.901619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.901762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.901789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.901912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.902049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.902079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.902230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.902350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.902376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.902521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.902691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.902725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.902831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.902964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.902992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.903140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.903261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.903286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.903398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.903530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.903559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.903716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.903846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.903874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.904018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.904138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.904164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.904334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.904465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.904494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.904642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.904751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.904781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.904906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.905057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.905083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.905221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.905365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.905393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.905559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.905699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.905728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.905881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.906008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.906033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.906172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.906300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.906328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.906458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.906603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.906631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.906805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.906933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.906959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.907114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.907250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.907279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.907383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.907526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.907554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.907681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.907856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.907883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.908069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.908220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.908245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.872 qpair failed and we were unable to recover it. 00:30:08.872 [2024-11-26 04:41:47.908365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.872 [2024-11-26 04:41:47.908471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.908496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.908587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.908716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.908742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.908879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.908997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.909026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.909170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.909309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.909337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.909485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.909605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.909630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.909768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.909903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.909932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.910065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.910214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.910239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.910357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.910482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.910507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.910644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.910767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.910797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.910952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.911051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.911077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.911227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.911324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.911350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.911457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.911556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.911586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.911739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.911849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.911878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.911999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.912124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.912151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.912323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.912459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.912487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.912597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.912762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.912791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.912939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.913067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.913093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.913232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.913440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.913468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.913577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.913760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.913787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.913917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.914045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.914071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.914213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.914357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.914386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.914541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.914697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.914723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.914850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.914961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.914987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.915087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.915176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.915201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.915362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.915497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.915526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.915663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.915796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.915822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.915969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.916086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.916112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.916281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.916453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.916480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.916589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.916697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.873 [2024-11-26 04:41:47.916724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.873 qpair failed and we were unable to recover it. 00:30:08.873 [2024-11-26 04:41:47.916826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.916922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.916947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.917105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.917240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.917268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.917421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.917550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.917575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.917730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.917877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.917907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.918032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.918176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.918204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.918354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.918500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.918526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.918636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.918775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.918804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.918904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.919016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.919044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.919188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.919348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.919374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.919599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.919734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.919763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.919905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.920068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.920097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.920212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.920412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.920455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.920585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.920728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.920757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.920895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.921060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.921088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.921236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.921398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.921424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.921550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.921652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.921681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.921857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.922019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.922048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.922165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.922284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.922310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.922450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.922583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.922611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.922725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.922860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.922888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.923005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.923099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.923124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.923215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.923396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.923424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.923580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.923702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.923728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.923855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.924008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.924049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.874 qpair failed and we were unable to recover it. 00:30:08.874 [2024-11-26 04:41:47.924163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.924332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.874 [2024-11-26 04:41:47.924360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.924468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.924566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.924594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.924749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.924903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.924944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.925084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.925221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.925250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.925380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.925516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.925545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.925663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.925820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.925846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.925960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.926096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.926125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.926285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.926395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.926424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.926568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.926697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.926724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.926841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.926985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.927014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.927155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.927293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.927322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.927468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.927565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.927590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.927699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.927829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.927854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.927999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.928126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.928154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.928298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.928415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.928440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.928566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.928726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.928753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.928849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.928996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.929021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.929132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.929224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.929251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.929386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.929525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.929554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.929696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.929837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.929866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.930043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.930169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.930199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.930327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.930429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.930474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.930638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.930750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.930779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.930900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.931029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.931055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.931203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.931331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.931360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.931530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.931619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.931645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.931779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.931885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.931911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.932131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.932267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.932309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.932457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.932574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.932603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.875 qpair failed and we were unable to recover it. 00:30:08.875 [2024-11-26 04:41:47.932774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.875 [2024-11-26 04:41:47.932863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.932889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.932996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.933111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.933144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.933264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.933363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.933391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.933530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.933660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.933691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.933893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.934045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.934087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.934192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.934330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.934358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.934534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.934634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.934660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.934796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.934889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.934933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.935064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.935164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.935192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.935312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.935461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.935486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.935638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.935817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.935846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.935977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.936075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.936103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.936281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.936381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.936406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.936590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.936694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.936721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.936898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.937002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.937030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.937180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.937306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.937331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.937498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.937653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.937678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.937854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.937992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.938020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.938196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.938294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.938320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.938440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.938567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.938596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.938736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.938905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.938931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.940061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.940243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.940273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.940434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.940562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.940588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.940757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.940975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.941004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.942525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.942700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.942733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.942891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.943044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.943070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.943192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.943330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.943360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.943499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.943598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.943625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.876 qpair failed and we were unable to recover it. 00:30:08.876 [2024-11-26 04:41:47.943753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.943892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.876 [2024-11-26 04:41:47.943921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.944061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.944179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.944208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.944383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.944589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.944617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.944778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.944913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.944942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.945064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.945230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.945259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.945439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.945528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.945553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.945714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.945836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.945861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.946009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.946157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.946185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.946334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.946461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.946487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.946624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.946728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.946757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.946891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.947032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.947060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.947217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.947367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.947392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.947516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.947722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.947751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.947860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.948067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.948095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.948298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.948417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.948464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.948614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.948719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.948745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.948844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.948960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.948987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.949089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.949199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.949225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.949377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.949548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.949576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.949744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.949944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.949968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.950100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.950222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.950247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.950385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.950489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.950517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.950624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.950759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.950786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.950877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.951001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.951027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.951132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.951239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.951264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.951435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.951607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.951644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.951769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.951867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.951895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.952040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.952144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.952173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.952309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.952440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.952468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.877 qpair failed and we were unable to recover it. 00:30:08.877 [2024-11-26 04:41:47.952591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.877 [2024-11-26 04:41:47.952717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.952743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.952849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.952947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.952993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.953096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.953235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.953261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.953345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.953461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.953487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.953616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.953725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.953752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.953850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.953976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.954002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.954138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.954230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.954256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.954391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.954533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.954561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.954708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.954880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.954905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.955003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.955095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.955120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.955251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.955392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.955420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.955526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.955653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.955682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.955821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.955916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.955941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.956048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.956170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.956198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.956365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.956499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.956524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.956627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.956747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.956774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.956904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.957057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.957084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.957335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.957505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.957534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.957703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.957828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.957854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.958025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.958128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.958156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.958316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.958413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.958441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.958572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.958720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.958747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.958873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.959050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.959078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.959217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.959372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.959398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.959554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.959649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.959693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.878 qpair failed and we were unable to recover it. 00:30:08.878 [2024-11-26 04:41:47.959870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.959977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.878 [2024-11-26 04:41:47.960019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.960166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.960302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.960332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.960466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.960620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.960645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.960815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.960917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.960942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.961038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.961175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.961200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.961410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.961552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.961578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.961779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.961885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.961911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.962026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.962115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.962142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.962268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.962439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.962468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.962594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.962755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.962781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.962886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.962982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.963008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.963129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.963277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.963307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.963431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.963532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.963558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.963706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.963858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.963884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.964091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.964220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.964246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.964395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.964522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.964547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.964703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.964821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.964846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.964995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.965101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.965128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.965259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.965377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.965401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.965543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.965647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.965675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.965847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.965977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.966002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.966187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.966279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.966304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.966436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.966566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.966593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.966742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.966898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.966925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.967058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.967208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.967237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.967336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.967430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.967455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.967564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.967671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.967709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.879 qpair failed and we were unable to recover it. 00:30:08.879 [2024-11-26 04:41:47.967806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.967961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.879 [2024-11-26 04:41:47.967986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.968116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.968249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.968287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.968392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.968503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.968528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.968704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.968815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.968844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.968974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.969087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.969115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.969282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.969380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.969414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.969549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.969658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.969707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.969812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.969920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.969947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.970094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.970217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.970242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.970363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.970487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.970512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.970640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.970789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.970816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.970941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.971070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.971094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.971220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.971324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.971351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.971473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.971658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.971700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.971850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.971956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.971990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.972125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.972259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.972285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.972393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.972514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.972539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.972697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.972818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.972843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.973051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.973173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.973198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.973306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.973429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.973453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.973544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.973641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.973667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.973783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.973879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.973904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.973994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.974122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.974148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.974230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.974352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.974376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.974465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.974591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.974616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.974746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.974899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.974924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.880 qpair failed and we were unable to recover it. 00:30:08.880 [2024-11-26 04:41:47.975032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.975171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.880 [2024-11-26 04:41:47.975195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.975343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.975447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.975471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.975597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.975749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.975775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.975874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.975962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.975987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.976088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.976221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.976246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.976377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.976469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.976493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.976594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.976752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.976778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.976872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.976980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.977005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.977119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.977266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.977291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.977432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.977558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.977587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.977703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.977803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.977828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.977956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.978118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.978143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.978264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.978362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.978386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.978516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.978672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.978717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.978845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.978969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.979004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.979132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.979256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.979282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.979408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.979500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.979525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.979612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.979739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.979765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.979895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.980000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.980028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.980157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.980329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.980357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.980510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.980627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.980652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.980797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.980923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.980948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.981114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.981268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.981293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.981459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.981548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.981573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.981724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.982507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.982540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.982723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.982838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.982863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.983012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.983105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.983133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.983231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.983358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.983382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.983489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.983578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.881 [2024-11-26 04:41:47.983603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.881 qpair failed and we were unable to recover it. 00:30:08.881 [2024-11-26 04:41:47.983727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.983822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.983847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.984000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.984108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.984137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.984271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.984417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.984445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.984602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.984714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.984740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.984860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.984959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.984984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.985125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.985270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.985298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.985442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.985598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.985623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.986380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.986563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.986589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.986728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.986937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.986962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.987131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.987238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.987263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.987393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.987513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.987538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.987634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.987752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.987778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.987878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.988000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.988027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.988176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.988271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.988297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.988415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.988620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.988647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.989432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.989579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.989608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.989744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.989945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.989970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.990157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.990283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.990315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.990451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.990582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.990607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.990725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.990837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.990862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.990998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.991125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.991151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.991289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.991389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.991414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.991629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.991764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.991790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.991916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.992040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.992064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.992218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.992313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.992339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.992466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.992593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.992618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.992715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.992867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.992892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.993030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.993146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.993171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:08.882 qpair failed and we were unable to recover it. 00:30:08.882 [2024-11-26 04:41:47.993309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.882 [2024-11-26 04:41:47.993413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.993443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.993573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.993699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.993726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.993829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.993924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.993950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.994111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.994234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.994265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.994424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.994576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.994602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.994702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.994819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.994863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.994988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.995117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.995145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.995289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.995415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.995440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.995568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.995735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.995761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.995893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.996033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.996058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.996166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.996297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.996322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.996458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.996552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.996577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.996675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.996777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.996804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.996910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.997038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.997068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.997205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.997301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.997326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.997420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.997520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.997545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.997671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.997786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.997813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.997919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.998638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.998669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.998795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.998920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.998945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.999078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.999173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.999199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.999315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.999437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.999463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.999597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.999730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.999756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:47.999853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.999961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:47.999986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:48.000128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:48.000254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:48.000284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.883 [2024-11-26 04:41:48.000415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:48.000571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.883 [2024-11-26 04:41:48.000597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.883 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.000721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.000850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.000877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.001021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.001121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.001146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.001284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.001376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.001403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.001551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.001649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.001676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.001807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.001924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.001951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.002055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.002141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.002166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.002325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.002430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.002456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.002584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.002693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.002719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.002818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.002919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.002946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.003082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.003207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.003232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.003335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.003460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.003485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.003582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.003705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.003732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.003838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.003936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.003961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.004055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.004158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.004183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.004312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.004412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.004437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.004537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.004662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.004694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.004793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.004899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.004924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.005048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.005176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.005201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.005299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.005393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.005418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.005527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.005628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.005654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.005772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.005869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.005895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.006001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.006110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.006136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.006257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.006377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.006411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.006515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.006637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.006663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.006771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.006871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.006896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.007039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.007182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.007208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.007358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.007449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.007475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.884 [2024-11-26 04:41:48.007575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.007667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.884 [2024-11-26 04:41:48.007701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.884 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.007798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.007896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.007920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.008088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.008210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.008235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.008359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.008452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.008479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.008582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.008717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.008745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.008850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.008947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.008972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.009104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.009228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.009255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.009353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.009484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.009509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.009612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.009726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.009753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.009858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.009965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.009990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.010111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.010240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.010266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.010363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.010487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.010513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.010611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.010707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.010733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.010834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.010929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.010954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.011062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.011215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.011241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.011335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.011431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.011458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.011555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.011647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.011672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.011787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.011891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.011916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.012017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.012146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.012172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.012278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.012414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.012440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.012569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.012692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.012719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.012821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.012922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.012948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.013082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.013167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.013193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.013288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.013413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.013439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.013562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.013663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.013695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.013799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.013895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.013920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.014021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.014119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.014144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.014274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.014406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.014432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.014538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.014628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.885 [2024-11-26 04:41:48.014653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.885 qpair failed and we were unable to recover it. 00:30:08.885 [2024-11-26 04:41:48.014769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.014865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.014890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.015032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.015124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.015149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.015264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.015403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.015429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.015562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.015657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.015703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.015807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.015896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.015922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.016027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.016133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.016157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.016271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.016375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.016400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.016497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.016641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.016666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.016773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.016869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.016894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.017039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.017166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.017191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.017310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.017409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.017434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.017537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.017643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.017667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.017823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.017924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.017950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.018071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.018233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.018262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.018392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.018518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.018544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.018636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.018746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.018773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.018879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.018974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.018998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.019105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.019256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.019282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.019407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.019534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.019561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.019655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.019762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.019788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.019893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.019987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.020011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.020116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.020243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.020267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.020398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.020484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.020509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.020630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.020746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.020773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.020867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.020960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.020986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.021091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.021211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.021237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.021370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.021486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.021512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.021618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.021714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.021741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.886 qpair failed and we were unable to recover it. 00:30:08.886 [2024-11-26 04:41:48.021837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.886 [2024-11-26 04:41:48.021939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.021966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.022090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.022190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.022215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.022352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.022446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.022472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.022622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.022721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.022748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.022844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.022939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.022964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.023087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.023211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.023236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.023360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.023452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.023477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.023587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.023692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.023719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.023822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.023920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.023944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.024070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.024171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.024197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.024327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.024427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.024453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.024578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.024678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.024708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.024808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.024907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.024931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.025090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.025210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.025236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.025337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.025426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.025451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.025601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.025715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.025740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.025839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.025926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.025950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.026063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.026191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.026217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.026338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.026425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.026450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.026556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.026656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.026681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.026789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.026884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.026909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.027007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.027102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.027126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.027210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.027296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.027321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.027447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.027542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.027568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.027672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.027809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.027835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.027940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.028097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.028123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.028251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.028403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.028430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.028538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.028662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.028706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.887 qpair failed and we were unable to recover it. 00:30:08.887 [2024-11-26 04:41:48.028821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.028941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.887 [2024-11-26 04:41:48.028967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.029092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.029191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.029217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.029322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.029445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.029471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.029565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.029661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.029703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.029813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.029916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.029940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.030036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.030130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.030155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.030265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.030419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.030444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.030554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.030691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.030732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.030840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.030937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.030964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.031098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.031206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.031233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.031398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.031538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.031562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.031704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.031807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.031832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.031934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.032064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.032090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.032222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.032350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.032376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.032532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.032656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.888 [2024-11-26 04:41:48.032681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:08.888 qpair failed and we were unable to recover it. 00:30:08.888 [2024-11-26 04:41:48.032815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.032913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.032939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.033128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.033321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.033359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.033522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.033667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.033708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.033826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.033923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.033947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.034111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.034236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.034262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.034394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.034549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.034576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.034675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.034809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.034835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.034954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.035159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.035202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.035319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.035474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.035501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.035635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.035779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.035805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.035954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.036067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.036093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.036212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.036323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.036348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.036457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.036559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.036591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.036719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.036829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.036855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.036956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.037100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.037126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.037255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.037353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.037382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.037485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.037632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.037659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.171 [2024-11-26 04:41:48.037787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.037902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.171 [2024-11-26 04:41:48.037928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.171 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.038044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.038233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.038259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.038358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.038519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.038546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.038695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.038811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.038835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.038931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.039085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.039112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.039303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.039436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.039466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.039577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.039669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.039710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.039912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.040007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.040032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.040146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.040285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.040310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.040411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.040546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.040572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.040678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.040804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.040830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.040945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.041080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.041106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.041195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.041341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.041366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.041592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.041734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.041759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.041864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.042045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.042073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.042211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.042334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.042365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.042519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.042656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.042702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.042855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.042947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.042972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.043116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.043239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.043264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.043356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.043462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.043488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.043589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.043696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.043722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.043825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.043916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.043942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.044048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.044158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.044185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.044297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.044430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.044456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.044590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.044684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.044717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.044845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.045583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.045617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.045786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.046536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.046569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.046724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.046835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.046863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.046974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.047098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.047123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.047294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.047423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.172 [2024-11-26 04:41:48.047449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.172 qpair failed and we were unable to recover it. 00:30:09.172 [2024-11-26 04:41:48.047610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.047731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.047758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.047868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.047969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.047996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.048093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.048178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.048203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.048340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.048496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.048521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.048618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.048742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.048768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.048859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.048953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.048978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.049112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.049203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.049228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.049381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.049475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.049502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.049632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.049741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.049767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.049875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.049964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.049990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.050095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.050213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.050238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.050358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.050538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.050566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.050736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.050837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.050862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.050955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.051104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.051129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.051248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.051357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.051385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.051496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.051606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.051633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.051783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.051875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.051899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.052026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.052172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.052200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.052346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.052481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.052509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.052653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.052787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.052813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.052913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.053020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.053047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.053165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.053300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.053329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.053517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.053657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.053682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.053826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.053921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.053947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.054111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.054230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.054272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.054417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.054522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.054548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.054650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.054789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.054815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.054922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.055014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.055038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.055165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.055270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.055295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.055414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.055510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.055534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.173 qpair failed and we were unable to recover it. 00:30:09.173 [2024-11-26 04:41:48.055672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.055793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.173 [2024-11-26 04:41:48.055824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.055928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.056074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.056100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.056202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.056327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.056352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.056456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.056572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.056598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.056729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.056834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.056859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.056956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.057050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.057075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.057180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.057299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.057325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.057414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.057504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.057529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.057634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.057743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.057768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.057897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.058000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.058025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.058133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.058267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.058295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.058424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.058527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.058552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.058680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.058784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.058809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.058902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.058991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.059016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.059129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.059230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.059255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.059356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.059445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.059470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.059570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.059664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.059704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.059810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.059901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.059926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.060024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.060159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.060184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.060304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.060400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.060425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.060533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.060657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.060683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.060813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.060913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.060938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.061039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.061162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.061187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.061298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.061427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.061452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.061551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.061691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.061716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.061819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.061920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.061945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.062054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.062157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.062182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.062335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.062459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.062483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.062577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.062667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.062699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.062802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.062903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.062929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.063033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.063185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.174 [2024-11-26 04:41:48.063211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.174 qpair failed and we were unable to recover it. 00:30:09.174 [2024-11-26 04:41:48.063333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.063471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.063496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.063590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.063694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.063720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.063823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.063915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.063940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.064039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.064143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.064168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.064280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.064380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.064406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.064508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.064644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.064669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.064780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.064881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.064907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.065008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.065102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.065129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.065262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.065361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.065387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.065525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.065647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.065671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.065785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.065893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.065918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.066051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.066174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.066199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.066298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.066418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.066443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.066591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.066723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.066751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.066849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.066944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.066969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.067074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.067196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.067221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.067349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.067485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.067511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.067610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.067714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.067740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.067832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.067928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.067952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.068086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.068211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.068236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.068333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.068429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.068453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.068546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.068640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.068666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.175 [2024-11-26 04:41:48.068790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.068891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.175 [2024-11-26 04:41:48.068916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.175 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.069029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.069126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.069151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.069249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.069370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.069395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.069487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.069617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.069642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.069784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.069887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.069911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.070003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.070130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.070154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.070277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.070395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.070420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.070507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.070656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.070682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.070814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.070907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.070933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.071060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.071167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.071191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.071316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.071408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.071434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.071533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.071621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.071646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.071790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.071904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.071932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.072036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.072142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.072174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.072280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.072403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.072427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.072566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.072666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.072700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.072806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.072907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.072931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.073100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.073200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.073225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.073347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.073498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.073522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.073613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.073736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.073762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.073859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.073941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.073965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.074104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.074200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.074224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.074327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.074442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.074466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.074591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.074720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.074750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.074855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.074949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.074973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.075124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.075247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.075272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.075425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.075549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.176 [2024-11-26 04:41:48.075573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.176 qpair failed and we were unable to recover it. 00:30:09.176 [2024-11-26 04:41:48.075700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.075806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.075832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.075931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.076051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.076075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.076203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.076326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.076351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.076450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.076540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.076564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.076683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.076796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.076821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.076920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.077027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.077052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.077177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.077302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.077333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.077469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.077605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.077630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.077757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.077851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.077875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.077982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.078081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.078106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.078233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.078334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.078358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.078493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.078623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.078647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.078757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.078847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.078871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.078966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.079080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.079105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.079206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.079295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.079319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.079420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.079543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.079567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.079668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.079797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.079828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.079950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.080042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.080067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.080196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.080352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.080378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.080507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.080598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.080622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.080730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.080827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.080869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.081063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.081197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.081226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.081398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.081501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.081526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.081648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.081752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.081778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.081877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.081977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.082002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.177 [2024-11-26 04:41:48.082125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.082274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.177 [2024-11-26 04:41:48.082299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.177 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.082419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.082519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.082546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.082676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.082847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.082872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.082971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.083098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.083123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.083273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.083435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.083460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.083554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.083676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.083711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.083813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.083939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.083964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.084141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.084249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.084274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.084401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.084551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.084576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.084720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.084855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.084880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.084980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.085106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.085133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.085290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.085399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.085426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.085605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.085757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.085782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.085882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.086030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.086054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.086208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.086308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.086333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.086455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.086578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.086603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.086740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.086843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.086868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.086962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.087101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.087143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.087289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.087426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.087454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.087604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.087732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.087759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.087886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.088016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.088041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.088143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.088233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.088274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.088418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.088529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.088558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.088704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.088828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.088855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.088953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.089106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.089131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.089266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.089370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.089398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.089561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.089698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.089740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.089873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.089968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.089993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.178 [2024-11-26 04:41:48.090111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.090242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.178 [2024-11-26 04:41:48.090270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.178 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.090376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.090507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.090534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.090676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.090803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.090828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.090960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.091057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.091082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.091187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.091336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.091361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.091515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.091639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.091664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.091811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.091950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.091979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.092091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.092285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.092313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.092444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.092587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.092611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.092737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.092863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.092889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.093011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.093157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.093184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.093283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.093436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.093462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.093588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.093713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.093739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.093843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.093939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.093965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.094074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.094228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.094253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.094342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.094473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.094498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.094600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.094725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.094751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.094853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.094952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.094977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.095106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.095233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.095258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.095384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.095486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.095512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.095640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.095741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.095771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.095910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.096057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.096099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.096235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.096363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.096388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.096483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.096583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.096611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.179 [2024-11-26 04:41:48.096762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.096870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.179 [2024-11-26 04:41:48.096897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.179 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.097054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.097147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.097172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.097296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.097414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.097439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.097540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.097665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.097695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.097857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.097946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.097972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.098073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.098201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.098227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.098349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.098451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.098476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.098572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.098704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.098730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.098852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.098947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.098972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.099133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.099249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.099274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.099392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.099538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.099565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.099707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.099837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.099865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.099974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.100076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.100103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.100266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.100394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.100419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.100512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.100596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.100620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.100759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.100847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.100872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.100992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.101127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.101154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.101292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.101433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.101460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.101624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.101795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.101820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.101962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.102099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.102126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.102308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.102442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.102491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.102610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.102711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.102738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.102877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.103040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.103069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.103231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.103337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.103366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.103477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.103616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.103644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.180 qpair failed and we were unable to recover it. 00:30:09.180 [2024-11-26 04:41:48.103873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.180 [2024-11-26 04:41:48.103994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.104026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.104232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.104409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.104456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.104595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.104752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.104777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.104906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.105012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.105037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.105184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.105297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.105324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.105459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.105615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.105643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.105806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.105932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.105957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.106104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.106210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.106238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.106373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.106534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.106561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.106679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.106790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.106817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.106985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.107165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.107211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.107320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.107487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.107515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.107669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.107767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.107792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.107943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.108054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.108095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.108221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.108335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.108362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.108559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.108710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.108757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.108880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.109009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.109038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.109143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.109285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.109312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.109448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.109580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.109608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.109740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.109869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.109894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.110037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.110142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.110169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.110329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.110491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.110518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.110683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.110842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.110867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.111008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.111169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.111197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.111344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.111471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.111496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.111648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.111824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.111855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.111961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.112080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.112104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.112201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.112319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.112344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.181 [2024-11-26 04:41:48.112492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.112616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.181 [2024-11-26 04:41:48.112648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.181 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.112790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.112913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.112939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.113064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.113165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.113193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.113320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.113460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.113488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.113627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.113804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.113829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.113926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.114029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.114053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.114179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.114276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.114318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.114465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.114600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.114626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.114790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.114903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.114927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.115080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.115198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.115224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.115348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.115445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.115472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.115573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.115700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.115726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.115821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.115996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.116023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.116172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.116275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.116299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.116451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.116568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.116608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.116720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.116828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.116853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.117020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.117148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.117175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.117326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.117476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.117500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.117623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.117775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.117801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.117926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.118062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.118089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.118240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.118389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.118413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.118532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.118676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.118718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.118876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.118976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.119001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.119100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.119189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.119214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.119316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.119463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.119488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.119631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.119763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.119791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.119963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.120092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.120117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.120247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.120393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.120417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.120530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.120672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.120709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.182 qpair failed and we were unable to recover it. 00:30:09.182 [2024-11-26 04:41:48.120828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.182 [2024-11-26 04:41:48.120977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.121002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.121113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.121341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.121369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.121470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.121611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.121639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.121762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.121868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.121893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.121990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.122140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.122167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.122302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.122428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.122455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.122572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.122693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.122718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.122848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.122984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.123009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.123148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.123308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.123335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.123455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.123539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.123564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.123707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.123874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.123898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.124038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.124178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.124206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.124350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.124443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.124470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.124560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.124684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.124734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.124884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.125010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.125034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.125155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.125278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.125302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.125439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.125583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.125607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.125737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.125913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.125941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.126056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.126180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.126205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.126345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.126556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.126584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.126721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.126855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.126883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.127032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.127153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.127178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.127383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.127492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.127520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.127657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.127781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.127806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.127932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.128069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.128094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.128247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.128465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.128493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.128658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.128787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.128812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.128932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.129029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.129054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.183 [2024-11-26 04:41:48.129202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.129341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.183 [2024-11-26 04:41:48.129368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.183 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.129519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.129642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.129671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.129788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.129907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.129932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.130029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.130186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.130210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.130325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.130474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.130498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.130601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.130730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.130770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.130870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.130989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.131013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.131105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.131294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.131319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.131437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.131555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.131579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.131725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.131833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.131860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.131971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.132096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.132123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.132273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.132377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.132402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.132536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.132651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.132679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.132856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.132985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.133009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.133103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.133192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.133217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.133316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.133465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.133490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.133595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.133713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.133742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.133855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.133972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.133996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.134116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.134243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.134270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.134371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.134475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.134502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.134675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.134852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.134879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.134990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.135134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.135159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.135251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.135397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.135422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.135547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.135630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.135655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.135820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.135921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.135948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.136093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.136208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.136233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.136352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.136475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.136499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.184 qpair failed and we were unable to recover it. 00:30:09.184 [2024-11-26 04:41:48.136614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.136746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.184 [2024-11-26 04:41:48.136774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.136907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.137073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.137097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.137216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.137364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.137389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.137532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.137698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.137726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.137872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.137997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.138022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.138138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.138231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.138256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.138395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.138493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.138521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.138628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.138755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.138783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.138926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.139041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.139065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.139200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.139374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.139398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.139544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.139667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.139706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.139856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.139973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.139998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.140140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.140267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.140294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.140442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.140560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.140584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.140734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.140883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.140926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.141069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.141173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.141204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.141375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.141469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.141494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.141619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.141774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.141815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.141945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.142110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.142135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.142259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.142397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.142424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.142596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.142725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.142749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.142851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.142948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.142973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.143087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.143235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.143259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.143410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.143529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.143553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.185 [2024-11-26 04:41:48.143715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.143860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.185 [2024-11-26 04:41:48.143888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.185 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.144037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.144181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.144209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.144364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.144495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.144536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.144680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.144833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.144858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.144987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.145079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.145121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.145272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.145407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.145431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.145524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.145673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.145731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.145853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.145993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.146020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.146165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.146297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.146321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.146492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.146631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.146658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.146813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.146904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.146930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.147056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.147177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.147201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.147371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.147522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.147547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.147694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.147819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.147846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.147966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.148083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.148107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.148288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.148434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.148459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.148591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.148733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.148761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.148880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.148982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.149006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.149178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.149350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.149374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.149527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.149672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.149706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.149830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.149976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.150000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.150143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.150306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.150333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.150504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.150620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.150645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.150774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.150869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.150893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.150990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.151111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.151136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.151277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.151412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.151440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.151606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.151761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.151787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.151882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.152053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.186 [2024-11-26 04:41:48.152080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.186 qpair failed and we were unable to recover it. 00:30:09.186 [2024-11-26 04:41:48.152217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.152349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.152376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.152545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.152645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.152670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.152807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.152938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.152965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.153075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.153209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.153250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.153404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.153527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.153552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.153719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.153862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.153890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.154026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.154159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.154186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.154372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.154503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.154527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.154637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.154773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.154800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.154900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.155028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.155055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.155165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.155291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.155315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.155411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.155537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.155563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.155665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.155789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.155818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.155993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.156145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.156188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.156315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.156455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.156487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.156627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.156743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.156768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.156872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.157034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.157059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.157201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.157300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.157326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.157461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.157564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.157591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.157711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.157807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.157832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.157964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.158143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.158167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.158290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.158428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.158455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.158605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.158763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.158788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.158886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.159036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.159063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.159254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.159400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.159424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.159579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.159697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.159722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.159872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.159999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.187 [2024-11-26 04:41:48.160026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.187 qpair failed and we were unable to recover it. 00:30:09.187 [2024-11-26 04:41:48.160134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.160274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.160298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.160397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.160496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.160520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.160653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.160824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.160852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.161010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.161185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.161209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.161327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.161471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.161495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.161603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.161769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.161794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.161911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.162027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.162055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.162161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.162275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.162299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.162440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.162576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.162603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.162744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.162849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.162877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.163015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.163138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.163162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.163339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.163485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.163509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.163634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.163783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.163811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.163963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.164064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.164089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.164209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.164391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.164415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.164552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.164701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.164729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.164879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.165034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.165059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.165199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.165300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.165327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.165475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.165573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.165601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.165754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.165907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.165936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.166088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.166187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.166214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.166317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.166441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.166468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.166621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.166732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.166757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.166898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.167071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.167099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.167257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.167355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.167382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.167526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.167676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.167724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.167838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.167939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.167966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.168100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.168237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.168266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.188 qpair failed and we were unable to recover it. 00:30:09.188 [2024-11-26 04:41:48.168447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.188 [2024-11-26 04:41:48.168545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.168570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.168746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.168885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.168912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.169048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.169183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.169210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.169352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.169444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.169468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.169580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.169713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.169741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.169874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.169977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.170004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.170145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.170269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.170293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.170401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.170503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.170544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.170711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.170822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.170851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.170965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.171115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.171139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.171288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.171422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.171453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.171613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.171714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.171742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.171858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.172010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.172035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.172183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.172321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.172348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.172482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.172615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.172642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.172775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.172901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.172926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.173063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.173274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.173329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.173445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.173551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.173578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.173702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.173790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.173814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.173952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.174080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.174108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.174218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.174356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.174383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.174510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.174624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.174650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.174826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.174993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.175020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.175146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.175260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.175288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.175414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.175536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.175561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.175671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.175818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.175846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.175981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.176104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.176131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.176279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.176427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.176451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.189 [2024-11-26 04:41:48.176592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.176762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.189 [2024-11-26 04:41:48.176790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.189 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.176925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.177070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.177097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.177234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.177333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.177359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.177453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.177594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.177621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.177773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.177878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.177903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.178014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.178131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.178155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.178274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.178425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.178452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.178587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.178727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.178755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.178917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.179047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.179072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.179220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.179385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.179412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.179581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.179690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.179716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.179816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.179963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.179990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.180101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.180238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.180265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.180372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.180508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.180536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.180708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.180802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.180827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.181006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.181110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.181137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.181305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.181428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.181452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.181614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.181781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.181809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.181911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.182046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.182074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.182219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.182329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.182356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.182490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.182590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.182614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.182736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.182870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.182897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.183061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.183191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.183218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.190 qpair failed and we were unable to recover it. 00:30:09.190 [2024-11-26 04:41:48.183342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.183463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.190 [2024-11-26 04:41:48.183492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.183626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.183773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.183800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.183963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.184091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.184119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.184237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.184327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.184352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.184505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.184632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.184660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.184815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.184910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.184934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.185056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.185147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.185171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.185302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.185397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.185421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.185508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.185596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.185621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.185773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.185888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.185922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.186070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.186216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.186254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.186406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.186511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.186538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.186693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.186824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.186849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.186990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.187087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.187114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.187276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.187414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.187441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.187589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.187715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.187740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.187882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.188013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.188040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.188139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.188244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.188272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.188397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.188520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.188544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.188664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.188822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.188849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.188987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.189110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.189137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.189293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.189438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.189462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.189624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.189778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.189804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.189938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.190082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.190109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.190256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.190348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.190373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.190488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.190635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.190660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.190797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.190961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.190989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.191140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.191257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.191281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.191 qpair failed and we were unable to recover it. 00:30:09.191 [2024-11-26 04:41:48.191394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.191557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.191 [2024-11-26 04:41:48.191585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.191732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.191838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.191865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.191987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.192091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.192116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.192298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.192448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.192472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.192600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.192740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.192769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.192899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.193000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.193024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.193202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.193332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.193360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.193491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.193635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.193660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.193760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.193853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.193879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.194010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.194177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.194205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.194303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.194413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.194441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.194599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.194737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.194762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.194887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.195064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.195092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.195228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.195360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.195387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.195506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.195628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.195651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.195808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.195939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.195963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.196092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.196214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.196238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.196343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.196463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.196487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.196632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.196804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.196829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.196924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.197052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.197077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.197201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.197295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.197321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.197461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.197591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.197618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.197754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.197887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.197915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.198046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.198174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.198205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.198363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.198486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.198510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.198652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.198820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.198848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.192 [2024-11-26 04:41:48.199000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.199095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.192 [2024-11-26 04:41:48.199118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.192 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.199245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.199341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.199364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.199491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.199656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.199683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.199819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.199943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.199966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.200110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.200220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.200246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.200374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.200508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.200534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.200675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.200832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.200857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.201013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.201175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.201203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.201392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.201521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.201545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.201667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.201767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.201790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.201900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.202062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.202088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.202222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.202317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.202343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.202463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.202593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.202619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.202758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.202908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.202931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.203054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.203186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.203213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.203348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.203444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.203469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.203595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.203747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.203773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.203902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.204063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.204089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.204238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.204333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.204358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.204502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.204634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.204660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.204786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.204922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.204949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.205128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.205253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.205277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.205390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.205530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.205557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.205747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.205876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.205900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.206026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.206174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.206198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.206323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.206449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.206476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.206585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.206722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.193 [2024-11-26 04:41:48.206750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.193 qpair failed and we were unable to recover it. 00:30:09.193 [2024-11-26 04:41:48.206871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.207001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.207025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.207187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.207303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.207328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.207424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.207547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.207574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.207730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.207847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.207872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.207993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.208101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.208128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.208268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.208398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.208426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.208540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.208630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.208653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.208807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.208972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.208999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.209109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.209254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.209281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.209421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.209545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.209570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.209717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.209858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.209885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.210049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.210220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.210246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.210393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.210511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.210534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.210692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.210803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.210831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.210963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.211073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.211100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.211219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.211336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.211361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.211475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.211618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.211645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.211807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.211918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.211946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.212073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.212201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.212225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.212350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.212473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.212498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.212626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.212763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.212791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.212936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.213065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.213094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.213280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.213371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.213395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.213498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.213672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.213707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.213852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.213949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.213974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.214101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.214257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.214281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.214411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.214557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.214584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.214765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.214894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.214933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.194 qpair failed and we were unable to recover it. 00:30:09.194 [2024-11-26 04:41:48.215068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.215227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.194 [2024-11-26 04:41:48.215252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.215381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.215472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.215513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.215659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.215777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.215802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.215951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.216057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.216083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.216199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.216329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.216357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.216532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.216659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.216712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.216845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.216976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.217010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.217120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.217257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.217285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.217406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.217528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.217551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.217683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.217841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.217866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.217968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.218113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.218140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.218310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.218427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.218452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.218617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.218738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.218763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.218862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.219020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.219047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.219223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.219358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.219383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.219540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.219648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.219675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.219834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.219950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.219975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.220100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.220220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.220243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.220380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.220515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.220543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.220658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.220812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.220839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.220992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.221122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.221145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.221250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.221407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.221433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.221593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.221723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.221748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.221877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.221999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.222023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.195 [2024-11-26 04:41:48.222120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.222218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.195 [2024-11-26 04:41:48.222242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.195 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.222389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.222530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.222557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.222728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.222880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.222921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.223058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.223224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.223251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.223383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.223511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.223538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.223692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.223829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.223853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.223954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.224115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.224138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.224239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.224391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.224417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.224536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.224658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.224684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.224834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.224982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.225008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.225110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.225250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.225280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.225431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.225531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.225554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.225680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.225781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.225804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.225928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.226027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.226054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.226228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.226350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.226374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.226488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.226589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.226615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.226733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.226842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.226869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.227007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.227108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.227132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.227278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.227403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.227427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.227548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.227719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.227747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.227865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.227992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.228020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.228123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.228247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.228273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.228368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.228516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.228540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.228653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.228790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.228817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.228918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.229089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.229116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.229260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.229397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.229422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.229569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.229661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.229692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.229842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.229982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.230010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.230119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.230235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.230262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.196 qpair failed and we were unable to recover it. 00:30:09.196 [2024-11-26 04:41:48.230384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.230518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.196 [2024-11-26 04:41:48.230542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.230683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.230806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.230835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.230985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.231115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.231142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.231257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.231403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.231427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.231572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.231709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.231746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.231847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.232008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.232043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.232181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.232307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.232331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.232508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.232634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.232661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.232775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.232886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.232913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.233025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.233122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.233147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.233286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.233414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.233441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.233576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.233673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.233706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.233834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.233962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.233986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.234078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.234208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.234234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.234362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.234538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.234562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.234709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.234830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.234855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.234979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.235105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.235132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.235235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.235348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.235375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.235497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.235589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.235613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.235760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.235861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.235888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.236020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.236118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.236145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.236294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.236416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.236440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.236564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.236668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.236724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.236870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.237025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.237049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.237143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.237244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.237268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.237359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.237481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.237505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.237625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.237733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.237761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.237907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.238011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.238036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.238211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.239079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.197 [2024-11-26 04:41:48.239113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.197 qpair failed and we were unable to recover it. 00:30:09.197 [2024-11-26 04:41:48.239284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.239422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.239450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.239597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.239759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.239785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.239917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.240063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.240090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.240235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.240342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.240375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.240520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.240670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.240702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.240816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.240956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.240983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.241127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.241257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.241284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.241427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.241525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.241549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.241662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.241827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.241852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.241971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.242089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.242132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.242251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.242368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.242392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.242482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.242608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.242633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.242779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.242921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.242946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.243082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.243209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.243233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.243364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.243452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.243492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.243668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.243775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.243800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.243918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.244065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.244089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.244238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.244345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.244374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.244483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.244653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.244680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.244844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.244967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.244998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.245140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.245305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.245330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.245448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.245591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.245618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.245738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.245887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.245911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.246032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.246175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.246203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.246340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.246476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.246503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.246650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.246761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.246787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.246904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.246999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.247023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.247145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.247226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.247251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.198 [2024-11-26 04:41:48.247341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.247432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.198 [2024-11-26 04:41:48.247455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.198 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.247573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.247694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.247719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.247843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.247937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.247960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.248056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.248139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.248163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.248291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.248386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.248411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.248505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.248637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.248661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.248779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.248874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.248898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.249025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.249169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.249197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.249306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.249469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.249496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.249646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.249760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.249786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.249895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.250030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.250057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.250219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.250321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.250348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.250492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.250592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.250617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.250738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.250899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.250926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.251058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.251190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.251217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.251360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.251508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.251532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.251632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.251758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.251783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.251960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.252058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.252085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.252230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.252349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.252373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.252491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.252593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.252622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.252742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.252854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.252882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.253023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.253174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.253199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.253318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.253450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.253479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.253614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.253772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.253797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.253915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.254071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.254095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.199 qpair failed and we were unable to recover it. 00:30:09.199 [2024-11-26 04:41:48.254245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.199 [2024-11-26 04:41:48.254379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.254405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.254510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.254671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.254713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.254890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.255018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.255042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.255154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.255288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.255315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.255453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.255625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.255649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.255813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.255913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.255937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.256094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.256218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.256243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.256366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.256499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.256526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.256714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.256812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.256836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.256980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.257166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.257190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.257341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.257429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.257453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.257547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.257641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.257665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.257828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.257962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.257990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.258131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.258268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.258295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.258468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.258589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.258613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.258739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.258875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.258900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.259042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.259176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.259204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.259350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.259434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.259459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.259630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.259733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.259760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.259875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.259970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.259997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.260116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.260238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.260262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.260395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.260557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.260584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.260699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.260803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.260830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.260974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.261096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.261120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.261233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.261358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.261384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.261523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.261638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.261665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.261854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.261974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.261998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.262140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.262285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.262312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.262454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.262588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.200 [2024-11-26 04:41:48.262615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.200 qpair failed and we were unable to recover it. 00:30:09.200 [2024-11-26 04:41:48.262767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.262896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.262922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.263013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.263145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.263173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.263312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.263416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.263442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.263636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.263765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.263790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.263911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.264034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.264060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.264159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.264308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.264335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.264516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.264642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.264682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.264797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.264902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.264930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.265030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.265138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.265167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.265309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.265437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.265462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.265605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.265703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.265735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.265866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.265999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.266027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.266172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.266334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.266375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.266548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.266700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.266729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.266884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.266984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.267011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.267129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.267281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.267305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.267414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.267552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.267579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.267723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.267826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.267854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.267966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.268087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.268111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.268253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.268355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.268382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.268557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.268708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.268734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.268894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.268990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.269014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.269187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.269361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.269385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.269511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.269651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.269682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.269839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.269934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.269959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.201 [2024-11-26 04:41:48.270097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.270197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.201 [2024-11-26 04:41:48.270226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.201 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.270357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.270500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.270524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.270616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.270777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.270803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.270953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.271096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.271122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.271288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.271456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.271480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.271607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.271744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.271770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.271948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.272039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.272063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.272230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.272325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.272352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.272484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.272617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.272644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.272812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.272909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.272934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.273062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.273206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.273233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.273381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.273480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.273505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.273626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.273765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.273793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.273898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.274005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.274032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.274155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.274279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.274305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.274449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.274655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.274682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.274860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.274962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.274989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.275100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.275198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.275224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.275339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.275453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.275480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.275654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.275785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.275810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.275939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.276030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.276056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.276272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.276440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.276467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.276643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.276780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.276807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.276960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.277082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.277107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.277284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.277409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.277433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.277555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.277695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.277723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.277843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.277966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.277992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.202 qpair failed and we were unable to recover it. 00:30:09.202 [2024-11-26 04:41:48.278179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.202 [2024-11-26 04:41:48.278302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.278327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.278465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.278597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.278624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.278740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.278867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.278892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.279036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.279186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.279210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.279305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.279408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.279433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.279552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.279668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.279701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.279854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.279992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.280019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.280156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.280308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.280332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.280424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.280523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.280547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.280683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.280828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.280852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.280980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.281102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.281127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.281278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.281397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.281421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.281543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.281708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.281748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.281886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.281983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.282010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.282158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.282274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.282298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.282436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.282573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.282599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.282744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.282880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.282907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.283056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.283179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.283203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.283342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.283475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.283502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.283619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.283747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.283775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.283896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.284024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.284048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.284193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.284332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.284359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.284500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.284632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.284658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.284825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.284930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.284954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.285078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.285190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.285233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.285377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.285509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.285536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.285694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.285793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.285817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.203 qpair failed and we were unable to recover it. 00:30:09.203 [2024-11-26 04:41:48.285960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.203 [2024-11-26 04:41:48.286134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.286160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.286297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.286396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.286423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.286544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.286660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.286691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.286811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.286935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.286962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.287087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.287219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.287245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.287361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.287454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.287480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.287599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.287717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.287745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.287870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.288003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.288030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.288159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.288249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.288273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.288367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.288458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.288482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.288603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.288703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.288728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.288864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.288986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.289013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.289154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.289322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.289346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.289459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.289611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.289636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.289769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.289860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.289884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.289990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.290153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.290180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.290320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.290456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.290484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.290631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.290746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.290771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.290943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.291088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.291112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.291238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.291381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.291408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.291550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.291641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.291666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.291863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.291966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.291994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.292091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.292239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.292266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.292437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.292563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.292587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.204 qpair failed and we were unable to recover it. 00:30:09.204 [2024-11-26 04:41:48.292735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.204 [2024-11-26 04:41:48.292842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.292870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.292989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.293127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.293154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.293324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.293452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.293477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.293627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.293791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.293819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.293949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.294036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.294060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.294185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.294305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.294330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.294473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.294631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.294659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.294821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.294972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.294996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.295121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.295243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.295269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.295428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.295531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.295558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.295714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.295926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.295953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.296104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.296230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.296254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.296397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.296507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.296540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.296704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.296923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.296948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.297117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.297217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.297242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.297336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.297460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.297486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.297637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.297842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.297870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.298019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.298144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.298168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.298313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.298449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.298477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.298634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.298772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.298797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.298928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.299046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.299070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.299212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.299317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.299344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.299444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.299624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.299649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.299783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.299902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.299926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.300083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.300171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.300196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.300336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.300444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.300471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.300612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.300731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.300756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.205 [2024-11-26 04:41:48.300912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.301046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.205 [2024-11-26 04:41:48.301073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.205 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.301175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.301303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.301330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.301441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.301591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.301615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.301774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.301984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.302011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.302146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.302248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.302274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.302384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.302502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.302526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.302698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.302803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.302830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.303037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.303175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.303202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.303352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.303475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.303501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.303643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.303828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.303857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.303971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.304174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.304198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.304319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.304412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.304436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.304527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.304658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.304682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.304826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.305000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.305027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.305197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.305314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.305339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.305477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.305635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.305663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.305811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.305933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.305960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.306127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.306336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.306364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.306466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.306602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.306629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.306735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.306875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.306903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.307052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.307166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.307191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.307363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.307498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.307525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.307630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.307743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.307771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.307883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.308030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.308055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.308168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.308318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.308342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.308464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.308582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.308606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.308809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.308910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.308938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.309099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.309248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.309272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.309374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.309501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.309528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.206 qpair failed and we were unable to recover it. 00:30:09.206 [2024-11-26 04:41:48.309651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.206 [2024-11-26 04:41:48.309818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.309844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.310016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.310155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.310180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.310307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.310445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.310472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.310607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.310728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.310753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.310892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.311001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.311028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.311131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.311258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.311284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.311398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.311496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.311520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.311669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.311806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.311834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.311977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.312121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.312148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.312263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.312399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.312424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.312582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.312709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.312735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.312840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.312988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.313015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.313160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.313310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.313334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.313475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.313617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.313644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.313794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.313946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.313970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.314063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.314196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.314220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.314341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.314463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.314490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.314657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.314788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.314813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.314944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.315083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.315107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.315223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.315338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.315365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.315500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.315635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.315662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.315831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.315949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.315974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.316075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.316182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.316209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.316376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.316511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.316538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.316676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.316777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.316801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.316917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.317030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.317057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.317163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.317295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.317322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.317440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.317542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.317566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.207 qpair failed and we were unable to recover it. 00:30:09.207 [2024-11-26 04:41:48.317697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.317835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.207 [2024-11-26 04:41:48.317862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.318027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.318122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.318149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.318295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.318415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.318439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.318612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.318786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.318838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.318957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.319094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.319121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.319264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.319355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.319381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.319576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.319726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.319751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.319925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.320168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.320221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.320379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.320499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.320523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.320671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.320793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.320818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.320943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.321119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.321147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.321285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.321407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.321432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.321653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.321808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.321833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.321929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.322070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.322097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.322208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.322307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.322331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.322474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.322615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.322642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.322819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.322952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.322978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.323097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.323191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.323217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.323311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.323475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.323499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.323648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.323826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.323855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.324003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.324094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.324125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.324271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.324405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.324433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.324568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.324672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.324708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.324917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.325088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.325115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.325248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.325357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.325384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.325537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.325660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.325683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.325794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.325888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.325912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.326002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.326134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.326158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.326318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.326435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.208 [2024-11-26 04:41:48.326459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.208 qpair failed and we were unable to recover it. 00:30:09.208 [2024-11-26 04:41:48.326604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.326754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.326780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.326909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.327049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.327076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.327249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.327425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.327449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.327604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.327725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.327766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.327902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.328039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.328066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.328200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.328338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.328361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.328453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.328569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.328594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.328779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.328915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.328942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.329116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.329245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.329272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.329416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.329531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.329555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.329665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.329808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.329835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.329941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.330068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.330094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.330216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.330333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.330357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.330497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.330659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.330692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.330835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.330935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.330962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.331104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.331252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.331276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.331435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.331560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.209 [2024-11-26 04:41:48.331585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.209 qpair failed and we were unable to recover it. 00:30:09.209 [2024-11-26 04:41:48.331726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.331856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.331883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.331990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.332095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.332119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.332245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.332333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.332374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.332482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.332640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.332666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.332824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.332974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.332999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.333192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.333310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.333335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.333458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.333591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.333618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.333778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.333896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.333921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.334055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.334188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.334215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.334311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.334479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.334503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.334628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.334753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.334778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.334890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.335054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.335081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.335214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.335357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.335384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.335531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.335652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.335677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.335873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.336007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.336031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.336174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.336350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.336375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.336514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.336645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.336672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.336828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.337031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.337058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.337172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.337324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.337349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.337464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.337588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.337612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.337723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.337842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.337866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.338016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.338108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.338132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.338262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.338348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.338372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.338491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.338609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.338634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.338782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.338925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.338952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.339105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.339222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.339251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.339363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.339465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.339492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.210 qpair failed and we were unable to recover it. 00:30:09.210 [2024-11-26 04:41:48.339631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.210 [2024-11-26 04:41:48.339759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.339784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.339935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.340058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.340099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.340272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.340387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.340412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.340537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.340738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.340763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.340912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.341001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.341026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.341124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.341246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.341271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.341397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.341545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.341573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.341746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.341947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.341972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.342095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.342242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.342269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.342412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.342508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.342536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.342684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.342809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.342833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.342949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.343106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.343132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.343271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.343363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.343390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.343534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.343619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.343644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.343854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.344083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.344132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.344233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.344378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.344402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.344523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.344641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.344667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.344775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.344924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.344951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.345063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.345166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.345194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.345349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.345471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.345496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.345650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.345820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.345845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.345942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.346048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.346075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.346225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.346323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.346347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.346484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.346594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.346622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.346726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.346891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.346918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.347125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.347249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.347294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.347458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.347554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.347581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.211 qpair failed and we were unable to recover it. 00:30:09.211 [2024-11-26 04:41:48.347757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.211 [2024-11-26 04:41:48.347859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.347883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.348006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.348096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.348121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.348238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.348414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.348441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.348616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.348735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.348761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.348961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.349094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.349122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.349272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.349385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.349410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.349530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.349670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.349705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.349822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.349942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.349966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.350058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.350175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.350200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.350344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.350474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.350502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.350628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.350730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.350757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.350880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.351014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.351041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.351146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.351304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.351339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.351494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.351629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.351656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.351779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.351888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.351913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.352055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.352256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.352295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.352431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.352581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.352605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.352756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.352923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.352951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.353119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.353238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.353263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.353359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.353445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.353469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.353594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.353723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.353750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.353886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.353987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.354011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.354135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.354231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.354256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.354412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.354527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.354555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.354665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.354787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.354815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.354958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.355076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.355100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.212 qpair failed and we were unable to recover it. 00:30:09.212 [2024-11-26 04:41:48.355218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.212 [2024-11-26 04:41:48.355353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.355380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.355539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.355636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.355663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.355793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.355923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.355947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.356087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.356220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.356246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.356389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.356562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.356585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.356702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.356826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.356852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.356998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.357169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.357193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.357366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.357457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.357484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.357607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.357703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.357729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.357823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.357921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.357945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.358119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.358247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.358274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.358423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.358525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.358549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.358680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.358777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.358819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.358994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.359110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.359134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.359261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.359354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.359379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.359507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.359674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.359709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.359816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.359930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.359959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.360103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.360225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.360250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.360398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.360526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.360553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.360714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.360862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.360886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.361010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.361152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.361177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.361348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.361468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.361492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.361588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.361677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.361709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.361805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.361927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.361953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.362103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.362276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.362303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.362466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.362625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.362653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.362804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.362904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.362930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.363070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.363173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.363198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.213 qpair failed and we were unable to recover it. 00:30:09.213 [2024-11-26 04:41:48.363316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.363421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.213 [2024-11-26 04:41:48.363448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.363646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.363856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.363882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.364000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.364138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.364165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.364336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.364471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.364497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.364642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.364738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.364763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.364857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.364975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.365000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.365090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.365218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.365242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.365363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.365456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.365482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.365606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.365754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.365782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.365891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.366050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.366082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.366258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.366410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.366451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.366592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.366716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.366741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.366887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.367026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.367054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.367202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.367303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.367328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.367467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.367597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.367625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.367762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.367901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.367928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.368050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.368145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.368170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.368341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.368446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.368473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.368655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.368791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.368816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.368917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.369012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.369036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.369157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.369274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.369298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.214 qpair failed and we were unable to recover it. 00:30:09.214 [2024-11-26 04:41:48.369431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.369574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.214 [2024-11-26 04:41:48.369601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.498 qpair failed and we were unable to recover it. 00:30:09.498 [2024-11-26 04:41:48.369759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.498 [2024-11-26 04:41:48.369889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.498 [2024-11-26 04:41:48.369915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.498 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.370063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.370165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.370193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.370327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.370433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.370460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.370643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.370806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.370834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.370990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.371139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.371164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.371283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.371428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.371453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.371605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.371726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.371751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.371919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.372027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.372051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.372215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.372333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.372360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.372488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.372574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.372599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.372698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.372805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.372831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.372927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.373070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.373098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.373255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.373363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.373391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.373488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.373622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.373649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.373774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.373879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.373903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.373998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.374119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.374144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.374297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.374409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.374436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.374596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.374699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.374727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.374870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.374963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.374988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.375171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.375270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.375298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.375435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.375577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.375602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.375738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.375867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.375892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.376044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.376177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.376204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.376391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.376513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.376537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.376667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.376792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.376817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.376985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.377120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.377147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.377277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.377435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.377462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.377626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.377770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.377796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.499 qpair failed and we were unable to recover it. 00:30:09.499 [2024-11-26 04:41:48.377925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.499 [2024-11-26 04:41:48.378070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.378098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.378206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.378369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.378396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.378545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.378638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.378663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.378768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.378884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.378908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.379022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.379126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.379153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.379303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.379422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.379446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.379559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.379667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.379703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.379821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.379940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.379964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.380123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.380215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.380240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.380349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.380481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.380508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.380660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.380768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.380798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.380923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.381074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.381114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.381249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.381373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.381400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.381504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.381633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.381659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.381785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.381875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.381900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.382050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.382151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.382178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.382283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.382413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.382455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.382575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.382672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.382704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.382825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.382920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.382944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.383067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.383179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.383206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.383344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.383466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.383491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.383632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.383748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.383773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.383882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.384023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.384050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.384233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.384351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.384376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.384497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.384591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.384618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.384746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.384900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.384925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.385052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.385152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.500 [2024-11-26 04:41:48.385177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.500 qpair failed and we were unable to recover it. 00:30:09.500 [2024-11-26 04:41:48.385326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.385447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.385472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.385564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.385711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.385739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.385890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.385979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.386004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.386135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.386296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.386323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.386437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.386566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.386593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.386746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.386870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.386894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.387039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.387203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.387229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.387377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.387494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.387518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.387642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.387754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.387780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.387897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.388040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.388067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.388200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.388302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.388328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.388444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.388559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.388583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.388707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.388865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.388890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.388993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.389095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.389138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.389270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.389394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.389418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.389560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.389658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.389694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.389846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.389975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.390001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.390148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.390236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.390260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.390432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.390591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.390618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.390725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.390893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.390920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.391045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.391167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.391193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.391285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.391427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.391455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.391560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.391680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.391711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.391858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.391981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.392005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.392157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.392298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.392326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.392457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.392546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.392570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.392695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.392799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.392823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.501 qpair failed and we were unable to recover it. 00:30:09.501 [2024-11-26 04:41:48.392933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.501 [2024-11-26 04:41:48.393060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.393087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.393231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.393358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.393382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.393479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.393581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.393605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.393699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.393826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.393867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.394032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.394181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.394205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.394306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.394454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.394479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.394622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.394798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.394824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.394988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.395126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.395153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.395330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.395422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.395447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.395582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.395717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.395752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.395925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.396060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.396088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.396229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.396355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.396379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.396508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.396677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.396731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.396904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.397026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.397051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.397152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.397281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.397305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.397444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.397587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.397614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.397787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.397906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.397930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.398057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.398160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.398185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.398283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.398404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.398428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.398587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.398715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.398752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.398876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.398996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.399020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.399171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.399334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.399361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.399505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.399635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.399661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.399793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.399901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.399925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.400034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.400135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.400162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.400272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.400400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.400427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.400576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.400696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.400722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.400840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.401009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.401034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.502 qpair failed and we were unable to recover it. 00:30:09.502 [2024-11-26 04:41:48.401196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.502 [2024-11-26 04:41:48.401368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.401396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.401537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.401661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.401691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.401871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.402056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.402117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.402255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.402427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.402451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.402574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.402729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.402754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.402912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.403042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.403069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.403203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.403407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.403431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.403528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.403655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.403680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.403790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.403887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.403912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.404030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.404168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.404195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.404310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.404467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.404491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.404605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.404748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.404776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.404881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.405023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.405047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.405171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.405263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.405287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.405412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.405505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.405544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.405661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.405778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.405806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.405920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.406044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.406069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.406206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.406342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.406369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.406498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.406637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.406661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.406801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.406925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.406951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.407096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.407226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.407259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.407420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.407517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.407557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.407693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.407802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.407826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.503 qpair failed and we were unable to recover it. 00:30:09.503 [2024-11-26 04:41:48.407981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.503 [2024-11-26 04:41:48.408133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.408175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.408286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.408383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.408411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.408549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.408671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.408705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.408880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.409055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.409079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.409195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.409289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.409313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.409539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.409704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.409733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.409874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.410001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.410025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.410120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.410268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.410292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.410388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.410481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.410507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.410683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.410819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.410846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.410942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.411120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.411147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.411289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.411412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.411436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.411606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.411716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.411750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.411855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.411994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.412021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.412165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.412297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.412322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.412442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.412533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.412557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.412733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.412976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.413022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.413188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.413395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.413422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.413645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.413774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.413799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.413920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.414097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.414122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.414246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.414372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.414396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.414540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.414643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.414672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.414865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.414950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.414975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.415092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.415217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.415242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.415386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.415550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.415577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.415737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.415864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.415887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.416014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.416101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.416125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.416242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.416408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.416432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.416590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.416690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.504 [2024-11-26 04:41:48.416733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.504 qpair failed and we were unable to recover it. 00:30:09.504 [2024-11-26 04:41:48.416875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.416976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.417000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.417121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.417255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.417281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.417409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.417569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.417596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.417718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.417815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.417839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.417983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.418109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.418136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.418285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.418412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.418436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.418532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.418622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.418646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.418746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.418861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.418886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.419000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.419120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.419144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.419265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.419392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.419417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.419510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.419628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.419652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.419785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.419912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.419937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.420045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.420165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.420189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.420283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.420421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.420447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.420619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.420720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.420745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.420892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.420985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.421009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.421140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.421295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.421322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.421490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.421587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.421614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.421763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.421913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.421938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.422084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.422215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.422246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.422360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.422523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.422550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.422699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.422820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.422846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.422945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.423064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.423088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.423264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.423399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.423425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.423545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.423673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.423708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.423837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.423986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.424012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.424174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.424264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.424291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.424436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.424561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.424586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.505 qpair failed and we were unable to recover it. 00:30:09.505 [2024-11-26 04:41:48.424708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.505 [2024-11-26 04:41:48.424849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.424877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.425043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.425169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.425196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.425341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.425427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.425451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.425603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.425709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.425737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.425873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.426040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.426064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.426215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.426345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.426384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.426515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.426647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.426674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.426829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.426931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.426956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.427113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.427200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.427224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.427332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.427495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.427522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.427691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.427834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.427859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.427953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.428079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.428103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.428268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.428409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.428436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.428572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.428718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.428746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.428887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.428986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.429013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.429129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.429260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.429287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.429425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.429631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.429658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.429782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.429907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.429933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.430101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.430260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.430287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.430421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.430552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.430579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.430720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.430843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.430868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.430972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.431130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.431157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.431290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.431428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.431456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.431583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.431709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.431735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.431878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.432038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.432065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.432199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.432371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.432395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.432501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.432725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.432750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.506 qpair failed and we were unable to recover it. 00:30:09.506 [2024-11-26 04:41:48.432902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.506 [2024-11-26 04:41:48.433038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.433065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.433169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.433295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.433321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.433460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.433612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.433636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.433793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.433899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.433923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.434014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.434115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.434139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.434269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.434363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.434392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.434542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.434670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.434704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.434868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.435011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.435038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.435173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.435269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.435295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.435431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.435566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.435593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.435731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.435844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.435871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.436047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.436149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.436173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.436274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.436394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.436436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.436587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.436711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.436736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.436836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.436953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.436977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.437072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.437251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.437278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.437412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.437521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.437548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.437697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.437801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.437825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.437927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.438027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.438052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.438202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.438290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.438314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.438466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.438634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.438662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.438811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.438905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.438929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.439074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.439242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.439267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.439418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.439566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.439609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.439755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.439899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.439923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.440044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.440141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.440165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.440381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.440522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.440549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.440721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.440921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.440945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.507 [2024-11-26 04:41:48.441099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.441234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.507 [2024-11-26 04:41:48.441261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.507 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.441412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.441534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.441558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.441679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.441834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.441859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.442011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.442147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.442174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.442288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.442407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.442432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.442544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.442675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.442710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.442817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.442924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.442950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.443175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.443280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.443304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.443400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.443497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.443521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.443699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.443833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.443860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.443976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.444067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.444091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.444297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.444403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.444430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.444594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.444716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.444742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.444834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.444950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.444974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.445092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.445192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.445219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.445387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.445481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.445507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.445654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.445819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.445845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.445972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.446097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.446124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.446289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.446384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.446411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.446550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.446635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.446659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.446794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.446895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.446919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.447063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.447208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.447232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.447370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.447519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.447560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.447703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.447878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.447902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.508 [2024-11-26 04:41:48.447994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.448091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.508 [2024-11-26 04:41:48.448116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.508 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.448212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.448308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.448332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.448425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.448587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.448614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.448783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.448906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.448930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.449056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.449175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.449203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.449346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.449506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.449532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.449668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.449785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.449813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.449961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.450045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.450069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.450240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.450376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.450403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.450550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.450641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.450665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.450777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.450870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.450894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.451016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.451155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.451182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.451325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.451493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.451520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.451692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.451783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.451808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.451952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.452135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.452160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.452317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.452407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.452432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.452531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.452626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.452650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.452781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.452874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.452915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.453050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.453177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.453204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.453355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.453476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.453500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.453607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.453780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.453805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.453898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.454040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.454067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.454202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.454351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.454375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.454596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.454706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.454734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.454865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.454974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.455001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.455156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.455256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.455280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.455401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.455573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.455599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.455734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.455846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.455874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.509 qpair failed and we were unable to recover it. 00:30:09.509 [2024-11-26 04:41:48.456012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.456164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.509 [2024-11-26 04:41:48.456187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.456296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.456403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.456429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.456537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.456714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.456743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.456914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.457012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.457037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.457190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.457355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.457382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.457509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.457645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.457672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.457826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.457947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.457971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.458072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.458198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.458223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.458356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.458479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.458503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.458697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.458819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.458843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.458994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.459139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.459163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.459317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.459426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.459452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.459596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.459713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.459738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.459897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.460020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.460044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.460184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.460350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.460378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.460527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.460646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.460670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.460815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.460976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.461004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.461171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.461311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.461340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.461490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.461605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.461630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.461786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.461988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.462013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.462181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.462316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.462343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.462463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.462587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.462615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.462792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.462911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.462935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.463067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.463160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.463187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.463358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.463482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.463506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.463657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.463804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.463832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.463933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.464077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.464101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.464218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.464370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.510 [2024-11-26 04:41:48.464413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.510 qpair failed and we were unable to recover it. 00:30:09.510 [2024-11-26 04:41:48.464559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.464711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.464740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.464873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.464976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.465004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.465154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.465300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.465324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.465467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.465613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.465641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.465784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.465889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.465917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.466062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.466190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.466214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.466333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.466474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.466501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.466651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.466751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.466776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.466927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.467048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.467072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.467222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.467364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.467391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.467532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.467662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.467696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.467850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.467980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.468004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.468110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.468244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.468268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.468369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.468538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.468565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.468681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.468803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.468828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.468976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.469103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.469130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.469259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.469402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.469426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.469547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.469640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.469664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.469824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.469918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.469943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.470065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.470217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.470244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.470395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.470513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.470537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.470674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.470853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.470877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.471046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.471182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.471209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.471351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.471499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.471523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.471701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.471838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.471867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.472009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.472114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.472141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.472318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.472423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.472448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.472543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.472712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.511 [2024-11-26 04:41:48.472740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.511 qpair failed and we were unable to recover it. 00:30:09.511 [2024-11-26 04:41:48.472892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.473011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.473035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.473157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.473280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.473304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.473423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.473535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.473562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.473672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.473809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.473836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.474012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.474128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.474152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.474315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.474413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.474437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.474558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.474682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.474712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.474807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.474922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.474947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.475077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.475247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.475271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.475362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.475474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.475501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.475672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.475774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.475799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.475939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.476064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.476091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.476237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.476385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.476413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.476534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.476655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.476682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.476802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.476946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.476970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.477132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.477227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.477254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.477392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.477480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.477504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.477628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.477739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.477768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.477870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.478007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.478034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.478183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.478298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.478322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.478408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.478560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.478584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.478727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.478848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.478875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.479022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.479126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.479150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.479243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.479366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.479406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.479595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.479744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.479770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.479925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.480051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.480090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.480236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.480362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.480386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.512 qpair failed and we were unable to recover it. 00:30:09.512 [2024-11-26 04:41:48.480560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.480673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.512 [2024-11-26 04:41:48.480711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.480851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.481003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.481027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.481156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.481272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.481296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.481399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.481527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.481551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.481677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.481830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.481855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.481950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.482101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.482126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.482227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.482359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.482383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.482529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.482693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.482737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.482832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.482934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.482958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.483060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.483153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.483179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.483319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.483468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.483492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.483627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.483746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.483771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.483859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.483959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.483983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.484085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.484237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.484262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.484392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.484480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.484504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.484632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.484725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.484750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.484936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.485076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.485106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.485285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.485410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.485438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.485582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.485714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.485741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.485869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.485993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.513 [2024-11-26 04:41:48.486034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.513 qpair failed and we were unable to recover it. 00:30:09.513 [2024-11-26 04:41:48.486150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.486295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.486320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.486447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.486615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.486640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.486801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.486951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.486976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.487104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.487227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.487252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.487375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.487473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.487498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.487599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.487720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.487745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.487874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.488039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.488065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.488164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.488293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.488319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.488478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.488579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.488604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.488732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.488827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.488854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.488979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.489081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.489106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.489234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.489386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.489412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.489542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.489632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.489657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.489816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.489945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.489973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.490109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.490230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.490256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.490379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.490532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.490557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.490695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.490838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.490881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.491024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.491166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.491190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.491311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.491434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.491459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.491594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.491698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.491724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.491832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.492024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.492070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.492183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.492302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.492329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.492460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.492562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.492586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.492714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.492863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.492888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.493012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.493135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.493160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.493259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.493410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.493436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.493539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.493670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.493701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.514 [2024-11-26 04:41:48.493814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.493950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.514 [2024-11-26 04:41:48.493975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.514 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.494099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.494190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.494216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.494313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.494465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.494490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.494614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.494740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.494765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.494892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.495021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.495047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.495175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.495296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.495321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.495449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.495587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.495613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.495710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.495881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.495924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.496095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.496209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.496234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.496334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.496488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.496514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.496617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.496706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.496732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.496882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.497040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.497067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.497216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.497338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.497363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.497464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.497616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.497640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.497769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.497929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.497974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.498103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.498232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.498257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.498413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.498537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.498562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.498692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.498809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.498834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.498934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.499027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.499052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.499176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.499326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.499356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.499509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.499659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.499704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.499830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.499924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.499950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.500047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.500176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.500201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.500333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.500482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.500507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.500612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.500766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.500792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.500924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.501017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.501042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.501137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.501230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.501255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.501408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.501496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.501521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.501621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.501753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.515 [2024-11-26 04:41:48.501779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.515 qpair failed and we were unable to recover it. 00:30:09.515 [2024-11-26 04:41:48.501932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.502025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.502057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.502152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.502277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.502302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.502400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.502487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.502511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.502642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.502798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.502824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.502920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.503082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.503108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.503238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.503340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.503367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.503460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.503587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.503612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.503753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.503928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.503971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.504115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.504252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.504277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.504408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.504507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.504531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.504652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.504784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.504814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.504915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.505010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.505034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.505134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.505249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.505274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.505400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.505521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.505546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.505675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.505827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.505856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.505998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.506132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.506157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.506251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.506373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.506398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.506502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.506653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.506679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.506832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.507015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.507057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.507241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.507410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.507436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.507560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.507657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.507702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.507828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.507993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.508035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.508159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.508278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.508303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.508432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.508557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.508582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.508753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.508919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.508947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.509113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.509206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.509232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.509331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.509456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.509481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.509577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.509669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.509700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.516 qpair failed and we were unable to recover it. 00:30:09.516 [2024-11-26 04:41:48.509820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.516 [2024-11-26 04:41:48.509973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.509998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.510121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.510251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.510277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.510426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.510548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.510573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.510722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.510818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.510844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.510942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.511042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.511069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.511228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.511348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.511374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.511468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.511615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.511640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.511760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.511889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.511914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.512087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.512223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.512248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.512373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.512476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.512501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.512603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.512725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.512750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.512872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.512967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.512994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.513150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.513277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.513302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.513408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.513561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.513586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.513731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.513906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.513951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.514099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.514230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.514255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.514382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.514507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.514534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.514679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.514863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.514889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.515064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.515203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.515230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.515351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.515444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.515470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.515603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.515741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.515770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.515880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.516004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.516028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.516153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.516272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.516297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.516400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.516520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.516544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.516635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.516814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.516858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.517033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.517143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.517168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.517295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.517445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.517470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.517596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.517695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.517722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.517 qpair failed and we were unable to recover it. 00:30:09.517 [2024-11-26 04:41:48.517869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.518038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.517 [2024-11-26 04:41:48.518080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.518235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.518359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.518384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.518540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.518695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.518721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.518841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.518985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.519012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.519147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.519238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.519263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.519397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.519550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.519575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.519709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.519830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.519859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.520019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.520174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.520202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.520369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.520492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.520516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.520613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.520751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.520780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.520920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.521033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.521076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.521179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.521303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.521327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.521477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.521595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.521619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.521724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.521827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.521853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.521980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.522071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.522096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.522233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.522364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.522389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.522513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.522633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.522658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.522787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.522887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.522912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.523039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.523154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.523179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.523273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.523399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.523424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.523518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.523670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.523714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.523827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.523958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.523983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.524109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.524225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.524250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.524349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.524467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.524492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.518 [2024-11-26 04:41:48.524613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.524771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.518 [2024-11-26 04:41:48.524797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.518 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.524901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.525033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.525058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.525223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.525342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.525367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.525520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.525645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.525671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.525818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.526008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.526051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.526178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.526345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.526371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.526523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.526644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.526669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.526815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.526975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.527003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.527140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.527292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.527317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.527445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.527568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.527594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.527699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.527831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.527856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.528011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.528101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.528126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.528278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.528438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.528463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.528598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.528699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.528725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.528906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.529062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.529105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.529278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.529450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.529475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.529599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.529696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.529721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.529838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.530047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.530090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.530211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.530379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.530404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.530533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.530652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.530677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.530831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.530993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.531035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.531149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.531322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.531351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.531482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.531636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.531662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.531796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.531924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.531949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.532042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.532165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.532190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.532311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.532436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.532461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.532562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.532710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.532736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.532863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.532990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.533015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.533148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.533287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.519 [2024-11-26 04:41:48.533315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.519 qpair failed and we were unable to recover it. 00:30:09.519 [2024-11-26 04:41:48.533448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.533567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.533592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.533701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.533831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.533856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.533988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.534127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.534155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.534298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.534461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.534488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.534653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.534778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.534802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.534922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.535079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.535105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.535228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.535376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.535404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.535538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.535640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.535667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.535816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.535935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.535959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.536123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.536268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.536295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.536428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.536546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.536571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.536708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.536864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.536888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.537041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.537172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.537213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.537321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.537463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.537490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.537597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.537702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.537743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.537841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.537982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.538009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.538143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.538308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.538336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.538474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.538595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.538619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.538735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.538864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.538888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.539031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.539164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.539191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.539356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.539453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.539480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.539617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.539737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.539762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.539857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.539999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.540026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.540135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.540320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.540348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.540511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.540668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.540705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.540816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.540943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.540968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.541114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.541215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.541242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.541360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.541461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.541488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.520 qpair failed and we were unable to recover it. 00:30:09.520 [2024-11-26 04:41:48.541661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.520 [2024-11-26 04:41:48.541792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.541817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.541911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.542028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.542055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.542215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.542350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.542376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.542481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.542578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.542605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.542724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.542849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.542874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.543024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.543130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.543157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.543262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.543367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.543399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.543531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.543661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.543694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.543811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.543914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.543940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.544069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.544245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.544273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.544409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.544572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.544599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.544747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.544870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.544894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.544983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.545135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.545158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.545315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.545480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.545508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.545673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.545824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.545852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.545998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.546103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.546129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.546289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.546450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.546477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.546615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.546732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.546757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.546856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.546991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.547019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.547153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.547255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.547282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.547483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.547614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.547640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.547817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.547913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.547937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.548085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.548249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.548277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.548386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.548553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.548580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.548695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.548826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.548855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.548978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.549067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.549108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.549248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.549369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.549397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.549529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.549665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.549710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.521 [2024-11-26 04:41:48.549847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.549930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.521 [2024-11-26 04:41:48.549954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.521 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.550100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.550235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.550263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.550438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.550574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.550602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.550717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.550875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.550902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.551043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.551162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.551185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.551306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.551440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.551466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.551627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.551763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.551794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.552006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.552285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.552347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.552499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.552620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.552644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.552805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.552969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.552996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.553130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.553262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.553288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.553398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.553535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.553559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.553657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.553788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.553813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.553955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.554127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.554155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.554264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.554401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.554427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.554562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.554694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.554721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.554833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.554963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.554992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.555134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.555235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.555259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.555384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.555482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.555507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.555604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.555741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.555768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.555888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.556012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.556035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.556199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.556335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.556361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.556464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.556561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.556588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.556732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.556834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.556857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.556984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.557106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.557130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.522 qpair failed and we were unable to recover it. 00:30:09.522 [2024-11-26 04:41:48.557253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.522 [2024-11-26 04:41:48.557392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.557419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.557562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.557716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.557741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.557951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.558092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.558118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.558241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.558390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.558414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.558556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.558698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.558739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.558836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.558937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.558974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.559142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.559304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.559330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.559494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.559619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.559643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.559821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.559921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.559960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.560135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.560289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.560313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.560431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.560590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.560616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.560736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.560868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.560892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.561025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.561151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.561176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.561297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.561430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.561457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.561569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.561672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.561705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.561854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.561947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.561973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.562113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.562216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.562242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.562407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.562544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.562571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.562709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.562842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.562869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.563013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.563137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.563161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.563263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.563352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.563377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.563498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.563648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.563672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.563841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.564004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.564031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.564185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.564298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.564322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.564426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.564563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.564590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.564765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.564880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.564909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.565048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.565182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.565205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.523 qpair failed and we were unable to recover it. 00:30:09.523 [2024-11-26 04:41:48.565321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.523 [2024-11-26 04:41:48.565444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.565469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.565614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.565722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.565763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.565892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.566065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.566092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.566306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.566477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.566502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.566653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.566755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.566779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.566909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.567077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.567103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.567263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.567413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.567437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.567538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.567719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.567748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.567893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.568012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.568036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.568211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.568324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.568352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.568490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.568623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.568651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.568820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.568928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.568956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.569100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.569220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.569244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.569414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.569535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.569562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.569700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.569802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.569829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.569973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.570109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.570135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.570282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.570401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.570426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.570547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.570693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.570718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.570865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.570990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.571015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.571115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.571204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.571227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.571372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.571485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.571509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.571682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.571868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.571895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.572055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.572198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.572225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.572389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.572523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.572550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.572700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.572830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.572855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.572997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.573152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.573179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.573318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.573452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.573492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.573626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.573826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.573876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.524 qpair failed and we were unable to recover it. 00:30:09.524 [2024-11-26 04:41:48.574030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.524 [2024-11-26 04:41:48.574180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.574204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.574349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.574485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.574511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.574616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.574757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.574784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.574954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.575169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.575224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.575365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.575472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.575496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.575643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.575791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.575819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.575984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.576118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.576146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.576298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.576427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.576452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.576591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.576745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.576770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.576899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.577044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.577072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.577236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.577377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.577404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.577564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.577702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.577731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.577856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.577946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.577970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.578074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.578242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.578270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.578376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.578508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.578535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.578701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.578869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.578894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.579015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.579104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.579129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.579261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.579352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.579378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.579503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.579637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.579665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.579800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.579944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.579969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.580117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.580238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.580262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.580382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.580547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.580574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.580701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.580866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.580893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.581031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.581138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.581165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.581310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.581457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.581481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.581643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.581742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.581767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.581921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.582011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.582036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.582138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.582282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.582310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.525 qpair failed and we were unable to recover it. 00:30:09.525 [2024-11-26 04:41:48.582427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.582545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.525 [2024-11-26 04:41:48.582574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.582750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.582849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.582874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.582998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.583159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.583186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.583323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.583466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.583493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.583634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.583733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.583759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.583907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.584051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.584079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.584215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.584342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.584369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.584511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.584624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.584652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.584830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.584955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.584982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.585109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.585253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.585279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.585416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.585553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.585579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.585727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.585853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.585877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.585972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.586068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.586092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.586240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.586380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.586404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.586500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.586653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.586677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.586860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.587120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.587173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.587297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.587419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.587444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.587618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.587756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.587783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.587924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.588061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.588088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.588199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.588341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.588367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.588542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.588697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.588740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.588874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.589012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.589039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.589187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.589311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.589334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.589458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.589597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.589623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.589794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.589897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.589920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.590108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.590230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.590254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.590371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.590466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.590506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.590638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.590851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.590901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.526 qpair failed and we were unable to recover it. 00:30:09.526 [2024-11-26 04:41:48.591024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.526 [2024-11-26 04:41:48.591145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.591168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.591339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.591453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.591480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.591577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.591705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.591733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.591900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.591997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.592023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.592175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.592326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.592350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.592450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.592574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.592601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.592713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.592855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.592879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.593032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.593225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.593275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.593447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.593542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.593567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.593711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.593853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.593895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.594050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.594205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.594228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.594321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.594467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.594496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.594622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.594722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.594746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.594886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.595015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.595041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.595178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.595299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.595322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.595468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.595611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.595635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.595786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.595911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.595952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.596052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.596185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.596213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.596349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.596480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.596506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.596681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.596856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.596919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.597070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.597172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.597196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.597300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.597388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.597418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.597549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.597703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.597731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.527 qpair failed and we were unable to recover it. 00:30:09.527 [2024-11-26 04:41:48.597872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.527 [2024-11-26 04:41:48.598044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.598068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.598168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.598260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.598284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.598409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.598562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.598591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.598728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.598880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.598904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.599007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.599131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.599171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.599297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.599389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.599413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.599589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.599733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.599762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.599943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.600096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.600120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.600260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.600405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.600436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.600605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.600751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.600776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.600870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.600982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.601009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.601112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.601246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.601272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.601379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.601496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.601523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.601646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.601796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.601822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.601951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.602091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.602117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.602255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.602389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.602416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.602586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.602715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.602739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.602864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.602959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.602982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.603126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.603255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.603282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.603451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.603586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.603613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.603808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.604040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.604090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.604240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.604388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.604413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.604503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.604594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.604619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.604722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.604861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.604888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.605023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.605172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.605196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.605300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.605420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.605444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.605567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.605707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.605734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.605898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.606008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.606034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.528 qpair failed and we were unable to recover it. 00:30:09.528 [2024-11-26 04:41:48.606173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.606332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.528 [2024-11-26 04:41:48.606360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.606528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.606658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.606704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.606848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.606947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.606970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.607108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.607270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.607297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.607454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.607578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.607602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.607726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.607848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.607873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.607985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.608130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.608155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.608278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.608423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.608450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.608617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.608771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.608795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.608917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.609037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.609061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.609210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.609339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.609366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.609507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.609677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.609711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.609821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.609974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.609997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.610150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.610276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.610300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.610432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.610527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.610554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.610720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.610871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.610895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.611013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.611181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.611208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.611330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.611453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.611479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.611643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.611770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.611795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.611944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.612086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.612109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.612210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.612338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.612362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.612490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.612590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.612614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.612756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.612865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.612892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.613024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.613120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.613146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.613243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.613377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.613403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.613550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.613635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.613659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.613771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.613936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.613962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.614076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.614249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.614273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.614373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.614519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.529 [2024-11-26 04:41:48.614546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.529 qpair failed and we were unable to recover it. 00:30:09.529 [2024-11-26 04:41:48.614668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.614793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.614818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.614928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.615028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.615055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.615192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.615363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.615390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.615542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.615636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.615660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.615767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.615890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.615914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.616062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.616225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.616249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.616367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.616478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.616504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.616637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.616752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.616776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.616871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.616991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.617014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.617159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.617326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.617353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.617493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.617601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.617627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.617773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.617868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.617892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.617998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.618118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.618143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.618294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.618420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.618444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.618561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.618749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.618774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.618869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.619034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.619060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.619180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.619302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.619326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.619456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.619605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.619629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.619736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.619835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.619859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.619979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.620130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.620157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.620275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.620364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.620387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.620516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.620637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.620661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.620801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.620907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.620934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.621101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.621233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.621261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.621410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.621530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.621555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.621704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.621813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.621840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.622003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.622108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.622134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.622276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.622419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.622443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.530 qpair failed and we were unable to recover it. 00:30:09.530 [2024-11-26 04:41:48.622563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.530 [2024-11-26 04:41:48.622715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.622739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.622876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.623038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.623062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.623236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.623333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.623360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.623463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.623565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.623594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.623715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.623873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.623898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.624041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.624204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.624231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.624394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.624556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.624583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.624723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.624916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.624945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.625120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.625242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.625266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.625423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.625545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.625568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.625708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.625839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.625866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.626002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.626177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.626241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.626360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.626486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.626510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.626619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.626755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.626782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.626895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.627057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.627084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.627255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.627376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.627401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.627540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.627712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.627756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.627885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.627983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.628007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.628125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.628221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.628245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.628391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.628492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.628521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.628640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.628766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.628791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.628926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.629087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.629113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.629224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.629331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.629357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.629549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.629672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.629705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.629836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.629968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.629992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.630125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.630220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.630245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.630371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.630518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.531 [2024-11-26 04:41:48.630543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.531 qpair failed and we were unable to recover it. 00:30:09.531 [2024-11-26 04:41:48.630701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.630824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.630851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.630967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.631090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.631116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.631266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.631428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.631454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.631614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.631742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.631769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.631901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.632036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.632062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.632204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.632323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.632347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.632483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.632597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.632625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.632739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.632857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.632882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.632988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.633069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.633093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.633193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.633314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.633337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.633467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.633567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.633591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.633733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.633829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.633852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.633988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.634123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.634151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.634319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.634470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.634510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.634648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.634764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.634792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.634926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.635065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.635091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.635262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.635374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.635397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.635509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.635656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.635680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.635819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.635920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.635946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.636109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.636240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.636265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.636369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.636494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.636518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.636611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.636738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.636764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.636939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.637073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.637100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.637238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.637338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.637365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.532 [2024-11-26 04:41:48.637529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.637699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.532 [2024-11-26 04:41:48.637726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.532 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.637871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.637975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.638000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.638147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.638253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.638279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.638440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.638577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.638610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.638747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.638882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.638910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.639041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.639135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.639160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.639256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.639402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.639426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.639593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.639736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.639763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.639928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.640027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.640053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.640199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.640320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.640344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.640469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.640565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.640590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.640718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.640898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.640922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.641025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.641204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.641229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.641378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.641469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.641497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.641619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.641742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.641767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.641890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.642052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.642079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.642220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.642359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.642383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.642553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.642731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.642756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.642880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.643025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.643066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.643189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.643281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.643305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.643434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.643531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.643573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.643752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.643844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.643868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.643992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.644095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.644124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.644258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.644363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.644394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.644558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.644694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.644722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.644869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.644970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.644993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.645087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.645253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.645280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.645409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.645579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.645604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.645744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.645885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.645912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.533 qpair failed and we were unable to recover it. 00:30:09.533 [2024-11-26 04:41:48.646043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.533 [2024-11-26 04:41:48.646190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.646214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.646333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.646463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.646491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.646603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.646743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.646771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.646886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.646990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.647016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.647128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.647272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.647300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.647459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.647574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.647601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.647740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.647904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.647931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.648171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.648336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.648362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.648509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.648637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.648661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.648785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.648899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.648927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.649105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.649249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.649274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.649428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.649563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.649591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.649733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.649829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.649855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.649997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.650110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.650151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.650278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.650387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.650414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.650584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.650681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.650715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.650833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.650929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.650953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.651054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.651202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.651226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.651371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.651541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.651565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.651705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.651857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.651885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.652044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.652180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.652205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.652334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.652443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.652472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.652636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.652785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.652810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.652934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.653052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.653076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.653235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.653330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.653354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.653534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.653630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.653657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.653799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.653943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.653972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.654113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.654291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.654315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-11-26 04:41:48.654437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.654584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.534 [2024-11-26 04:41:48.654608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.654755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.654888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.654915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.655015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.655146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.655173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.655284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.655426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.655453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.655575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.655715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.655740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.655861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.655972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.655999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.656168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.656301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.656327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.656435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.656537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.656564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.656737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.656831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.656856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.656984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.657143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.657170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.657281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.657440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.657467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.657572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.657707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.657735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.657916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.658038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.658064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.658214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.658354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.658381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.658522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.658625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.658652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.658790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.658961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.658986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.659108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.659230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.659253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.659432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.659534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.659561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.659699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.659861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.659888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.660020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.660147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.660174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.660344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.660473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.660498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.660592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.660716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.660742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.660921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.661056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.661082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.661245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.661380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.661406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.661523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.661647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.661671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.661825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.661942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.661970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.662118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.662274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.662302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.662444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.662577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.662603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.662728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.662852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.535 [2024-11-26 04:41:48.662875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-11-26 04:41:48.663020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.663164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.663191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.663331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.663468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.663496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.663609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.663763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.663799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.663893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.664010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.664033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.664180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.664345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.664373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.664542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.664646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.664674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.664842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.664985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.665008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.665138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.665257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.665281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.665418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.665522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.665550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.665657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.665776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.665803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.665936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.666056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.666080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.666204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.666325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.666349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.666444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.666586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.666612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.666742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.666882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.666909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.667019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.667147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.667174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.667300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.667420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.667444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.667603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.667744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.667771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.667907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.668014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.668042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.668186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.668320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.668347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.668465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.668556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.668580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.668722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.668900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.668925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.669051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.669197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.669224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.669333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.669429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.669456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.669586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.669683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.669713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.536 [2024-11-26 04:41:48.669857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.669986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.536 [2024-11-26 04:41:48.670027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.536 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.670153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.670245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.670286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.670398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.670536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.670560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.670682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.670781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.670805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.670946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.671087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.671113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.671297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.671444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.671467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.671638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.671779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.671808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.671951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.672112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.672136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.672314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.672421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.672449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.672612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.672718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.672746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.672877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.673120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.673145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.673267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.673393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.673418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.673591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.673745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.673769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.673894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.673991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.674015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.674136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.674263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.674287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.674411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.674528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.674551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.674676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.674793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.674820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.674922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.675064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.675088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.675214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.675336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.675361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.675482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.675632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.675656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.675792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.675896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.675922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.676051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.676197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.676221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.676320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.676439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.676478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.676628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.676720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.676746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.676894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.677006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.677035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.677139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.677305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.677329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.677477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.677599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.677626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.677759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.677856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.677879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.537 qpair failed and we were unable to recover it. 00:30:09.537 [2024-11-26 04:41:48.678002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.678126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.537 [2024-11-26 04:41:48.678150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.678321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.678478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.678505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.678671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.678802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.678829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.678972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.679094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.679117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.679236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.679383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.679407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.679559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.679727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.679756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.679967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.680108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.680134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.680272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.680395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.680420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.680558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.680668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.680703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.680826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.680944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.680984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.681148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.681277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.681303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.681442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.681543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.681567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.681698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.681841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.681869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.682001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.682136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.682163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.682272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.682428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.682455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.682576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.682733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.682758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.682905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.683011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.683037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.683202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.683383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.683407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.683512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.683661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.683711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.683893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.684028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.684068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.684206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.684345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.684372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.684521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.684647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.684671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.684799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.684911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.684937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.685078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.685227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.685251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.685372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.685509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.685536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.685679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.685859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.685885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.686005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.686135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.686164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.538 qpair failed and we were unable to recover it. 00:30:09.538 [2024-11-26 04:41:48.686261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.538 [2024-11-26 04:41:48.686414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.686438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.686550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.686692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.686720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.686856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.687020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.687044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.687175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.687295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.687336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.687499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.687657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.687684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.687847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.687968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.687993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.688111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.688235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.688259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.688386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.688528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.688557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.688704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.688827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.688850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.688969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.689103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.689134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.689273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.689408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.689436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.689570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.689667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.689699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.689872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.689992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.690017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.690173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.690341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.690368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.690544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.690633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.690657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.690776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.690912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.690939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.691062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.691181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.691209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.691361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.691499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.691539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.691665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.691812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.691840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.691966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.692137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.692165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.692290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.692414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.692440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.692625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.692713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.692737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.692887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.693038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.693064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.693274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.693466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.693490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.693615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.693734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.693760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.693914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.694059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.694083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.694176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.694297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.694320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.694458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.694589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.539 [2024-11-26 04:41:48.694617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.539 qpair failed and we were unable to recover it. 00:30:09.539 [2024-11-26 04:41:48.694796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.694954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.694997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.540 qpair failed and we were unable to recover it. 00:30:09.540 [2024-11-26 04:41:48.695136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.695270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.695302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.540 qpair failed and we were unable to recover it. 00:30:09.540 [2024-11-26 04:41:48.695438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.695571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.695597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.540 qpair failed and we were unable to recover it. 00:30:09.540 [2024-11-26 04:41:48.695715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.695881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.695908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.540 qpair failed and we were unable to recover it. 00:30:09.540 [2024-11-26 04:41:48.696079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.696183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.696209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.540 qpair failed and we were unable to recover it. 00:30:09.540 [2024-11-26 04:41:48.696339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.696501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.696529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.540 qpair failed and we were unable to recover it. 00:30:09.540 [2024-11-26 04:41:48.696634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.696761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.696788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.540 qpair failed and we were unable to recover it. 00:30:09.540 [2024-11-26 04:41:48.696925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.697061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.540 [2024-11-26 04:41:48.697087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.540 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.697233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.697356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.697382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.697480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.697630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.697658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.697818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.697930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.697954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.698105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.698232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.698258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.698383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.698482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.698506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.698631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.698769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.698810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.698912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.699040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.699067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.699194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.699311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.699334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.699462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.699613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.699653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.699829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.699963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.699991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.700171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.700292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.700319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.700442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.700589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.700613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.700736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.700834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.700858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.823 qpair failed and we were unable to recover it. 00:30:09.823 [2024-11-26 04:41:48.701000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.823 [2024-11-26 04:41:48.701135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.701162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.701335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.701500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.701528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.701666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.701805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.701835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.702020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.702116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.702140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.702252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.702410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.702438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.702541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.702678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.702713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.702823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.702928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.702957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.703112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.703263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.703289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.703416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.703544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.703572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.703739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.703899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.703926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.704042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.704176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.704203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.704379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.704535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.704578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.704717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.704817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.704845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.704978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.705140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.705168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.705271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.705378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.705407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.705527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.705677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.705708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.705824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.705963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.705988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.706089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.706205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.706228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.706324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.706477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.706502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.706628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.706778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.706803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.706941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.707046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.707072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.707224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.707349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.707373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.707496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.707617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.707662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.707819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.707941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.707966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.708056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.708168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.708196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.824 qpair failed and we were unable to recover it. 00:30:09.824 [2024-11-26 04:41:48.708334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.708490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.824 [2024-11-26 04:41:48.708517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.708650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.708802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.708827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.708956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.709050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.709075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.709210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.709361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.709388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.709516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.709619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.709646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.709773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.709900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.709925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.710057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.710155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.710179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.710290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.710422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.710450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.710613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.710748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.710777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.710879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.711043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.711071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.711243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.711421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.711448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.711609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.711719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.711747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.711884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.712014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.712043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.712183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.712317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.712344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.712486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.712603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.712626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.712796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.712932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.712958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.713125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.713263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.713289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.713426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.713551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.713578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.713700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.713790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.713813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.713926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.714029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.714055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.714184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.714345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.714372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.714536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.714644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.714671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.714793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.714922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.714946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.715092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.715229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.715255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.715370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.715527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.715554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.715665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.715774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.715801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.715915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.716015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.716039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.716156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.716327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.716354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.825 [2024-11-26 04:41:48.716491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.716632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.825 [2024-11-26 04:41:48.716660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.825 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.716802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.716901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.716928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.717099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.717225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.717249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.717412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.717558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.717582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.717735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.717846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.717873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.718025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.718175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.718199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.718323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.718453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.718478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.718625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.718758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.718786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.718926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.719100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.719125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.719217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.719317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.719341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.719496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.719605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.719632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.719786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.719907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.719933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.720079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.720230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.720255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.720362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.720461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.720486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.720651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.720772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.720796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.720957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.721058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.721084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.721252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.721415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.721442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.721605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.721720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.721750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.721926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.722077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.722118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.722255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.722387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.722413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.722576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.722735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.722759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.722883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.723001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.723026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.723149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.723271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.723294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.723434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.723566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.723593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.723761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.723900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.723927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.724067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.724200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.724226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.724371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.724498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.724521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.724661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.724800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.826 [2024-11-26 04:41:48.724841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.826 qpair failed and we were unable to recover it. 00:30:09.826 [2024-11-26 04:41:48.724942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.725116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.725140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.725265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.725379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.725406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.725516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.725604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.725629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.725734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.725878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.725905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.726064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.726201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.726226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.726350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.726449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.726474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.726620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.726772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.726815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.726931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.727033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.727060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.727222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.727354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.727382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.727556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.727728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.727754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.727907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.728033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.728073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.728209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.728372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.728398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.728534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.728641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.728668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.728831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.728958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.728999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.729141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.729260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.729285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.729424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.729558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.729583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.729681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.729869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.729896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.730009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.730136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.730162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.730299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.730424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.730448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.730621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.730820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.730876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.731038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.731180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.731210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.731347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.731450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.731477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.731594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.731695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.731722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.731891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.732049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.732075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.732208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.732359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.732383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.732508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.732635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.732659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.827 qpair failed and we were unable to recover it. 00:30:09.827 [2024-11-26 04:41:48.732792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.732917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.827 [2024-11-26 04:41:48.732941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.733056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.733196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.733223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.733328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.733458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.733486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.733629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.733776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.733801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.733951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.734098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.734144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.734274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.734442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.734467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.734594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.734715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.734762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.734898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.735143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.735196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.735312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.735435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.735459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.735584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.735757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.735782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.735870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.735998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.736022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.736123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.736220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.736244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.736342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.736490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.736514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.736653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.736790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.736815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.736940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.737097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.737125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.737224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.737346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.737372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.737494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.737591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.737615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.737764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.737905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.737934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.738096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.738204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.738230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.738370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.738521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.738544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.738664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.738771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.738796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.738961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.739085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.739110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.739246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.739361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.739385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.828 [2024-11-26 04:41:48.739506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.739597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.828 [2024-11-26 04:41:48.739623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.828 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.739792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.739943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.739972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.740120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.740227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.740254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.740420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.740571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.740595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.740738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.740881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.740906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.740999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.741120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.741145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.741315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.741450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.741477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.741610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.741737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.741762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.741898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.742035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.742062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.742232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.742382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.742422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.742559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.742717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.742755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.742865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.743000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.743028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.743207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.743303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.743328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.743452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.743582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.743606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.743705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.743845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.743869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.743962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.744110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.744138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.744271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.744403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.744430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.744545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.744703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.744729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.744873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.745035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.745062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.745182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.745309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.745333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.745446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.745581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.745608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.745716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.745867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.745891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.746051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.746200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.746225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.746332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.746476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.746503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.746645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.746767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.746796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.746945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.747098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.747122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.747300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.747452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.747476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.747602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.747748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.747772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.747914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.748077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.829 [2024-11-26 04:41:48.748104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.829 qpair failed and we were unable to recover it. 00:30:09.829 [2024-11-26 04:41:48.748279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.748402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.748426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.748545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.748662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.748698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.748817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.748963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.748989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.749131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.749292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.749318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.749464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.749555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.749578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.749751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.749870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.749894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.750017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.750104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.750128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.750247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.750372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.750395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.750564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.750660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.750710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.750828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.750952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.750975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.751061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.751161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.751186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.751285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.751418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.751445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.751604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.751727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.751752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.751938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.752072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.752099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.752273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.752419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.752443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.752566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.752724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.752751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.752929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.753028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.753051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.753162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.753293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.753320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.753427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.753590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.753617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.753736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.753872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.753899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.754040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.754167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.754191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.754309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.754410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.754436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.754538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.754678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.754712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.754886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.754992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.755020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.755168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.755301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.755325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.755472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.755582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.755609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.755744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.755845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.755872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.756006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.756115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.756141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.830 qpair failed and we were unable to recover it. 00:30:09.830 [2024-11-26 04:41:48.756269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.830 [2024-11-26 04:41:48.756370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.756393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.756488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.756650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.756674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.756834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.756981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.757008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.757174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.757297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.757321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.757443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.757576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.757600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.757776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.757914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.757941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.758042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.758181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.758209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.758317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.758477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.758503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.758641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.758776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.758800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.758953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.759060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.759086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.759191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.759313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.759339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.759476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.759605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.759632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.759775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.759880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.759904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.760026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.760149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.760192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.760356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.760519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.760544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.760676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.760824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.760848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.760994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.761088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.761112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.761236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.761379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.761406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.761509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.761641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.761668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.761786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.761883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.761922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.762043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.762136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.762159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.762290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.762415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.762441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.762587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.762769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.762795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.762923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.763075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.763099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.763216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.763342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.763369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.763519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.763651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.763677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.763790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.763931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.763954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.764099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.764213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.764238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.831 qpair failed and we were unable to recover it. 00:30:09.831 [2024-11-26 04:41:48.764337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.831 [2024-11-26 04:41:48.764471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.764495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.764638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.764813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.764841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.764975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.765106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.765134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.765311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.765469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.765494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.765615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.765742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.765774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.765934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.766091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.766117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.766229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.766360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.766387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.766564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.766698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.766724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.766849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.766969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.766993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.767110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.767204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.767230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.767331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.767481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.767510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.767678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.767858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.767883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.768036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.768121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.768145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.768269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.768427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.768453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.768589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.768770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.768795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.768882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.768982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.769022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.769198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.769346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.769389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.769553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.769692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.769720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.769854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.770023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.770051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.770243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.770332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.770355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.770477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.770592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.770617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.770755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.770929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.770952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.771071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.771212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.771239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.771342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.771475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.771501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.771671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.771844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.771872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.772008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.772137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.772164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.832 qpair failed and we were unable to recover it. 00:30:09.832 [2024-11-26 04:41:48.772274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.772415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.832 [2024-11-26 04:41:48.772440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.772566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.772716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.772743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.772862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.773013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.773036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.773185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.773316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.773344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.773486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.773621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.773648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.773794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.773959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.773985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.774127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.774247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.774271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.774401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.774501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.774529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.774640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.774784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.774812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.774963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.775086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.775109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.775234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.775349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.775373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.775522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.775663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.775717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.775888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.776053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.776078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.776209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.776378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.776404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.776575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.776701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.776726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.776882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.777042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.777069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.777235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.777371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.777398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.777506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.777675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.777705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.777858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.777952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.777977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.778125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.778254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.778282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.778422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.778564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.778590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.778701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.778814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.778843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.778997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.779148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.779172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.779272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.779413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.779439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.779578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.779743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.779771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.779895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.780000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.780026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.833 qpair failed and we were unable to recover it. 00:30:09.833 [2024-11-26 04:41:48.780146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.780273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.833 [2024-11-26 04:41:48.780297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.780469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.780606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.780633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.780767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.780867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.780894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.781001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.781177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.781201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.781352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.781473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.781497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.781647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.781785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.781817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.781944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.782076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.782103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.782265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.782425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.782452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.782607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.782728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.782753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.782849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.782969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.782993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.783139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.783310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.783334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.783490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.783664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.783698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.783828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.783941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.783965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.784053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.784201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.784228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.784363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.784524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.784551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.784724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.784853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.784881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.785004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.785121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.785145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.785288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.785426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.785453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.785620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.785770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.785795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.785923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.786075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.786102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.786278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.786436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.786461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.786636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.786755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.786780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.786906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.787046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.787073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.787212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.787389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.787413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.787536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.787660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.787706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.787852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.787987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.788020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.788193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.788301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.788327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.788460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.788599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.788626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.834 qpair failed and we were unable to recover it. 00:30:09.834 [2024-11-26 04:41:48.788746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.788847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.834 [2024-11-26 04:41:48.788871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.788960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.789083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.789107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.789226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.789340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.789369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.789469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.789577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.789605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.789753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.789851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.789876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.790026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.790169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.790196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.790331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.790435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.790461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.790561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.790699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.790740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.790876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.791000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.791025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.791153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.791275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.791300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.791440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.791573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.791600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.791706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.791832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.791896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.792038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.792188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.792212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.792363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.792460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.792488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.792628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.792791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.792818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.792961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.793200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.793253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.793404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.793526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.793550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.793697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.793861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.793888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.794030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.794166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.794193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.794323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.794483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.794510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.794660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.794784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.794808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.794931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.795069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.795095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.795224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.795361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.795387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.795517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.795611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.795637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.795770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.795899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.795923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.796092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.796226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.796252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.796390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.796502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.796529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.796713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.796837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.796861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.835 [2024-11-26 04:41:48.796956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.797070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.835 [2024-11-26 04:41:48.797095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.835 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.797235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.797375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.797402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.797562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.797739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.797764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.797872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.797967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.797990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.798154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.798274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.798297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.798440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.798549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.798575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.798683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.798827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.798850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.798969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.799106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.799132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.799307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.799435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.799459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.799566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.799678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.799716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.799853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.799973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.800001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.800134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.800294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.800321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.800483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.800588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.800612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.800735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.800829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.800852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.800952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.801071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.801097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.801245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.801417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.801440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.801563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.801709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.801734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.801887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.802000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.802026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.802167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.802304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.802331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.802465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.802625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.802652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.802782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.802884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.802908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.803033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.803205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.803232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.803403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.803549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.803574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.803723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.803887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.803914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.804062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.804184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.804208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.804346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.804522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.804545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.804705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.804829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.804856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.804956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.805131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.805182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.836 [2024-11-26 04:41:48.805323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.805421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.836 [2024-11-26 04:41:48.805462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.836 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.805594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.805704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.805744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.805877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.806014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.806041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.806167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.806296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.806322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.806461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.806583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.806607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.806747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.806887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.806915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.807086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.807196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.807223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.807387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.807493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.807519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.807663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.807821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.807846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.807971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.808117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.808143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.808250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.808384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.808410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.808542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.808675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.808712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.808858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.808975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.808999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.809113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.809246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.809273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.809402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.809532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.809559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.809700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.809864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.809891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.810033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.810147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.810171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.810307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.810441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.810472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.810574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.810674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.810707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.810809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.810952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.810978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.811104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.811253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.811277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.811429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.811534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.811562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.811737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.811830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.811856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.811999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.812149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.812173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.812301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.812424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.812448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.837 [2024-11-26 04:41:48.812590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.812710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.837 [2024-11-26 04:41:48.812739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.837 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.812882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.812994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.813021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.813191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.813353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.813380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.813522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.813642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.813668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.813828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.813962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.813988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.814098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.814196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.814224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.814358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.814494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.814521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.814664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.814769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.814794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.814903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.815059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.815083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.815267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.815389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.815413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.815551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.815695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.815723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.815868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.815989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.816016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.816164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.816315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.816338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.816485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.816651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.816677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.816836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.816931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.816955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.817075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.817197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.817223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.817351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.817484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.817511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.817647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.817769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.817797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.817936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.818071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.818100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.818221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.818345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.818369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.818533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.818684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.818714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.818866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.818999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.819026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.819168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.819305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.819332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.819452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.819543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.819568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.819732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.819872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.819899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.820036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.820181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.820208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.820380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.820510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.820536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.820673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.820839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.820865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.821023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.821150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.838 [2024-11-26 04:41:48.821176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.838 qpair failed and we were unable to recover it. 00:30:09.838 [2024-11-26 04:41:48.821285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.821448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.821476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.821603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.821766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.821794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.821935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.822099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.822122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.822286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.822436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.822461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.822622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.822764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.822792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.822929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.823098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.823124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.823267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.823391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.823415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.823517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.823637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.823677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.823797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.823933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.823960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.824122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.824284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.824311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.824462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.824589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.824614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.824710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.824833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.824858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.825032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.825190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.825217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.825324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.825456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.825483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.825632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.825784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.825827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.825963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.826127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.826154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.826290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.826420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.826445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.826608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.826758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.826783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.826939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.827061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.827090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.827235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.827370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.827394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.827500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.827586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.827610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.827760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.827909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.827936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.828054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.828182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.828206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.828296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.828422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.828447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.828536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.828671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.828712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.828828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.828948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.828990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.829108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.829221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.829245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.829382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.829529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.839 [2024-11-26 04:41:48.829554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.839 qpair failed and we were unable to recover it. 00:30:09.839 [2024-11-26 04:41:48.829702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.829880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.829908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.830040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.830153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.830180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.830325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.830454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.830479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.830651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.830785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.830810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.830932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.831029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.831053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.831188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.831325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.831355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.831523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.831646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.831670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.831793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.831951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.831977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.832085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.832190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.832216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.832321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.832492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.832516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.832643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.832750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.832778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.832952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.833081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.833108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.833276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.833417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.833443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.833565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.833733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.833762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.833887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.834006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.834030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.834133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.834270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.834298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.834438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.834574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.834601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.834733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.834872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.834899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.835073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.835191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.835214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.835366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.835464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.835491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.835662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.835839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.835872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.835983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.836099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.836126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.836281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.836383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.836409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.836554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.836690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.836718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.836855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.836989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.837015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.837191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.837366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.837393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.837554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.837663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.837698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.837846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.837946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.837970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.840 qpair failed and we were unable to recover it. 00:30:09.840 [2024-11-26 04:41:48.838063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.838189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.840 [2024-11-26 04:41:48.838213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.838333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.838463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.838490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.838632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.838728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.838752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.838897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.839032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.839059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.839196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.839302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.839328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.839492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.839637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.839663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.839843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.839970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.840009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.840179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.840295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.840319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.840459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.840558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.840586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.840728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.840865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.840890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.841035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.841153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.841177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.841356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.841472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.841496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.841618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.841800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.841829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.841967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.842080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.842109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.842262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.842388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.842412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.842558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.842648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.842672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.842822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.842936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.842964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.843098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.843226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.843253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.843375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.843526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.843551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.843700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.843808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.843834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.844010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.844166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.844190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.844331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.844463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.844491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.844638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.844788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.844814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.844979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.845088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.845114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.845248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.845378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.845404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.845546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.845645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.845671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.845820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.845947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.845971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.846096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.846227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.846254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.841 [2024-11-26 04:41:48.846391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.846526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.841 [2024-11-26 04:41:48.846553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.841 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.846716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.846862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.846887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.847039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.847164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.847204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.847369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.847513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.847536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.847659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.847780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.847809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.847945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.848076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.848104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.848225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.848316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.848341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.848511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.848654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.848679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.848812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.848968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.848991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.849111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.849284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.849310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.849428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.849524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.849548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.849701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.849820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.849845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.849967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.850069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.850096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.850227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.850327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.850355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.850501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.850627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.850651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.850788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.850891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.850917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.851064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.851232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.851258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.851392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.851536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.851559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.851680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.851841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.851883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.851991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.852153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.852180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.852290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.852453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.852480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.852654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.852799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.852827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.853000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.853125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.853149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.853272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.853411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.853437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.853578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.853675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.842 [2024-11-26 04:41:48.853709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.842 qpair failed and we were unable to recover it. 00:30:09.842 [2024-11-26 04:41:48.853885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.854018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.854045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.854191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.854279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.854303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.854415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.854539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.854566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.854675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.854853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.854880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.855015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.855142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.855169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.855278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.855390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.855415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.855535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.855674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.855712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.855817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.855969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.855993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.856142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.856253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.856279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.856440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.856571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.856597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.856756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.856878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.856903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.857055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.857173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.857197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.857325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.857451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.857475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.857569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.857695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.857720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.857859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.857963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.857989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.858120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.858300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.858324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.858419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.858517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.858542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.858644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.858784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.858810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.858954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.859050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.859077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.859222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.859373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.859397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.859495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.859648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.859674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.859832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.859947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.859971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.860137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.860297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.860324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.860457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.860560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.860589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.860730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.860878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.860902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.861001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.861098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.861123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.861223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.861339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.861366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.861537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.861704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.861728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.843 qpair failed and we were unable to recover it. 00:30:09.843 [2024-11-26 04:41:48.861858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.843 [2024-11-26 04:41:48.861946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.861970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.862118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.862286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.862312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.862433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.862579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.862606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.862712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.862854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.862878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.863024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.863157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.863184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.863300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.863448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.863473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.863629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.863762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.863791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.863918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.864049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.864076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.864236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.864358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.864385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.864507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.864655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.864680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.864818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.864992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.865016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.865114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.865249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.865276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.865435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.865545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.865574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.865749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.865849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.865873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.865996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.866168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.866192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.866325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.866498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.866525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.866703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.866818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.866843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.866964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.867088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.867112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.867282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.867420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.867445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.867572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.867742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.867770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.867907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.868014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.868043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.868161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.868248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.868273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.868415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.868521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.868548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.868680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.868794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.868821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.868956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.869085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.869112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.869260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.869409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.869433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.869576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.869714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.869742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.869845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.869976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.870004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.844 qpair failed and we were unable to recover it. 00:30:09.844 [2024-11-26 04:41:48.870120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.870221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.844 [2024-11-26 04:41:48.870248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.870388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.870509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.870533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.870673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.870808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.870836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.870937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.871062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.871089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.871225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.871362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.871389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.871561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.871659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.871684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.871806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.871950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.871977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.872106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.872207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.872234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.872345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.872480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.872507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.872625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.872790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.872814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.872918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.873037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.873060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.873160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.873310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.873334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.873446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.873611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.873638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.873771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.873901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.873925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.874069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.874229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.874261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.874411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.874559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.874582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.874733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.875003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.875059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.875204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.875331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.875354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.875477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.875617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.875643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.875829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.875976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.876000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.876146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.876283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.876312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.876459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.876606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.876630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.876819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.876964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.876988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.877113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.877260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.877288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.877452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.877583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.877614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.877719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.877864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.877889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.877996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.878149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.878174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.878286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.878434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.878458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.845 [2024-11-26 04:41:48.878580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.878724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.845 [2024-11-26 04:41:48.878753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.845 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.878905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.879028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.879053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.879180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.879322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.879345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.879496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.879664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.879697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.879837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.879974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.880001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.880151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.880301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.880325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.880504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.880699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.880733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.880881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.881027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.881054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.881191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.881328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.881355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.881476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.881564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.881588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.881691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.881817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.881840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.882008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.882180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.882206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.882342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.882518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.882543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.882710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.882886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.882914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.883050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.883193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.883220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.883366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.883465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.883490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.883675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.883842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.883869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.884034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.884127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.884152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.884264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.884403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.884429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.884566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.884711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.884738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.884862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.884994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.885017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.885143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.885269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.885292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.885473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.885627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.885652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.885794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.885942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.885966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.846 qpair failed and we were unable to recover it. 00:30:09.846 [2024-11-26 04:41:48.886087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.886342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.846 [2024-11-26 04:41:48.886407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.886554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.886653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.886678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.886810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.886938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.886962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.887109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.887242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.887268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.887408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.887524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.887550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.887702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.887804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.887827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.887990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.888125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.888150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.888329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.888451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.888477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.888648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.888764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.888792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.888932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.889053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.889078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.889225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.889347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.889371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.889493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.889611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.889635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.889731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.889959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.890022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.890205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.890356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.890397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.890536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.890641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.890669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.890832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.890921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.890945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.891150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.891281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.891307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.891456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.891570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.891594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.891711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.891872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.891898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.892035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.892161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.892188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.892350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.892500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.892525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.892618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.892767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.892792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.892909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.893041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.893069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.893207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.893336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.893363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.893522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.893666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.893696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.893824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.893952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.893975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.847 [2024-11-26 04:41:48.894141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.894260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.847 [2024-11-26 04:41:48.894283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.847 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.894374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.894509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.894532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.894682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.894802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.894829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.894976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.895099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.895123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.895308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.895436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.895460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.895606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.895746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.895771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.895870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.895969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.895993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.896121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.896224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.896247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.896382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.896521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.896547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.896660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.896803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.896827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.896925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.897019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.897042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.897164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.897283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.897306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.897454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.897589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.897616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.897732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.897831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.897855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.897948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.898122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.898148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.898293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.898412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.898436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.898580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.898741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.898769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.898877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.898995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.899019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.899138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.899271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.899295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.899390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.899476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.899500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.899620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.899761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.899789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.899916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.900075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.900102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.900205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.900371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.900399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.900510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.900631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.900656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.900812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.900975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.901001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.901110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.901225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.901250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.901349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.901436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.901460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.901600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.901738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.901764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.848 qpair failed and we were unable to recover it. 00:30:09.848 [2024-11-26 04:41:48.901940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.848 [2024-11-26 04:41:48.902072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.902100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.902237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.902379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.902404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.902526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.902645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.902670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.902801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.902897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.902921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.903047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.903183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.903211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.903351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.903494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.903518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.903658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.903786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.903811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.903932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.904046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.904071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.904194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.904299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.904326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.904467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.904572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.904599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.904748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.904849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.904875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.905007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.905130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.905155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.905301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.905464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.905491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.905659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.905794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.905819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.905984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.906137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.906162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.906286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.906437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.906461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.906577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.906705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.906733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.906847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.906977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.907004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.907142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.907278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.907305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.907415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.907517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.907542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.907696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.907831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.907858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.907986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.908085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.908112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.908213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.908343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.908370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.908479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.908630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.908655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.908830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.908981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.909005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.909158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.909300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.909327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.909470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.909609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.909636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.909763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.909886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.909911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.849 qpair failed and we were unable to recover it. 00:30:09.849 [2024-11-26 04:41:48.910033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.910147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.849 [2024-11-26 04:41:48.910176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.910314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.910456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.910484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.910591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.910699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.910728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.910876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.911026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.911050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.911209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.911372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.911399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.911500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.911631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.911658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.911810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.911936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.911976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.912101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.912253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.912278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.912397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.912534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.912561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.912718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.912812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.912837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.912934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.913030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.913054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.913192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.913350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.913374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.913497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.913662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.913696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.913842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.913963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.913988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.914078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.914197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.914235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.914383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.914539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.914564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.914726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.914828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.914855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.914965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.915060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.915089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.915199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.915320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.915347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.915461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.915606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.915633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.915759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.915882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.915906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.916048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.916230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.916254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.916383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.916476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.916500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.916608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.916754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.916778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.916880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.916981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.917005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.917158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.917319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.917345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.917482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.917590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.917618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.917761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.917906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.917930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.850 [2024-11-26 04:41:48.918068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.918199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.850 [2024-11-26 04:41:48.918226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.850 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.918359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.918464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.918492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.918629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.918821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.918847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.918968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.919119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.919147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.919267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.919378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.919405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.919508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.919679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.919713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.919827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.919925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.919949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.920041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.920139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.920162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.920256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.920378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.920405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.920509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.920633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.920659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.920777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.920902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.920925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.921063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.921195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.921221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.921375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.921526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.921552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.921682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.921828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.921858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.922002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.922141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.922168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.922283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.922405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.922428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.922576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.922718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.922746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.922879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.923012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.923038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.923185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.923324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.923350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.923511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.923652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.923679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.923831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.923933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.923972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.924131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.924233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.924260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.924438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.924597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.924621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.924774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.924873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.924903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.925049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.925182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.925211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.851 qpair failed and we were unable to recover it. 00:30:09.851 [2024-11-26 04:41:48.925373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.851 [2024-11-26 04:41:48.925487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.925513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.925645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.925772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.925796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.925945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.926109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.926136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.926244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.926381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.926409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.926575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.926729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.926755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.926914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.927015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.927056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.927230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.927380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.927421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.927523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.927695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.927737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.927884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.928030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.928063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.928199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.928340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.928367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.928525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.928631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.928657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.928787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.928936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.928960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.929068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.929227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.929253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.929391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.929535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.929561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.929672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.929797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.929821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.929945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.930041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.930064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.930189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.930315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.930341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.930494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.930608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.930632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.930759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.930853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.930878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.931011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.931185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.931212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.931377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.931505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.931531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.931709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.931856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.931880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.932041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.932165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.932206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.932345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.932481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.932505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.932616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.932798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.932823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.932927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.933083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.933168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.933367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.933527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.933554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.933698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.933868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.933892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.852 [2024-11-26 04:41:48.934009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.934126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.852 [2024-11-26 04:41:48.934152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.852 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.934293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.934456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.934482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.934599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.934747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.934773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.934889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.935020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.935047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.935178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.935324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.935351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.935520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.935636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.935663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.935787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.935938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.935961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.936111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.936255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.936279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.936404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.936544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.936571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.936738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.936866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.936891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.937065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.937210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.937251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.937371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.937478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.937504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.937665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.937819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.937844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.938012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.938148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.938175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.938375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.938517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.938544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.938669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.938798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.938823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.938914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.939069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.939095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.939231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.939371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.939399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.939540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.939668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.939701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.939841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.939976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.940003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.940136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.940263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.940290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.940459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.940593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.940619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.940773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.940900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.940924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.941064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.941250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.941274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.941427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.941570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.941596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.941748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.941897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.941921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.942113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.942343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.942399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.942540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.942671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.942705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.942842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.942967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.853 [2024-11-26 04:41:48.942991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.853 qpair failed and we were unable to recover it. 00:30:09.853 [2024-11-26 04:41:48.943155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.943286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.943313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.943456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.943553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.943578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.943769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.943892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.943916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.944066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.944180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.944207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.944342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.944487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.944512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.944625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.944780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.944805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.944957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.945100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.945144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.945271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.945440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.945465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.945623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.945742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.945766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.945907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.946039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.946065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.946169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.946341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.946368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.946509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.946616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.946643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.946799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.946895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.946920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.947045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.947139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.947165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.947288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.947388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.947416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.947550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.947682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.947730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.947833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.947954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.947979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.948129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.948251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.948275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.948434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.948535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.948562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.948701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.948824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.948848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.948954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.949077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.949102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.949227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.949349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.949373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.949502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.949604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.949632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.949757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.949858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.949883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.950027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.950159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.950188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.950314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.950487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.950514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.950648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.950776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.950800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.950925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.951048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.951072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.854 qpair failed and we were unable to recover it. 00:30:09.854 [2024-11-26 04:41:48.951199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.854 [2024-11-26 04:41:48.951300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.951342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.951503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.951631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.951657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.951833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.951923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.951948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.952104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.952267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.952294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.952437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.952577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.952604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.952748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.952871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.952896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.953045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.953179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.953205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.953334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.953464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.953491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.953618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.953768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.953793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.953892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.953983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.954008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.954138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.954229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.954271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.954381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.954477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.954503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.954641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.954796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.954821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.954916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.955032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.955055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.955207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.955340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.955366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.955535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.955666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.955717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.955863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.955994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.956020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.956195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.956342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.956384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.956493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.956598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.956626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.956735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.956898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.956922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.957065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.957196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.957223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.957368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.957472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.957495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.957625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.957728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.957752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.957848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.957970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.958014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.958243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.958435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.958462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.958628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.958756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.958780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.958902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.958987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.959011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.855 [2024-11-26 04:41:48.959129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.959236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.855 [2024-11-26 04:41:48.959262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.855 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.959427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.959591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.959618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.959737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.959864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.959887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.960029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.960162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.960190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.960324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.960481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.960507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.960681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.960806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.960829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.960979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.961107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.961147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.961285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.961439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.961480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.961641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.961823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.961848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.962021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.962223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.962275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.962451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.962615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.962638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.962732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.962864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.962889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.963030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.963162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.963203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.963380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.963537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.963565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.963714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.963843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.963867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.964025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.964132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.964159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.964317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.964478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.964504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.964628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.964734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.964761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.964936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.965060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.965100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.965210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.965378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.965404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.965531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.965654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.965681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.965801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.965929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.965953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.966166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.966264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.966288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.966446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.966605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.966631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.966780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.966920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.966944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.856 qpair failed and we were unable to recover it. 00:30:09.856 [2024-11-26 04:41:48.967161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.967327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.856 [2024-11-26 04:41:48.967354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.967554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.967691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.967718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.967871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.968005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.968036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.968146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.968274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.968301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.968412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.968540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.968567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.968708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.968834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.968858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.969002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.969136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.969165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.969340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.969459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.969483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.969632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.969784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.969810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.969912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.970029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.970054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.970180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.970268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.970292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.970474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.970605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.970633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.970754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.970881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.970909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.971054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.971193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.971219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.971370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.971508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.971534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.971671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.971793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.971818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.971912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.972041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.972065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.972164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.972258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.972282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.972414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.972561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.972585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.972730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.972893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.972918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.973052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.973179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.973204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.973354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.973508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.973547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.973697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.973837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.973866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.973959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.974114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.974140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.974259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.974416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.974443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.974564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.974747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.974771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.974925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.975069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.975095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.975252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.975377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.975404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.857 qpair failed and we were unable to recover it. 00:30:09.857 [2024-11-26 04:41:48.975513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.975620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.857 [2024-11-26 04:41:48.975646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.975803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.975894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.975918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.976035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.976170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.976197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.976356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.976519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.976546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.976695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.976856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.976888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.977065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.977187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.977210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.977324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.977486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.977513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.977630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.977731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.977757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.977881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.978028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.978056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.978227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.978326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.978351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.978504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.978636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.978663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.978813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.978956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.978984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.979176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.979298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.979323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.979457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.979575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.979599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.979781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.979920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.979948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.980065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.980222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.980271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.980531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.980681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.980716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.980835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.980967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.980991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.981083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.981173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.981197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.981322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.981464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.981491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.981597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.981734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.981762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.981883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.982003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.982027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.982135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.982234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.982258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.982425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.982581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.982605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.982756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.982869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.982895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.983020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.983150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.983175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.983266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.983359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.983384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.983509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.983682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.983733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.983865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.983958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.858 [2024-11-26 04:41:48.983982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.858 qpair failed and we were unable to recover it. 00:30:09.858 [2024-11-26 04:41:48.984110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.984198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.984223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.984369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.984497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.984524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.984634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.984770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.984798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.984933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.985043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.985072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.985217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.985369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.985393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.985583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.985700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.985725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.985868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.986008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.986037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.986269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.986359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.986385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.986509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.986615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.986640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.986792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.986894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.986918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.987008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.987097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.987122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.987255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.987422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.987449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.987574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.987727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.987752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.987879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.988001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.988025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.988121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.988220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.988245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.988340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.988456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.988480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.988629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.988728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.988753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.988906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.989015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.989042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.989194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.989282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.989307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.989428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.989548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.989572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.989667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.989766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.989791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.989922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.990056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.990082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.990187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.990353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.990377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.990501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.990616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.990642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.990765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.990891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.990914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.991074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.991195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.991218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.991348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.991520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.859 [2024-11-26 04:41:48.991551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.859 qpair failed and we were unable to recover it. 00:30:09.859 [2024-11-26 04:41:48.991691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.991839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.991863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.991990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.992113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.992139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.992289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.992392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.992419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.992581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.992691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.992718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.992867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.992957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.992980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.993106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.993228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.993251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.993422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.993552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.993576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.993728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.993837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.993865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.993999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.994166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.994193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.994337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.994483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.994507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.994707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.994846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.994871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.995035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.995151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.995177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.995315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.995452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.995479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.995597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.995717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.995742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.995845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.995960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.995987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.996129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.996243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.996270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.996446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.996563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.996586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.996740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.996859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.996882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.997052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.997174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.997199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.997372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.997532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.997559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.997724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.997900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.997964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.998149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.998243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.998268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.998405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.998542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.998571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.998706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.998844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.998870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.999043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.999314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.999338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.999466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.999591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.999615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.860 qpair failed and we were unable to recover it. 00:30:09.860 [2024-11-26 04:41:48.999708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.999888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.860 [2024-11-26 04:41:48.999914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.000078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.000247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.000272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.000398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.000497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.000521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.000646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.000746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.000771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.000915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.001077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.001105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.001204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.001335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.001362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.001515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.001635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.001659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.001768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.001893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.001918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.002065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.002200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.002227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.002368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.002509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.002536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.002671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.002819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.002859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.002982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.003073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.003096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.003236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.003370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.003395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.003532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.003664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.003699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.003797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.003941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.003973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.004145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.004243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.004267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.004403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.004504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.004530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.004699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.004815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.004839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.004935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.005055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.005095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.005244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.005350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.005374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.005517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.005657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.005683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.005839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.005934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.005962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.006097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.006196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.006224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.006412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.006529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.006569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.006694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.006845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.006869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.006996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.007084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.007109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.861 qpair failed and we were unable to recover it. 00:30:09.861 [2024-11-26 04:41:49.007209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.861 [2024-11-26 04:41:49.007306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.007347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.007500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.007620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.007644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.007806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.007941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.007968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.008108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.008247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.008274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.008436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.008551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.008577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.008693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.008840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.008864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.009028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.009157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.009185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.009304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.009422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.009447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.009589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.009766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.009791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.009919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.010069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.010094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.010251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.010389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.010416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.010528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.010661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.010695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.010837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.010946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.010974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.011105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.011224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.011248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.011366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.011525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.011552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.011690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.011799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.011827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.011943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.012035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.012059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.012188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.012304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.012328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.012471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.012602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.012628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.012780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.012877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.012902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.013055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.013160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.013188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.013344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.013497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.013522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.013637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.013764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.013792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.013968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.014094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.014118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.014233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.014369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.014395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.014558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.014717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.014761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.014861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.014963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.014987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.015082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.015231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.015255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.015396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.015555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.862 [2024-11-26 04:41:49.015579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.862 qpair failed and we were unable to recover it. 00:30:09.862 [2024-11-26 04:41:49.015704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.015833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.015858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.016045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.016164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.016188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.016299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.016434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.016462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.016609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.016730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.016755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.016847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.016964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.016988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.017118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.017271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.017295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.017404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.017590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.017614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.017714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.017837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.017878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.017993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.018111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.018135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.018238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.018343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.018370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.018501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.018596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.018625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.018749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.018888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.018916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.019060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.019183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.019208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.019328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.019455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.019482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.019624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.019722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.019750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.019860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.020039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.020063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.020162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.020280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.020304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.020434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.020567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.020594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.020777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.020899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.020923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.021089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.021212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.021236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.021358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.021475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.021500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.021659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.021795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.021823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.021923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.022056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.022083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.022184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.022292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.022319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.022462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.022558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.863 [2024-11-26 04:41:49.022582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:09.863 qpair failed and we were unable to recover it. 00:30:09.863 [2024-11-26 04:41:49.022734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.022845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.022873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.023006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.023137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.023165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.023297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.023400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.023428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.023572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.023661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.023693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.023866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.023975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.024001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.024136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.024308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.024332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.024434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.024521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.024545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.024700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.024797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.024822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.024945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.025088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.025113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.025248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.025385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.025412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.025544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.025683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.025716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.025813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.025909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.025933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.026032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.026120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.026143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.026309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.026459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.026483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.026636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.026747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.026775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.026917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.027032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.027056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.027176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.027350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.027374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.027465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.027604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.027631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.027744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.027849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.027878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.028007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.028106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.028131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.028231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.028371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.028398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.028532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.028673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.028713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.028842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.028941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.028967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.029086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.029212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.029236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.029358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.029447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.029473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.029579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.029750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.029775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.029898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.030016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.030045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.030201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.030326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.030350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.030454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.030602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.030631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.030769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.030890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.030915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.031030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.031143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.031170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.031328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.031450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.031475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.031565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.031710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.031738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.031876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.032020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.032044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.032144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.032309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.032335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.032500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.032594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.032618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.032722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.032845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.032891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.033001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.033126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.033153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.033292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.033438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.033462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.033613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.033703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.033728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.033849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.033978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.034006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.034146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.034282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.034309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.034419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.034533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.034558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.034726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.034823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.034849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.034940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.035040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.035064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.035187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.035351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.035378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.035534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.035655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.035679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.035795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.035917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.185 [2024-11-26 04:41:49.035941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.185 qpair failed and we were unable to recover it. 00:30:10.185 [2024-11-26 04:41:49.036073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.036208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.036235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.036338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.036477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.036501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.036592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.036717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.036742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.036871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.036960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.036984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.037093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.037223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.037250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.037390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.037496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.037523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.037634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.037747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.037775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.037949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.038100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.038143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.038240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.038412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.038436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.038592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.038738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.038766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.038869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.039007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.039034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.039183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.039280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.039305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.039454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.039577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.039605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.039748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.039879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.039906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.040048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.040219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.040245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.040414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.040502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.040526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.040678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.040866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.040893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.041030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.041141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.041170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.041328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.041486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.041513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.041661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.041834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.041859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.041975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.042109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.042136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.042262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.042398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.042425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.042531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.042631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.042658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.042804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.042898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.042923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.043057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.043159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.043186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.043349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.043487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.043514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.043652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.043816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.043841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.043934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.044034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.044058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.044157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.044339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.044366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.044498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.044662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.044702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.044869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.045033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.045083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.045231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.045332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.045356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.045479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.045623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.045650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.045801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.045896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.045920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.046090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.046223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.046250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.046399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.046488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.046512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.046629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.046768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.046793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.046918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.047034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.047061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.047210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.047387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.047414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.047587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.047682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.047713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.047869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.048001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.048028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.048166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.048265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.048292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.048407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.048544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.048571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.048715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.048810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.048834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.048978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.049107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.049133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.049238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.049337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.049363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.049543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.049661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.049691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.049845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.049949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.049974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.050125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.050241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.050268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.050362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.050522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.050549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.050663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.050786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.050811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.050914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.051037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.051061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.051174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.051310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.051337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.051473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.051579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.186 [2024-11-26 04:41:49.051606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.186 qpair failed and we were unable to recover it. 00:30:10.186 [2024-11-26 04:41:49.051746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.051854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.051881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.052032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.052152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.052176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.052327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.052476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.052500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.052601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.052720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.052762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.052869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.053002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.053028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.053173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.053265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.053289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.053432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.053598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.053622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.053723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.053895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.053923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.054088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.054284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.054311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.054417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.054542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.054566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.054663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.054764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.054788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.054903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.055043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.055070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.055178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.055309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.055337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.055459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.055577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.055601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.055744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.055873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.055900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.056031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.056175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.056200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.056291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.056389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.056428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.056628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.056772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.056797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.056890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.056989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.057013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.057168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.057290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.057318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.057417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.057541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.057568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.057709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.057830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.057854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.057975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.058071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.058098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.058231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.058366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.058393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.058556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.058654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.058681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.058833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.058959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.058983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.059152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.059286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.059318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.059450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.059560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.059587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.059727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.059860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.059887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.060038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.060131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.060156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.060321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.060477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.060501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.060665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.060769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.060798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.060937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.061132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.061186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.061329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.061442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.061466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.061620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.061711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.061736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.061865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.062001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.062028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.062197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.062343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.062367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.062525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.062644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.062669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.062798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.062899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.062926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.063073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.063206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.063231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.063397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.063497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.063524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.187 qpair failed and we were unable to recover it. 00:30:10.187 [2024-11-26 04:41:49.063677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.187 [2024-11-26 04:41:49.063848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.063873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.063998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.064087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.064112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.064236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.064381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.064405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.064540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.064656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.064680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.064811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.064925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.064949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.065069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.065183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.065207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.065307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.065426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.065450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.065584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.065737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.065762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.065884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.066011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.066035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.066178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.066308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.066335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.066476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.066607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.066634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.066753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.066869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.066893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.066992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.067139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.067163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.067278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.067410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.067437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.067571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.067669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.067705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.067816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.067962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.067986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.068136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.068272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.068300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.068457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.068594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.068621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.068767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.068886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.068911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.069119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.069284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.069334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.069489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.069651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.069678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.069831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.069958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.070000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.070164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.070299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.070326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.070463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.070594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.070621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.070764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.070890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.070915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.071057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.071185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.071212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.071344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.071465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.071493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.071637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.071784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.071810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.071941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.072094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.072118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.072274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.072430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.072454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.072601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.072752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.072777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.072884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.072983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.073010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.073200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.073331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.073357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.073492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.073626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.073654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.073775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.073874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.073899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.074022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.074172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.074199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.074371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.074503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.074535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.074683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.074814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.074838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.074956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.075123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.075150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.075280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.075387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.075414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.075582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.075757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.075782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.075890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.076022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.076046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.076142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.076318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.076345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.076509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.076646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.076672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.076831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.076920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.076945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.077055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.077223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.077251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.077346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.077486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.077514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.077683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.077836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.077862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.077992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.078198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.078256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.188 [2024-11-26 04:41:49.078362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.078480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.188 [2024-11-26 04:41:49.078507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.188 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.078644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.078787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.078812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.078928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.079105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.079146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.079287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.079429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.079455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.079590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.079703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.079737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.079891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.080062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.080089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.080221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.080355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.080382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.080585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.080765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.080790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.080894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.081001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.081030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.081172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.081335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.081363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.081493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.081626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.081654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.081839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.081935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.081960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.082142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.082269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.082293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.082443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.082583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.082607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.082733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.082885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.082909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.083006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.083167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.083192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.083369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.083508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.083535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.083635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.083759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.083784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.083908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.084069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.084094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.084269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.084397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.084424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.084532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.084662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.084710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.084824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.084940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.084965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.085077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.085213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.085240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.085361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.085448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.085473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.085561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.085694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.085722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3045040 Killed "${NVMF_APP[@]}" "$@" 00:30:10.189 [2024-11-26 04:41:49.085888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.086032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.086058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.086166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 04:41:49 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:10.189 [2024-11-26 04:41:49.086329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.086357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 04:41:49 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:10.189 [2024-11-26 04:41:49.086463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 04:41:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:10.189 [2024-11-26 04:41:49.086615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.086645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 04:41:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:10.189 [2024-11-26 04:41:49.086780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.086911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 04:41:49 -- common/autotest_common.sh@10 -- # set +x 00:30:10.189 [2024-11-26 04:41:49.086939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.087048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.087153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.087180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.087296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.087478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.087503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.087650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.087749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.087774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.087948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.088044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.088071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.088188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.088330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.088357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.088482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.088620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.088645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.088804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.088921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.088948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.089093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.089183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.089208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.089376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.089516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.089548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.089701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.089803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.089829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.089988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.090090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.090118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.090253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 04:41:49 -- nvmf/common.sh@469 -- # nvmfpid=3045631 00:30:10.189 04:41:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:10.189 [2024-11-26 04:41:49.090872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.090908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 04:41:49 -- nvmf/common.sh@470 -- # waitforlisten 3045631 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.091059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 04:41:49 -- common/autotest_common.sh@829 -- # '[' -z 3045631 ']' 00:30:10.189 [2024-11-26 04:41:49.091216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.091246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 04:41:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:10.189 [2024-11-26 04:41:49.091427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 04:41:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:10.189 [2024-11-26 04:41:49.091523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.091548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 04:41:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:10.189 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:10.189 [2024-11-26 04:41:49.091703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 04:41:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:10.189 [2024-11-26 04:41:49.091815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.091843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 04:41:49 -- common/autotest_common.sh@10 -- # set +x 00:30:10.189 [2024-11-26 04:41:49.092006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.092494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.092527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.189 qpair failed and we were unable to recover it. 00:30:10.189 [2024-11-26 04:41:49.092679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.093214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.189 [2024-11-26 04:41:49.093252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.093403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.093513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.093541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.093671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.093791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.093816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.093915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.094045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.094070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.094214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.094331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.094359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.094485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.094616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.094641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.094797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.094910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.094938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.095071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.095211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.095238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.095359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.095461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.095490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.095631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.095729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.095755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.095901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.096065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.096093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.096246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.096406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.096433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.096570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.096715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.096740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.096849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.096942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.096966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.097104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.097220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.097247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.097388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.097560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.097585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.097677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.097789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.097817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.097968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.098061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.098087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.098238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.098348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.098376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.098494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.098601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.098629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.098771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.098862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.098886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.098991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.099108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.099133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.099283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.099393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.099420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.099527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.099654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.099682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.099811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.099936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.099964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.100116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.100236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.100261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.100385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.100537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.100564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.100676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.100802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.100830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.100939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.101089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.101113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.101239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.101354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.101379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.101513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.101692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.101720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.101819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.101921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.101967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.102099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.102227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.102252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.102376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.102482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.102507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.102629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.102753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.102781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.102915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.103019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.103047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.103224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.103327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.103353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.103450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.103550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.103575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.103722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.103841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.103868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.103973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.104102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.104129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.104270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.104407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.104433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.104547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.104677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.104723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.104829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.104936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.104963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.105100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.105241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.105265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.105359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.105453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.105477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.105648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.105802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.105828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.190 [2024-11-26 04:41:49.105919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.106051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.190 [2024-11-26 04:41:49.106078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.190 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.106195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.106342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.106366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.106462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.106548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.106572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.106716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.106818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.106842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.106959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.107107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.107132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.107262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.107409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.107438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.107547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.107653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.107681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.107804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.107905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.107930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.108038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.108165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.108189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.108332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.108439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.108468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.108611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.108715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.108743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.108867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.108967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.108991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.109111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.109210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.109237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.109349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.109509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.109536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.109692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.109792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.109820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.109937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.110063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.110088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.110209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.110343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.110371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.110507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.110638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.110665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.110839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.110951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.110979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.111112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.111212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.111236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.111329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.111422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.111447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.111576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.111713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.111742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.111876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.111989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.112016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.112142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.112238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.112263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.112364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.112468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.112493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.112587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.112746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.112774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.112895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.113033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.113061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.113181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.113285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.113310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.113442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.113581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.113608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.113760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.113850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.113875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.113974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.114122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.114149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.114264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.114394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.114419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.114564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.114675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.114711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.114822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.114916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.114940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.115098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.115203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.115230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.115404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.115532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.115556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.115700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.115839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.115866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.116001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.116146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.116174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.116282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.116415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.116452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.116593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.116699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.116724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.116831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.116943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.116972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.117110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.117211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.117235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.117354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.117479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.117504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.117636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.117743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.117768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.117871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.117969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.117994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.118114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.118233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.118257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.118385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.118490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.118519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.118643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.118740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.118766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.118889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.119017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.119042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.119148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.119268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.119293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.191 qpair failed and we were unable to recover it. 00:30:10.191 [2024-11-26 04:41:49.119392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.191 [2024-11-26 04:41:49.119538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.119562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.119654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.119865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.119892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.120019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.120107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.120132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.120282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.120397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.120421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.120563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.120665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.120701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.120817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.120942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.120966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.121096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.121191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.121215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.121319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.121446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.121470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.121562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.121661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.121694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.121791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.121913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.121937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.122077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.122200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.122224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.122378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.122491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.122518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.122645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.122801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.122825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.122925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.123032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.123055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.123145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.123266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.123290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.123385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.123479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.123503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.123630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.123767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.123793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.123904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.124038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.124063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.124192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.124315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.124340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.124457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.124729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.124756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.124864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.125610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.125643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.125802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.125911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.125936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.126104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.126229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.126254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.126399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.126571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.126598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.126722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.126813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.126837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.126935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.127034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.127058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.127217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.127370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.127394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.127551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.127658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.127683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.127796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.127896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.127920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.128027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.128157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.128182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.128315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.128415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.128440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.128554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.128744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.128772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.129630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.129788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.129815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.129927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.130050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.130075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.130229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.130325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.130350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.130476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.130571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.130595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.130700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.130804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.130829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.130931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.131047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.131076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.131232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.131352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.131376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.131504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.131630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.131655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.131763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.131850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.131875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.131973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.132081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.132105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.132237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.132339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.132363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.132491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.132474] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:10.192 [2024-11-26 04:41:49.132549] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:10.192 [2024-11-26 04:41:49.132583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.132609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.132723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.132820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.132845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.132954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.133073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.133098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.133189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.133357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.133384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.133578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.133672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.133708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.133837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.133950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.192 [2024-11-26 04:41:49.133993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.192 qpair failed and we were unable to recover it. 00:30:10.192 [2024-11-26 04:41:49.134086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.134199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.134227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.134369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.134469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.134494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.134581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.134731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.134760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.134901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.135056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.135085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.135232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.135353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.135379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.135519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.135611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.135636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.135763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.135878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.135906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.136052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.136171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.136195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.136308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.136401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.136425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.136519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.136652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.136677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.136823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.136960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.136990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.137163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.137318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.137342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.137436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.137533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.137558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.137682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.138477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.138510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.138674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.139421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.139454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.139642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.139750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.139793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.139928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.140066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.140090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.140229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.140326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.140351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.140503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.140630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.140655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.140792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.140907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.140935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.141084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.141193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.141220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.141324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.141458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.141483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.141579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.141715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.141741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.141837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.141949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.141977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.142077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.142198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.142223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.142344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.142452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.142479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.142639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.142747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.142776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.142898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.143048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.143083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.143207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.143321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.143353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.143504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.143633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.143660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.143785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.143900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.143924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.144069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.144202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.144229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.144368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.144469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.144498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.144616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.144724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.144750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.144843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.144941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.144966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.145060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.145152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.145176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.145321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.145460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.145488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.145611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.145737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.145763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.145858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.145959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.145988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.146122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.146288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.146325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.146456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.147212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.147245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.147456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.148386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.148420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.148589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.149319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.149351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.149526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.149664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.149729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.149839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.149935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.149960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.150122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.150249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.150289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.150399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.150543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.150583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.193 qpair failed and we were unable to recover it. 00:30:10.193 [2024-11-26 04:41:49.150741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.193 [2024-11-26 04:41:49.150833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.150858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.150981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.151080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.151120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.151263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.151361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.151387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.151487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.151622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.151649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.151772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.151865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.151890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.152038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.152150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.152177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.152291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.152439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.152468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.152618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.152744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.152770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.152874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.153009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.153037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.153174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.153334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.153361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.153512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.153634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.153663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.153828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.153926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.153950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.154069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.154229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.154257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.154407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.154549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.154576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.154743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.154849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.154875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.154967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.155112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.155140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.155358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.155496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.155523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.155657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.155787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.155812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.155908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.156024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.156051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.156188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.156330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.156372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.156526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.156696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.156740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.156835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.156936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.156976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.157073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.157194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.157222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.157395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.157508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.157538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.157658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.157783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.157809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.157911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.158061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.158089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.158225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.158362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.158390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.158565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.158708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.158734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.158833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.158930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.158954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.159091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.159191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.159218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.159315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.159425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.159452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.159556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.159653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.159680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.159806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.159900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.159928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.160053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.160147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.160173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.160275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.160377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.160404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.160539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.160639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.160666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.160813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.160940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.160964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.161083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.161189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.161217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.161382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.161513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.161554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.161682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.161790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.161815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.161918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.162020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.162053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.162175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.162285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.162313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.162415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.162553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.162579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.162694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.162810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.162834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.162932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.163051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.163075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.163248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.163357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.163384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.163494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.163624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.163651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.194 [2024-11-26 04:41:49.163810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.163904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.194 [2024-11-26 04:41:49.163930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.194 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.164044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.164139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.164166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.164319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.164436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.164464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.164592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.164723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.164748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.164880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.164996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.165023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.165152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.165258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.165285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.165445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.165543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.165570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.165672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.165802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.165826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.165926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.166020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.166044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.166211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.166337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.166364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.166479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.166627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.166656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.166786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.166883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.166906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.167010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.167132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.167159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.167291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.167397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.167433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.167565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.167671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.167707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.167818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.167917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.167942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.168074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.168222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.168248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.168399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.168536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.168561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.168653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.168776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.168820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.168962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.169120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.169146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.169263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.169384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.169409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.169507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.169630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.169654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.169803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 EAL: No free 2048 kB hugepages reported on node 1 00:30:10.195 [2024-11-26 04:41:49.170007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.170034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.170160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.170280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.170303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.170423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.170540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.170563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.170661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.170769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.170795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.170902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.171017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.171042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.171167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.171287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.171311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.171401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.171481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.171505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.171627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.172398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.172432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.172596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.172778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.172822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.172934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.173067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.173095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.173218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.173330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.173356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.173469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.173562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.173588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.173691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.173818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.173843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.173934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.174031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.174055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.174150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.174274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.174301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.174453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.174538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.174561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.174646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.174750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.174774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.174872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.174975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.174998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.175151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.175249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.175273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.175370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.175536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.175560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.175655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.175783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.175809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.175907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.176032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.176056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.176189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.176278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.176302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.176422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.176521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.176546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.176696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.176796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.176824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.195 qpair failed and we were unable to recover it. 00:30:10.195 [2024-11-26 04:41:49.176921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.177055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.195 [2024-11-26 04:41:49.177078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.177177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.177274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.177299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.177429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.177553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.177577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.177665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.177773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.177798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.177901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.178059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.178083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.178211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.178312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.178336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.178424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.178542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.178566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.178666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.178775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.178802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.178903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.179001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.179025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.179176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.179330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.179355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.179458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.179554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.179579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.179677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.179774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.179797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.179888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.179983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.180007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.180129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.180241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.180266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.180398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.180530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.180554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.180680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.180790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.180815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.180915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.181592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.181622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.181753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.181862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.181886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.181987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.182139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.182163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.182266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.182418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.182443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.182552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.182678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.182723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.182827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.182928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.182954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.183086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.183208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.183233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.183333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.183418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.183441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.183547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.183668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.183699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.183830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.183952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.183977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.184140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.184293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.184316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.184418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.184512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.184537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.184660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.184771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.184795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.184890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.185056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.185080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.185212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.185330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.185354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.185454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.185601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.185625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.185732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.185825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.185853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.185981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.186081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.186106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.186257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.186347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.186372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.186513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.186637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.186661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.186776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.186875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.186899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.187030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.187154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.187178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.187280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.187416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.187440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.187574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.187707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.187732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.187838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.187939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.187968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.188097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.188197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.188222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.188345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.188467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.188491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.188613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.188750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.188775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.188897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.189009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.189033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.189157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.189253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.189277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.189413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.189508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.189532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.189665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.189797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.189823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.189941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.190065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.190089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.190215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.190363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.190387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.190489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.190609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.190633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.190765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.190868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.190891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.190995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.191092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.191116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.196 qpair failed and we were unable to recover it. 00:30:10.196 [2024-11-26 04:41:49.191239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.196 [2024-11-26 04:41:49.191340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.191363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.191457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.191551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.191576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.191710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.191812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.191836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.191931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.192079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.192103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.192232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.192328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.192351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.192481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.192603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.192629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.192775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.192900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.192925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.193066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.193165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.193189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.193297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.193391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.193417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.193518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.193638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.193663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.193810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.193958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.193993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.194095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.194230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.194256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.194375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.194470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.194495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.194630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.194753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.194780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.194907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.195849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.195880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.195994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.196149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.196177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.196318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.196425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.196451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.196581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.196729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.196756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.196862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.196992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.197017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.197147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.197275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.197300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.197394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.197484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.197509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.197638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.197747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.197773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.197879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.197987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.198013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.198142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.198278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.198314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.198468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.198631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.198657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.198799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.198916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.198942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.199070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.199220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.199246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.199372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.199521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.199546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.199658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.199795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.199821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.199912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.200210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.200240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.200387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.200511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.200538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.200663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.200793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.200819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.200929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.201057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.201084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.201177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.201304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.201329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.201460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.201563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.201589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.201717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.201820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.201846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.201947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.202116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.202142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.202267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.202366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.202392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.202498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.202599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.202627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.202736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.202838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.202864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.203012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.203142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.203168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.203298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.203394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.203419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.203554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.203696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.203721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.203826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.203976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.204001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.204129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.204227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.204253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.204378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.204515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.204541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.204675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.204786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.204812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.204914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.205010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.205036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.205134] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:10.197 [2024-11-26 04:41:49.205185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.205309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.205334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.205476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.205580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.205605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.205734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.205857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.205883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.197 qpair failed and we were unable to recover it. 00:30:10.197 [2024-11-26 04:41:49.205980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.197 [2024-11-26 04:41:49.206100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.206124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.206252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.206371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.206396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.206526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.206655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.206694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.206795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.206885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.206911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.207037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.207193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.207218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.207373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.207464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.207489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.207593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.207720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.207746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.207870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.207968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.208007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.208152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.208276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.208301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.208422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.208545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.208570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.208706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.208828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.208854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.208989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.209146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.209171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.209269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.209395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.209422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.209522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.209619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.209645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.209779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.209903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.209928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.210090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.210213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.210239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.210361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.210481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.210506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.210629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.210741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.210767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.210876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.211008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.211033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.211131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.211255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.211282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.211386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.211543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.211568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.211720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.211819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.211845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.211975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.212128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.212153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.212284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.212446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.212472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.212626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.212733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.212759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.212859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.213024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.213049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.213177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.213308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.213333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.213452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.213582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.213607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.213722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.213830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.213856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.213959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.214084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.214109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.214233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.214326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.214351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.214477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.214630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.214655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.214795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.214944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.214970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.215070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.215194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.215222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.215321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.215443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.215469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.215635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.215773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.215799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.215950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.216088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.216115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.216248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.216378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.216405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.216537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.216643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.216669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.216790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.216897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.216922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.217031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.217134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.217159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.217257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.217409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.217434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.217575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.217706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.217732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.217834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.217969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.217998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.218100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.218195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.218220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.218393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.218521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.218549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.218648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.218759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.218787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.218895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.219058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.219083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.198 [2024-11-26 04:41:49.219236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.219327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.198 [2024-11-26 04:41:49.219351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.198 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.219475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.219626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.219652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.219762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.219861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.219886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.219985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.220147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.220173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.220303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.220443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.220469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.220591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.220739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.220766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.220899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.221036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.221062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.221156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.221305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.221330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.221481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.221578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.221604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.221718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.221826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.221852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.221981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.222127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.222153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.222280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.222417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.222442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.222570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.222663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.222694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.222799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.222907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.222933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.223058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.223159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.223184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.223308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.223470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.223496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.223599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.223703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.223729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.223858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.223951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.223977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.224076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.224227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.224252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.224412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.224540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.224569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.224667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.224811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.224836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.224935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.225038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.225063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.225171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.225373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.225398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.225555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.225758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.225784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.225910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.226043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.226068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.226190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.226310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.226335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.226425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.226517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.226543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.226667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.226786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.226812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.226937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.227041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.227066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.227197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.227296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.227325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.227424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.227524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.227549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.227756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.227878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.227903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.228030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.228157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.228183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.228309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.228408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.228434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.228560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.228658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.228691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.228815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.228912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.228937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.229037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.229189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.229214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.229339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.229461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.229488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.229614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.229740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.229766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.229862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.229985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.230016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.230136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.230255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.230280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.230407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.230532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.230556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.230697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.230848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.230875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.230966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.231069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.231095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.231197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.231319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.231344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.231437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.231530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.231555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.231656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.231789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.231816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.231942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.232035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.232060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.232212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.232339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.232364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.232471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.232592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.232622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.232752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.232880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.232905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.233108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.233232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.233258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.233382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.233497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.233523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.233672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.233781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.233807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.233924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.234026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.199 [2024-11-26 04:41:49.234051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.199 qpair failed and we were unable to recover it. 00:30:10.199 [2024-11-26 04:41:49.234175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.234303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.234329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.234480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.234576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.234601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.234709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.234803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.234828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.234979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.235108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.235133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.235257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.235391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.235416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.235576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.235682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.235713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.235844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.235996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.236022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.236162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.236263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.236290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.236393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.236512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.236537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.236663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.236788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.236813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.236919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.237045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.237070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.237195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.237331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.237356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.237487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.237612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.237637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.237766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.237890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.237916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.238015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.238117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.238144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.238290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.238421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.238446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.238608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.238708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.238735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.238863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.239018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.239044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.239149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.239276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.239303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.239404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.239501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.239527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.239629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.239746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.239772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.239890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.239983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.240010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.240139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.240269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.240295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.240416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.240550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.240575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.240670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.240834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.240860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.240997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.241120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.241145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.241269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.241427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.241452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.241550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.241705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.241731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.241830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.241921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.241948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.242076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.242169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.242194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.242316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.242475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.242500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.242630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.242735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.242761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.242892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.242988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.243013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.243139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.243263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.243288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.243440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.243530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.243555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.243658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.243821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.243847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.243945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.244067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.244093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.244188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.244338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.244363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.244474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.244625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.244650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.244750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.244846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.244870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.244999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.245147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.245172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.245324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.245444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.245469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.245590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.245719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.245746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.245867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.245989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.246014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.246134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.246237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.246263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.246402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.246518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.246543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.246640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.246771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.246796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.246943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.247076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.247102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.247194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.247319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.247345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.247440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.247532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.247557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.200 qpair failed and we were unable to recover it. 00:30:10.200 [2024-11-26 04:41:49.247681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.200 [2024-11-26 04:41:49.247809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.247834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.247935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.248071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.248096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.248253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.248353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.248378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.248509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.248638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.248665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.248811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.248935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.248960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.249063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.249189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.249216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.249316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.249433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.249459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.249611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.249736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.249763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.249884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.250010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.250037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.250161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.250285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.250310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.250408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.250533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.250559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.250714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.250840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.250865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.250986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.251115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.251141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.251241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.251332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.251357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.251461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.251586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.251611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.251756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.251905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.251931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.252068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.252164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.252189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.252326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.252451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.252477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.252604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.252740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.252766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.252888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.253009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.253036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.253147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.253303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.253329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.253462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.253556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.253581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.253725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.253854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.253879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.254018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.254139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.254164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.254256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.254358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.254385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.254489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.254615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.254641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.254810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.254915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.254942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.255072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.255195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.255220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.255359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.255453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.255479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.255606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.255743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.255769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.255860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.255966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.256002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.256132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.256255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.256280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.256386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.256509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.256534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.256631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.256795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.256821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.256918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.257049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.257075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.257211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.257342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.257368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.257464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.257586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.257611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.257740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.257873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.257899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.258012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.258140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.258167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.258289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.258438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.258463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.258563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.258696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.258722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.258848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.258939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.258965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.259120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.259244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.259270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.259398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.259493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.259518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.259644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.259788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.259814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.259941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.260097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.260122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.260226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.260317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.260342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.260474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.260566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.260592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.260727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.260849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.260874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.260982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.261108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.261134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.261254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.261380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.261407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.261538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.261639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.261666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.261827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.261979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.262005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.262105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.262229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.262257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.201 qpair failed and we were unable to recover it. 00:30:10.201 [2024-11-26 04:41:49.262385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.201 [2024-11-26 04:41:49.262514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.262541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.262641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.262786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.262812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.262905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.263022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.263047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.263169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.263266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.263292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.263451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.263570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.263599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.263725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.263857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.263884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.263988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.264138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.264164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.264255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.264381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.264406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.264511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.264669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.264705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.264809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.264928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.264953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.265110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.265238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.265263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.265361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.265457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.265486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.265642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.265751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.265777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.265873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.265995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.266021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.266154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.266252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.266278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.266432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.266519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.266545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.266638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.266766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.266792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.266887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.267049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.267075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.267170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.267267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.267293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.267432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.267561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.267587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.267739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.267867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.267893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.268021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.268110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.268139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.268262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.268387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.268415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.268541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.268694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.268720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.268821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.268951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.268977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.269116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.269238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.269263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.269396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.269547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.269572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.269701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.269803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.269829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.269919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.270011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.270037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.270168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.270292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.270317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.270473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.270574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.270600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.270735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.270863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.270893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.271024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.271143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.271168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.271297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.271420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.271445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.271540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.271676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.271710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.271841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.271941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.271967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.272063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.272199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.272226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.272380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.272485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.272512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.272638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.272765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.272792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.272888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.272982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.273009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.273130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.273256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.273282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.273405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.273535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.273565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.273664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.273765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.273791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.273894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.274030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.274055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.274182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.274284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.274309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.274433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.274560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.274586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.274780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.274906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.274932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.275086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.275208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.275235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.275335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.275455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.275480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.275604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.275741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.275767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.275867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.275962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.275989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.276098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.276248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.276274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.276381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.276512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.276538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.276638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.276758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.276784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.202 qpair failed and we were unable to recover it. 00:30:10.202 [2024-11-26 04:41:49.276935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.202 [2024-11-26 04:41:49.277062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.277087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.277188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.277326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.277352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.277456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.277559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.277585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.277720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.277847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.277873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.278003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.278126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.278152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.278282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.278381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.278407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.278508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.278608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.278635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.278732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.278823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.278848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.278975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.279101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.279126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.279251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.279352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.279378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.279479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.279582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.279608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.279749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.279875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.279902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.280056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.280182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.280207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.280345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.280470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.280497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.280648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.280759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.280785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.280884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.281006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.281031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.281156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.281289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.281314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.281451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.281573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.281598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.281743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.281847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.281873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.281997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.282146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.282172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.282304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.282430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.282455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.282611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.282720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.282747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.282868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.282968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.282994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.283120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.283246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.283271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.283393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.283520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.283554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.283673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.283804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.283830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.283951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.284068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.284094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.284219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.284348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.284373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.284473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.284594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.284619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.284740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.284857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.284883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.284987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.285076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.285102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.285246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.285343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.285369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.285496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.285618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.285644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.285774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.285871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.285897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.286046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.286134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.286160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.286278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.286382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.286407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.286532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.286660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.286715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.286822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.286915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.286942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.287106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.287230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.287256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.287389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.287510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.287536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.287665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.287813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.287842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.287973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.288067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.288094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.288215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.288335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.288360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.288484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.288644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.288670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.288775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.288874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.288901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.288999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.289153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.289179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.289310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.289436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.289461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.289590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.289729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.289756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.289855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.289954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.289980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.290071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.290168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.290194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.203 qpair failed and we were unable to recover it. 00:30:10.203 [2024-11-26 04:41:49.290346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.290496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.203 [2024-11-26 04:41:49.290522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.290650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.290784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.290811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.290936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.291054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.291080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.291199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.291292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.291318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.291442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.291536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.291562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.291713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.291834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.291860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.291987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.292085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.292110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.292251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.292373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.292399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.292550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.292661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.292701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.292838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.292988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.293013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.293114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.293239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.293264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.293368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.293486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.293511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.293612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.293703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.293729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.293831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.293927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.293951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.294040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.294073] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:10.204 [2024-11-26 04:41:49.294125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.294149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.294199] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:10.204 [2024-11-26 04:41:49.294218] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:10.204 [2024-11-26 04:41:49.294231] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:10.204 [2024-11-26 04:41:49.294239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.294329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.294352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.294449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.294449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:10.204 [2024-11-26 04:41:49.294547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.294479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:10.204 [2024-11-26 04:41:49.294571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.294706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.294527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:10.204 [2024-11-26 04:41:49.294530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:10.204 [2024-11-26 04:41:49.294801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.294825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.294974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.295065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.295089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.295190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.295289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.295314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.295414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.295507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.295532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.295672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.295772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.295797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.295928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.296031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.296055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.296156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.296301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.296325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.296418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.296539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.296563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.296683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.296813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.296837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.296967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.297056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.297082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.297176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.297271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.297295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.297397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.297522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.297546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.297642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.297764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.297789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.297911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.298008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.298034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.298161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.298284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.298309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.298404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.298520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.298543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.298583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x749e00 (9): Bad file descriptor 00:30:10.204 [2024-11-26 04:41:49.298757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.298899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.298928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.299025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.299132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.299157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.299251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.299346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.299371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.299471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.299565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.299589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.299697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.299796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.299821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.299922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.300040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.300075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.300176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.300296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.300320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.300411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.300501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.300526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.300621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.300736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.300761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.300864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.300962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.300987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.301076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.301168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.301192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.301280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.301371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.301395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.301522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.301614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.301639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.301746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.301843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.301867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.301957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.302048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.302072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.302194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.302286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.302310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.302449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.302543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.302567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.302693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.302793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.302817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.302939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.303082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.303106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.204 qpair failed and we were unable to recover it. 00:30:10.204 [2024-11-26 04:41:49.303226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.204 [2024-11-26 04:41:49.303327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.303350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.303467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.303561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.303586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.303682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.303823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.303848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.303966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.304086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.304111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.304213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.304308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.304333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.304453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.304539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.304564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.304695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.304787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.304811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.304910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.304998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.305022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.305144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.305241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.305266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.305361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.305456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.305481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.305604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.305724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.305748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.305846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.305940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.305964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.306096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.306196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.306222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.306312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.306399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.306423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.306521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.306624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.306653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.306765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.306857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.306882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.306974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.307094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.307119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.307243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.307360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.307384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.307474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.307589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.307613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.307715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.307837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.307861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.307954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.308048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.308072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.308226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.308318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.308342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.308466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.308558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.308583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.308710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.308813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.308837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.308965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.309089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.309118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.309243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.309347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.309371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.309467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.309583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.309607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.309712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.309808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.309832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.309936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.310028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.310053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.310179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.310279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.310303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.310396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.310487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.310511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.310608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.310720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.310744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.310868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.310954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.310978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.311072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.311157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.311182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.311278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.311377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.311401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.311554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.311644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.311668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.311769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.311872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.311896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.311987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.312076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.312100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.312187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.312279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.312304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.312424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.312510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.312534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.312630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.312731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.312755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.312876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.312975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.312999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.313090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.313174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.313198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.313315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.313410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.313434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.313531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.313646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.313669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.313773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.313859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.313884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.313982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.314099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.314123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.314222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.314344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.314370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.314457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.314550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.314575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.314666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.314814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.314840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.205 qpair failed and we were unable to recover it. 00:30:10.205 [2024-11-26 04:41:49.314961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.205 [2024-11-26 04:41:49.315055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.315080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.315180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.315279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.315304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.315400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.315489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.315514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.315602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.315726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.315752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.315854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.315953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.315977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.316069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.316161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.316186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.316282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.316407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.316431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.316562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.316653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.316678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.316794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.316915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.316941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.317027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.317126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.317151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.317275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.317359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.317383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.317477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.317562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.317586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.317684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.317788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.317814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.317905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.317995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.318018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.318126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.318217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.318242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.318367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.318490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.318519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.318621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.318732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.318757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.318855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.318942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.318967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.319087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.319179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.319203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.319300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.319389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.319414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.319539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.319632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.319656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.319761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.319880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.319903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.319998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.320117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.320141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.320242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.320363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.320388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.320488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.320581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.320608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.320756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.320882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.320906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.321017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.321123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.321148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.321243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.321339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.321363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.321453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.321543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.321567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.321695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.321819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.321844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.321938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.322038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.322064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.322158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.322249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.322273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.322372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.322473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.322497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.322593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.322684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.322713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.322811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.322904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.322928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.323024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.323142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.323167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.323269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.323392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.323416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.323524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.323634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.323659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.323759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.323879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.323904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.324056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.324149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.324174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.324273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.324394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.324418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.324526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.324628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.324653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.324763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.324860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.324885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.324980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.325065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.325089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.325196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.325290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.325314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.325433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.325529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.325552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.325657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.325796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.325820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.325981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.326070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.326094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.326184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.326306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.326330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.326425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.326516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.326540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.326659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.326753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.326778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.326870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.326966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.326990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.327107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.327202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.327227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.327322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.327471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.327496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.206 qpair failed and we were unable to recover it. 00:30:10.206 [2024-11-26 04:41:49.327657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.327768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.206 [2024-11-26 04:41:49.327794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.327922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.328052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.328075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.328175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.328266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.328291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.328380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.328496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.328521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.328612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.328712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.328737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.328837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.328965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.328989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.329083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.329177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.329201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.329289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.329384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.329408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.329508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.329624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.329655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.329758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.329859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.329885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.330045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.330127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.330152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.330290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.330406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.330431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.330583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.330683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.330730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.330832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.330929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.330954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.331041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.331191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.331215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.331304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.331401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.331427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.331531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.331648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.331672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.331787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.331880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.331906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.332005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.332124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.332148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.332276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.332398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.332423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.332514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.332598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.332622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.332746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.332840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.332866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.332987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.333077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.333101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.333208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.333335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.333359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.333460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.333558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.333582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.333716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.333813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.333837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.333929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.334063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.334087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.334182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.334311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.334336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.334432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.334516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.334539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.334645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.334781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.334806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.334899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.335018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.335044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.335130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.335223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.335247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.335370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.335484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.335509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.335609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.335714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.335739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.335831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.335952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.335977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.336109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.336204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.336228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.336328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.336451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.336476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.336573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.336671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.336702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.336825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.336927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.336950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.337052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.337147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.337171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.337274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.337367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.337391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.337486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.337609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.337634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.337740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.337839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.337863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.337982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.338078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.338105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.338199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.338321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.338346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.338468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.338568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.338592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.338681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.338810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.338835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.338936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.339023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.339047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.339155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.339279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.339303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.339394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.339499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.339524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.339617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.339729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.339754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.339865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.339955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.339985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.207 qpair failed and we were unable to recover it. 00:30:10.207 [2024-11-26 04:41:49.340119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.207 [2024-11-26 04:41:49.340256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.340280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.340402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.340522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.340551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.340693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.340786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.340810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.340912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.341018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.341045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.341149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.341247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.341273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.341370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.341457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.341481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.341603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.341746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.341771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.341864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.341964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.341988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.342078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.342178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.342202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.342326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.342421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.342446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.342541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.342656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.342681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.342818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.342914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.342943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.343051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.343153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.343177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.343279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.343397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.343420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.343522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.343610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.343633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.343777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.343872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.343896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.343993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.344078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.344101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.344191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.344316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.344340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.344434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.344562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.344586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.344681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.344781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.344805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.344933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.345029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.345065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.345166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.345260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.345285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.345385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.345509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.345534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.345631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.345763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.345788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.345882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.346018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.346043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.346175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.346267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.346291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.346389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.346502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.346527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.346620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.346721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.346745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.346871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.346962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.346986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.347071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.347198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.347222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.347349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.347444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.347468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.347554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.347644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.347669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.347793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.347919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.347943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.348047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.348145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.348170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.348259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.348348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.348372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.348522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.348643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.348678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.348777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.348879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.348903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.348993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.349088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.349113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.349268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.349384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.349408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.349506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.349599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.349623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.349756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.349907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.349931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.350064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.350160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.350184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.350283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.350378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.350404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.350533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.350628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.350653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.350759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.350850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.350875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.350963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.351085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.351109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.351227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.351319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.351344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.351466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.351564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.351588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.351725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.351847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.351872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.351968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.352124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.352149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.352245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.352338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.352362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.352458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.352590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.352614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.208 qpair failed and we were unable to recover it. 00:30:10.208 [2024-11-26 04:41:49.352736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.208 [2024-11-26 04:41:49.352824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.352853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.209 [2024-11-26 04:41:49.352953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.353050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.353075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.209 [2024-11-26 04:41:49.353197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.353291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.353315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.209 [2024-11-26 04:41:49.353430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.353551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.353577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.209 [2024-11-26 04:41:49.353676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.353807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.353832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.209 [2024-11-26 04:41:49.353923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.354056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.354081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.209 [2024-11-26 04:41:49.354168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.354259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.354284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.209 [2024-11-26 04:41:49.354385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.354505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.354530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.209 [2024-11-26 04:41:49.354626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.354723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.354748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.209 [2024-11-26 04:41:49.354847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.354967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.355002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.209 [2024-11-26 04:41:49.355096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.355219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.355243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.209 [2024-11-26 04:41:49.355354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.355460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.355484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.209 [2024-11-26 04:41:49.355610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.355702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.209 [2024-11-26 04:41:49.355727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.209 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.355821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.355938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.355963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.356090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.356208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.356233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.356329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.356456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.356481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.356574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.356668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.356706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.356802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.356900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.356925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.357027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.357114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.357139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.357229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.357316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.357340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.357429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.357524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.357551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.357667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.357813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.357838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.357929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.358035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.358059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.358191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.358315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.358340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.358434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.358528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.358553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.358645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.358747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.358772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.358892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.358992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.359017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.359118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.359241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.359267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.359389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.359478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.359503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.359626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.359754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.359780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.359903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.359996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.360021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.360198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.360335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.360365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.360507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.360610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.360636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.360804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.360901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.360927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.491 [2024-11-26 04:41:49.361032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.361124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.491 [2024-11-26 04:41:49.361149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.491 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.361253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.361377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.361402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.361491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.361588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.361613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.361750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.361846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.361872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.361968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.362066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.362091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.362242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.362338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.362363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.362472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.362595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.362619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.362755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.362862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.362886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.363016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.363104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.363128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.363227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.363316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.363340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.363440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.363570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.363594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.363736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.363844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.363868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.363991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.364119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.364143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.364255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.364350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.364374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.364524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.364615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.364640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.364757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.364854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.364880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.364976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.365070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.365094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.365185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.365289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.365313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.365410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.365506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.365531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.365629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.365761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.365785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.365905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.366010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.366034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.366134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.366225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.366249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.366382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.366503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.366526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.366619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.366727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.366754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.366882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.367018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.367043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.367142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.367263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.492 [2024-11-26 04:41:49.367288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.492 qpair failed and we were unable to recover it. 00:30:10.492 [2024-11-26 04:41:49.367381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.367471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.367496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.367594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.367707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.367733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.367863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.367964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.367989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.368099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.368188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.368212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.368309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.368399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.368423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.368550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.368671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.368701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.368828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.368924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.368949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.369068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.369189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.369213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.369299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.369416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.369440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.369534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.369689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.369714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.369804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.369909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.369934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.370034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.370130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.370157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.370255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.370375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.370399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.370499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.370611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.370635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.370739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.370834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.370858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.370974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.371107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.371132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.371286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.371415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.371439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.371533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.371652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.371676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.371782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.371882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.371907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.372011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.372128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.372152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.372244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.372342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.372366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.372474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.372593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.372621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.372754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.372846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.372870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.372964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.373077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.373101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.373190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.373336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.373361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.373490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.373581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.373606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.373764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.373883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.493 [2024-11-26 04:41:49.373907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.493 qpair failed and we were unable to recover it. 00:30:10.493 [2024-11-26 04:41:49.374002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.374100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.374125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.374224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.374343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.374367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.374492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.374583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.374607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.374700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.374838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.374862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.374959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.375077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.375106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.375202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.375284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.375308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.375405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.375499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.375523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.375608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.375726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.375756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.375857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.375995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.376019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.376115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.376244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.376273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.376375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.376467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.376491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.376627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.376747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.376773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.376896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.376990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.377014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.377099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.377226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.377250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.377371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.377458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.377486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.377585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.377678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.377710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.377809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.377930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.377955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.378104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.378204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.378229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.378320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.378423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.378448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.378601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.378726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.378751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.378848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.378935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.378961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.379103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.379221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.379245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.379366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.379481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.379505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.379601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.379722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.379747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.379871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.379964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.380003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.380098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.380188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.380213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.380309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.380433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.380457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.494 qpair failed and we were unable to recover it. 00:30:10.494 [2024-11-26 04:41:49.380555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.494 [2024-11-26 04:41:49.380661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.380693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.380820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.380914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.380940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.381043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.381130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.381154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.381254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.381368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.381392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.381494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.381617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.381642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.381756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.381905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.381930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.382026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.382116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.382141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.382232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.382326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.382352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.382469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.382575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.382599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.382765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.382868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.382896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.382994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.383088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.383113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.383237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.383362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.383386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.383481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.383573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.383597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.383716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.383808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.383833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.383929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.384027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.384052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.384160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.384257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.384283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.384416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.384535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.384560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.384684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.384780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.384805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.384913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.385039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.385064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.385162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.385254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.385279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.385399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.385520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.385544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.385640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.385746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.385771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.385893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.386016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.386043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.386171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.386263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.386288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.386394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.386521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.386546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.386637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.386748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.386774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.495 qpair failed and we were unable to recover it. 00:30:10.495 [2024-11-26 04:41:49.386866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.495 [2024-11-26 04:41:49.386992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.387017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.387143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.387244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.387269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.387399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.387534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.387559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.387693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.387787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.387812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.387938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.388061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.388086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.388184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.388279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.388304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.388431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.388565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.388590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.388678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.388769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.388794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.388924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.389058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.389083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.389175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.389278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.389302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.389411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.389534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.389558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.389675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.389781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.389806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.389943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.390066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.390091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.390187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.390333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.390357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.390483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.390595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.390619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.390724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.390826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.390850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.390978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.391067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.391091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.391183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.391315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.391339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.391467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.391561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.391586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.391721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.391837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.391862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.391981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.392117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.392142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.392262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.392360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.392384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.392489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.392607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.392631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.392757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.392874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.392898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.496 qpair failed and we were unable to recover it. 00:30:10.496 [2024-11-26 04:41:49.393004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.496 [2024-11-26 04:41:49.393124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.393148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.393240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.393332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.393356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.393459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.393581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.393604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.393714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.393863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.393888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.393978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.394100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.394124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.394221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.394340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.394364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.394458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.394550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.394574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.394667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.394770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.394796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.394932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.395063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.395088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.395205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.395308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.395332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.395432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.395525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.395549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.395674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.395774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.395799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.395905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.396001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.396025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.396123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.396245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.396269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.396390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.396481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.396505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.396627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.396744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.396774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.396886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.397010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.397034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.397138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.397234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.397258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.397362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.397456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.397481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.397605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.397711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.397736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.397835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.397959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.397983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.398077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.398175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.398199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.398290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.398383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.398407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.398506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.398605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.398630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.398756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.398877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.398901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.398996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.399093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.399120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.399239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.399333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.399359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.497 qpair failed and we were unable to recover it. 00:30:10.497 [2024-11-26 04:41:49.399455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.497 [2024-11-26 04:41:49.399576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.399600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.399761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.399895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.399920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.400008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.400103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.400127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.400257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.400379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.400403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.400525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.400647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.400673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.400856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.400973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.401008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.401139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.401246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.401270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.401399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.401491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.401516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.401615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.401724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.401750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.401845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.401996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.402021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.402143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.402299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.402324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.402449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.402547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.402572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.402677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.402776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.402801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.402893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.402989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.403013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.403141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.403262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.403286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.403379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.403476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.403500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.403594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.403683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.403716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.403803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.403928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.403952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.404086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.404184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.404208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.404298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.404425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.404451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.404602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.404714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.404739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.404826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.404917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.404945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.405040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.405128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.405151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.405276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.405400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.405424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.405521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.405606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.405630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.405748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.405847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.405872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.405993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.406100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.406124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.406212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.406300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.406324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.406423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.406544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.498 [2024-11-26 04:41:49.406567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.498 qpair failed and we were unable to recover it. 00:30:10.498 [2024-11-26 04:41:49.406657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.406754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.406779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.406882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.406981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.407005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.407102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.407239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.407263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.407365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.407484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.407508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.407605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.407727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.407751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.407844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.407939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.407963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.408086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.408203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.408227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.408345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.408428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.408452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.408549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.408664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.408696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.408794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.408910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.408933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.409040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.409131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.409155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.409289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.409375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.409399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.409484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.409605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.409629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.409729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.409825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.409849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.409941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.410069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.410094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.410189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.410275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.410299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.410407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.410506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.410529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.410622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.410754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.410778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.410881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.411000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.411024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.411144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.411270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.411293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.411403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.411492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.411517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.411603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.411696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.411720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.411820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.411915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.411939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.412043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.412146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.412171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.412264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.412391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.412415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.412508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.412597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.412621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.499 [2024-11-26 04:41:49.412728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.412848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.499 [2024-11-26 04:41:49.412873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.499 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.412965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.413064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.413088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.413204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.413300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.413323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.413446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.413534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.413559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.413660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.413772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.413798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.413920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.414021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.414046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.414136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.414224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.414249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.414340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.414441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.414464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.414583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.414671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.414710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.414797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.414922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.414946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.415038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.415133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.415158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.415277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.415395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.415420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.415517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.415611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.415635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.415738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.415859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.415883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.415995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.416102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.416126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.416226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.416312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.416336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.416433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.416581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.416606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.416736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.416832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.416861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.416953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.417040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.417064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.417158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.417306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.417330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.417421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.417519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.417543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.417647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.417740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.417766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.417888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.418006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.418030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.418127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.418251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.418275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.418378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.418468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.500 [2024-11-26 04:41:49.418493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.500 qpair failed and we were unable to recover it. 00:30:10.500 [2024-11-26 04:41:49.418614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.418742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.418767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.418863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.418951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.418976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.419097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.419186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.419211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.419315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.419410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.419436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.419530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.419619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.419644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.419744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.419845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.419870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.419962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.420056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.420081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.420176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.420302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.420326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.420431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.420550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.420574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.420675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.420811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.420836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.420927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.421033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.421059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.421159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.421281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.421306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.421430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.421548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.421573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.421705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.421798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.421823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.421916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.422021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.422047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.422133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.422258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.422282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.422381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.422475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.422500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.422619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.422743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.422768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.422889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.423013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.423037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.423134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.423255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.423280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.423399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.423482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.423506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.423601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.423694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.423720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.423814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.423963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.423988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.424119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.424209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.424233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.424334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.424457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.424481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.424573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.424658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.424709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.424808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.424956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.424990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.425089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.425215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.425240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.501 qpair failed and we were unable to recover it. 00:30:10.501 [2024-11-26 04:41:49.425363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.501 [2024-11-26 04:41:49.425455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.425481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.425578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.425666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.425704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.425796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.425883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.425907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.426001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.426089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.426113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.426206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.426293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.426317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.426435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.426585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.426614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.426713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.426824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.426849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.426949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.427071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.427096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.427215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.427304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.427328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.427449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.427598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.427623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.427718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.427841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.427866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.427951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.428048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.428074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.428169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.428294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.428318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.428434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.428523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.428547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.428673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.428777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.428801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.428892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.428987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.429013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.429114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.429240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.429265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.429355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.429450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.429475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.429598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.429733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.429758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.429852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.429946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.429971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.430079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.430194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.430218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.430305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.430421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.430446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.430566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.430666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.430698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.430820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.430912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.430937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.431064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.431151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.431175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.431269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.431386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.431411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.431512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.431629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.431653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.431768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.431856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.431879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.431966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.432080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.502 [2024-11-26 04:41:49.432105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.502 qpair failed and we were unable to recover it. 00:30:10.502 [2024-11-26 04:41:49.432199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.432323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.432347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.432444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.432538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.432563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.432649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.432764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.432789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.432905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.433008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.433032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.433162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.433279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.433302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.433395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.433510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.433535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.433629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.433730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.433757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.433848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.433939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.433963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.434060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.434152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.434176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.434292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.434378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.434402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.434495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.434613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.434638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.434744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.434833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.434857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.434943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.435074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.435099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.435194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.435311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.435335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.435461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.435583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.435607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.435711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.435805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.435830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.435983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.436109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.436133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.436221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.436320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.436344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.436432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.436554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.436580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.436710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.436805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.436828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.436922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.437047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.437071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.437216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.437316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.437340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.437437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.437530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.437554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.437656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.437759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.437784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.437879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.437979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.438004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.438123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.438206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.438229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.438359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.438448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.438471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.438561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.438652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.438699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.503 qpair failed and we were unable to recover it. 00:30:10.503 [2024-11-26 04:41:49.438822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.503 [2024-11-26 04:41:49.438914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.438938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.439067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.439153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.439177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.439268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.439391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.439415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.439518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.439640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.439664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.439760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.439875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.439898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.439994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.440082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.440106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.440226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.440313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.440337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.440435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.440518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.440542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.440670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.440773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.440797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.440882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.440997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.441022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.441118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.441216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.441241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.441341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.441432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.441456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.441550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.441644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.441668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.441776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.441871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.441896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.441984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.442079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.442102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.442254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.442343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.442366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.442490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.442581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.442605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.442722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.442812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.442837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.442987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.443068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.443093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.443190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.443311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.443335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.443472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.443559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.443583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.443683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.443776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.443799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.443922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.444014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.444038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.444128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.444227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.444252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.444345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.444434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.444458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.444561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.444682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.444737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.444834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.444953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.444977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.445075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.445203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.445227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.445319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.445407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.504 [2024-11-26 04:41:49.445432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.504 qpair failed and we were unable to recover it. 00:30:10.504 [2024-11-26 04:41:49.445527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.445612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.445636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.445726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.445828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.445852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.445972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.446063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.446087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.446178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.446327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.446352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.446444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.446541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.446565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.446690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.446809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.446834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.446929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.447017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.447042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.447172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.447262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.447286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.447381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.447465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.447490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.447604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.447703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.447729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.447849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.447942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.447966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.448064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.448216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.448241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.448362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.448451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.448475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.448600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.448716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.448743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.448837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.448940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.448964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.449084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.449200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.449225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.449346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.449436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.449460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.449578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.449678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.449708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.449834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.449951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.449975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.450098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.450222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.450246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.450336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.450431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.450455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.450539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.450665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.450699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.450826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.450915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.450939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.451042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.451144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.451169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.451266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.451365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.505 [2024-11-26 04:41:49.451389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.505 qpair failed and we were unable to recover it. 00:30:10.505 [2024-11-26 04:41:49.451477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.451567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.451593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.451694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.451786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.451812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.451901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.452029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.452054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.452151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.452270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.452294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.452382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.452507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.452533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.452629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.452759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.452784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.452910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.453010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.453034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.453129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.453221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.453245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.453371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.453486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.453510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.453640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.453731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.453756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.453843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.453957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.453980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.454084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.454178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.454204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.454329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.454413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.454438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.454526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.454618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.454642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.454736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.454828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.454852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.454959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.455045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.455070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.455170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.455266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.455290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.455412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.455506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.455530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.455628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.455776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.455802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.455896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.455984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.456009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.456109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.456222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.456246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.456337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.456473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.456498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.456617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.456720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.456746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.456840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.456928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.456952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.457078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.457173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.457197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.457313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.457462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.457486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.457577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.457667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.506 [2024-11-26 04:41:49.457695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.506 qpair failed and we were unable to recover it. 00:30:10.506 [2024-11-26 04:41:49.457790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.457911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.457936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.458032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.458178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.458202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.458292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.458416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.458440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.458536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.458624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.458649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.458779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.458881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.458905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.458996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.459114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.459138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.459228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.459345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.459370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.459456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.459554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.459578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.459671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.459765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.459789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.459882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.460010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.460035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.460126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.460221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.460250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.460344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.460431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.460454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.460573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.460675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.460717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.460805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.460886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.460911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.461000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.461097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.461121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.461211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.461325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.461350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.461454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.461545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.461569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.461676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.461773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.461797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.461900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.462017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.462042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.462140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.462266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.462291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.462421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.462543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.462567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.462660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.462791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.462817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.462924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.463021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.463046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.463168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.463258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.463283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.463374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.463463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.463487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.463585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.463710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.463735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.463836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.463927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.507 [2024-11-26 04:41:49.463952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.507 qpair failed and we were unable to recover it. 00:30:10.507 [2024-11-26 04:41:49.464072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.464169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.464193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.464289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.464382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.464406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.464503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.464592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.464617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.464740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.464836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.464860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.464961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.465053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.465077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.465173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.465287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.465311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.465404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.465489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.465514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.465605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.465696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.465720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.465820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.465915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.465939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.466042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.466137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.466161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.466281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.466375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.466400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.466492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.466614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.466640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.466733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.466855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.466879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.466972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.467057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.467080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.467217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.467351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.467379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.467503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.467588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.467613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.467730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.467819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.467844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.467997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.468132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.468159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.468286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.468383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.468407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.468510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.468631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.468655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.468750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.468875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.468899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.469021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.469149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.469174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.469267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.469363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.469387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.469482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.469605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.469629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.469756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.469856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.469881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.469974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.470066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.470091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.470207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.470297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.470321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.470419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.470512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.470536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.508 qpair failed and we were unable to recover it. 00:30:10.508 [2024-11-26 04:41:49.470691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.508 [2024-11-26 04:41:49.470808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.470833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.470929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.471053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.471078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.471225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.471314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.471339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.471458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.471551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.471575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.471677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.471774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.471799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.471897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.472029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.472053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.472154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.472319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.472344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.472436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.472533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.472559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.472684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.472788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.472812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.472906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.473023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.473047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.473174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.473295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.473319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.473417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.473502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.473527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.473618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.473735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.473761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.473881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.473971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.473997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.474117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.474236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.474261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.474350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.474473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.474497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.474587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.474718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.474743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.474835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.474984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.475008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.475128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.475222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.475246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.475391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.475483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.475508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.475610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.475710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.475735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.475851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.475941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.475965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.476119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.476219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.476242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.476331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.476449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.476474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.476559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.476676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.476706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.476797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.476912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.476936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.477034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.477130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.477155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.477282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.477374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.477399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.509 qpair failed and we were unable to recover it. 00:30:10.509 [2024-11-26 04:41:49.477485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.477579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.509 [2024-11-26 04:41:49.477603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.477743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.477890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.477914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.478009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.478099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.478123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.478214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.478333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.478358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.478460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.478554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.478580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.478675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.478770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.478794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.478898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.479032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.479058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.479163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.479280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.479303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.479398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.479486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.479514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.479604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.479716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.479740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.479859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.479963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.479987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.480135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.480233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.480258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.480355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.480446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.480470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.480565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.480690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.480715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.480845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.480957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.480980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.481071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.481159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.481185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.481335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.481425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.481450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.481546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.481667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.481712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.481816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.481939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.481984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.482081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.482168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.482191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.482295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.482389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.482413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.482537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.482627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.482650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.482779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.482898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.482922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.510 qpair failed and we were unable to recover it. 00:30:10.510 [2024-11-26 04:41:49.483032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.510 [2024-11-26 04:41:49.483152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.483176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.483269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.483391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.483414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.483512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.483627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.483651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.483747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.483837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.483861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.483964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.484057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.484082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.484206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.484308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.484337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.484486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.484605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.484628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.484727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.484850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.484874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.484993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.485100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.485125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.485223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.485314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.485337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.485485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.485574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.485597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.485703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.485792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.485816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.485913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.486021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.486045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.486163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.486260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.486285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.486401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.486494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.486517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.486611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.486711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.486740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.486855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.486938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.486962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.487052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.487142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.487166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.487266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.487355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.487378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.487494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.487589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.487614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.487718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.487838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.487862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.487989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.488081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.488108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.488224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.488347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.488373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.488459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.488572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.488596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.488698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.488823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.488848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.488940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.489068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.489094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.489224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.489316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.489340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.511 qpair failed and we were unable to recover it. 00:30:10.511 [2024-11-26 04:41:49.489436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.489557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.511 [2024-11-26 04:41:49.489582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.489682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.489797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.489821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.489908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.490054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.490078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.490188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.490278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.490302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.490394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.490484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.490508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.490636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.490732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.490758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.490890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.491041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.491065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.491158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.491251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.491276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.491409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.491495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.491518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.491647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.491743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.491767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.491922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.492019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.492043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.492132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.492225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.492248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.492342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.492461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.492486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.492568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.492662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.492692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.492834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.492929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.492954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.493117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.493231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.493256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.493350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.493464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.493489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.493582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.493710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.493735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.493827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.493926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.493950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.494081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.494230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.494255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.494380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.494474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.494499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.494591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.494711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.494736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.494834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.494948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.494973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.495068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.495191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.495214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.495319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.495402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.495426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.495519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.495637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.495660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.495773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.495901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.495926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.496028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.496130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.496154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.496272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.496362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.512 [2024-11-26 04:41:49.496386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.512 qpair failed and we were unable to recover it. 00:30:10.512 [2024-11-26 04:41:49.496519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.496611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.496635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.496733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.496827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.496851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.496937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.497037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.497060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.497162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.497250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.497274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.497369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.497487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.497512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.497608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.497710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.497736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.497830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.497919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.497943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.498063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.498156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.498180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.498273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.498362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.498386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.498476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.498563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.498586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.498692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.498810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.498834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.498919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.499064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.499088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.499182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.499274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.499298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.499414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.499512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.499536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.499626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.499743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.499767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.499856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.499973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.499997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.500110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.500205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.500229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.500314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.500399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.500423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.500519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.500638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.500663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.500771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.500866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.500891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.501027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.501109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.501133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.501252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.501379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.501404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.501501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.501584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.501607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.501716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.501840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.501864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.501988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.502073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.502097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.502197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.502311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.502334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.502433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.502525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.502549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.502670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.502770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.502794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.513 qpair failed and we were unable to recover it. 00:30:10.513 [2024-11-26 04:41:49.502886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.513 [2024-11-26 04:41:49.503009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.503033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.503137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.503254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.503278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.503375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.503465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.503490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.503592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.503716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.503742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.503836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.503959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.503984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.504109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.504200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.504223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.504352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.504472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.504497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.504623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.504707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.504732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.504833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.504959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.504983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.505073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.505160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.505183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.505268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.505364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.505388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.505478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.505576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.505601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.505728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.505847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.505872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.505968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.506092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.506116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.506239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.506363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.506387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.506502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.506607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.506631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.506716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.506842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.506867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.506993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.507081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.507106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.507205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.507325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.507349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.507468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.507551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.507576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.507716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.507835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.507859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.507980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.508101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.508126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.508219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.508346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.508371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.508467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.508588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.508613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.508736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.508820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.508845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.514 qpair failed and we were unable to recover it. 00:30:10.514 [2024-11-26 04:41:49.508940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.514 [2024-11-26 04:41:49.509056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.509080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.509196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.509295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.509320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.509411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.509508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.509532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.509631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.509731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.509757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.509856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.509958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.509983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.510105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.510199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.510222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.510344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.510464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.510490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.510582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.510689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.510715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.510806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.510894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.510918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.511008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.511154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.511178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.511267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.511388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.511412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.511563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.511646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.511670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.511803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.511891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.511914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.512045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.512189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.512213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.512337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.512433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.512458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.512578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.512668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.512724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.512830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.512977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.513001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.513160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.513254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.513279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.513381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.513528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.513553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.513644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.513775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.513800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.513889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.514013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.514038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.514137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.514260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.514284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.514401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.514490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.514514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.514630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.514725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.514750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.514872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.514965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.514989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.515110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.515197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.515221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.515 [2024-11-26 04:41:49.515321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.515436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.515 [2024-11-26 04:41:49.515461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.515 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.515551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.515638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.515662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.515765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.515854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.515878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.515966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.516060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.516084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.516176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.516262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.516286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.516375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.516468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.516491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.516591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.516676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.516705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.516810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.516925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.516948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.517071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.517165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.517189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.517290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.517408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.517431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.517531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.517628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.517653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.517809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.517897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.517926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.518050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.518141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.518165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.518263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.518351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.518375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.518477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.518605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.518629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.518730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.518829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.518854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.519004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.519097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.519121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.519213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.519308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.519332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.519424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.519541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.519565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.519691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.519785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.519808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.519909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.520038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.520064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.520188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.520282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.520310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.520400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.520520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.520544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.520632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.520759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.520784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.520876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.520961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.520985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.521081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.521173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.521197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.521297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.521421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.521445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.521563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.521678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.516 [2024-11-26 04:41:49.521709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.516 qpair failed and we were unable to recover it. 00:30:10.516 [2024-11-26 04:41:49.521803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.521926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.521951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.522046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.522166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.522189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.522273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.522365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.522389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.522490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.522605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.522633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.522753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.522859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.522883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.522977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.523066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.523090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.523182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.523276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.523300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.523392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.523485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.523511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.523629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.523724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.523751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.523836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.523918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.523941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.524071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.524161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.524185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.524305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.524397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.524423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.524526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.524610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.524633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.524735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.524832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.524860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.524949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.525073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.525098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.525192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.525313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.525337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.525430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.525517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.525541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.525631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.525732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.525757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.525853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.525947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.525970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.526091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.526213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.526237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.526336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.526424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.526448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.526572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.526705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.526730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.526823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.526909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.526933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.527031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.527123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.527147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.527273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.527393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.527419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.527537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.527651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.527676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.527775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.527868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.527892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.517 qpair failed and we were unable to recover it. 00:30:10.517 [2024-11-26 04:41:49.527988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.528105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.517 [2024-11-26 04:41:49.528129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.528229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.528319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.528343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.528439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.528528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.528552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.528646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.528763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.528788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.528913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.529004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.529028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.529120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.529222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.529247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.529341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.529433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.529457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.529557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.529675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.529707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.529808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.529905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.529929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.530017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.530161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.530186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.530304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.530391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.530415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.530505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.530586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.530610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.530716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.530833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.530857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.530945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.531068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.531092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.531188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.531275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.531299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.531391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.531480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.531503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.531619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.531749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.531774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.531875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.531990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.532014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.532121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.532221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.532245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.532339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.532458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.532482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.532573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.532697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.532722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.532842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.532936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.532961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.533056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.533152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.533177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.533272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.533396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.533420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.533518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.533618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.533643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.533767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.533860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.533885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.533973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.534071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.534096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.534201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.534322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.534345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.518 [2024-11-26 04:41:49.534445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.534568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.518 [2024-11-26 04:41:49.534593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.518 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.534695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.534817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.534841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.534931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.535024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.535047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.535146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.535232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.535256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.535370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.535466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.535489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.535611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.535731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.535756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.535876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.535971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.535995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.536111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.536238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.536261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.536384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.536477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.536501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.536605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.536725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.536750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.536874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.536969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.536992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.537117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.537210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.537234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.537330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.537418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.537443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.537538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.537663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.537693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.537787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.537876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.537900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.537997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.538120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.538143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.538261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.538351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.538375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.538465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.538582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.538606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.519 qpair failed and we were unable to recover it. 00:30:10.519 [2024-11-26 04:41:49.538737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.538831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.519 [2024-11-26 04:41:49.538854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.538951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.539042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.539065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.539191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.539287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.539313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.539412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.539557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.539581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.539680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.539805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.539829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.539928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.540058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.540083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.540180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.540277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.540301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.540400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.540493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.540517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.540606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.540723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.540749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.540844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.540940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.540964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.541059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.541156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.541180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.541279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.541370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.541395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.541514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.541601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.541625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.541723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.541821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.541845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.541964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.542048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.542072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.542170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.542322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.542347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.542440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.542563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.542589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.542714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.542840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.542865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.542957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.543073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.543097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.543189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.543305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.543330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.543451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.543541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.543566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.543696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.543798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.543824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.543918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.544003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.544027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.544150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.544244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.544269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.544424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.544540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.544564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.520 qpair failed and we were unable to recover it. 00:30:10.520 [2024-11-26 04:41:49.544704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.520 [2024-11-26 04:41:49.544798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.544822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.544921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.545064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.545087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.545180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.545295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.545318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.545414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.545512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.545535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.545657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.545757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.545782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.545906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.546022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.546046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.546135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.546229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.546253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.546411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.546498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.546522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.546644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.546748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.546773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.546863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.546980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.547004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.547093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.547209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.547232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.547353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.547474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.547497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.547585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.547681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.547712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.547803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.547919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.547943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.548071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.548161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.548184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.548286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.548410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.548434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.548558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.548697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.548722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.548816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.548938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.548962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.549049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.549166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.549191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.549286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.549431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.549455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.549582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.549678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.549727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.549849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.549969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.549994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.550098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.550216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.550240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.550337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.550458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.550484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.550581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.550672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.550704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.550831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.550920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.550943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.551061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.551161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.551185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.551279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.551380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.551405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.521 [2024-11-26 04:41:49.551502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.551593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.521 [2024-11-26 04:41:49.551618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.521 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.551711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.551808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.551832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.551955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.552078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.552103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.552197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.552318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.552343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.552471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.552595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.552618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.552735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.552835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.552860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.552955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.553045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.553069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.553193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.553281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.553305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.553392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.553507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.553535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.553653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.553778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.553803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.553895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.553987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.554011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.554116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.554202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.554226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.554322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.554413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.554438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.554539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.554661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.554691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.554792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.554915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.554939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.555057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.555208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.555233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.555323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.555417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.555441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.555530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.555650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.555674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.555799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.555889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.555918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.556022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.556118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.556142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.556242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.556348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.556372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.556497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.556620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.556643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.556759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.556883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.556907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.557005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.557130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.557153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.557277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.557381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.557406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.557534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.557656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.557681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.557809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.557928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.557952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.558043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.558193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.558217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.558309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.558435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.522 [2024-11-26 04:41:49.558463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.522 qpair failed and we were unable to recover it. 00:30:10.522 [2024-11-26 04:41:49.558559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.558653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.558677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.558800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.558924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.558947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.559074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.559164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.559188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.559332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.559451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.559475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.559622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.559720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.559745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.559832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.559924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.559948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.560036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.560127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.560151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.560242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.560332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.560357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.560509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.560635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.560659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.560766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.560862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.560891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.560988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.561111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.561136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.561251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.561343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.561367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.561486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.561586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.561611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.561732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.561831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.561856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.561946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.562068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.562091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.562181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.562272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.562295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.562386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.562481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.562505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.562601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.562694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.562720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.562819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.562966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.562991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.563079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.563202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.563227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.563330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.563419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.563443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.563559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.563660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.563684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.563787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.563873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.563897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.563999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.564088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.564112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.564203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.564290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.564315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.564398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.564517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.564542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.564661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.564791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.564816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.564913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.565004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.565028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.523 qpair failed and we were unable to recover it. 00:30:10.523 [2024-11-26 04:41:49.565150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.523 [2024-11-26 04:41:49.565244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.565268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.565359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.565455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.565478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.565586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.565713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.565738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.565829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.565945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.565969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.566064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.566150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.566173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.566268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.566360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.566384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.566481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.566608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.566633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.566754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.566847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.566871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.566966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.567053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.567077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.567197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.567320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.567343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.567430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.567520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.567544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.567640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.567773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.567798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.567888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.567986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.568011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.568114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.568208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.568232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.568326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.568417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.568440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.568538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.568631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.568655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.568781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.568909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.568933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.569025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.569123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.569148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.569244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.569371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.569395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.569497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.569592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.569616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.569719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.569807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.569830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.569920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.570040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.570065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.570199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.570288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.570312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.570412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.570505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.570531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.570653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.570749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.524 [2024-11-26 04:41:49.570774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.524 qpair failed and we were unable to recover it. 00:30:10.524 [2024-11-26 04:41:49.570903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.570999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.571022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.571112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.571227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.571251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.571338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.571426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.571450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.571540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.571636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.571661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.571757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.571872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.571896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.571992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.572111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.572135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.572260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.572355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.572379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.572488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.572584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.572608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.572709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.572830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.572854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.572942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.573029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.573053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.573155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.573255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.573279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.573374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.573492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.573516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.573611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.573736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.573761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.573857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.573974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.573997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.574121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.574211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.574235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.574354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.574444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.574467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.574564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.574691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.574715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.574870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.574962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.574985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.575073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.575155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.575179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.575269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.575355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.575379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.575503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.575618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.575641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.575743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.575865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.575888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.575986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.576070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.576094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.576212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.576327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.576351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.576446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.576536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.576560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.576644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.576737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.576761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.576854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.576984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.577008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.577135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.577229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.577254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.525 qpair failed and we were unable to recover it. 00:30:10.525 [2024-11-26 04:41:49.577379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.525 [2024-11-26 04:41:49.577472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.577497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.577625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.577718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.577744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.577841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.577940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.577964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.578089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.578181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.578204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.578293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.578414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.578438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.578559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.578652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.578675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.578778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.578872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.578896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.578987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.579081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.579105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.579195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.579316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.579341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.579435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.579553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.579578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.579714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.579806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.579830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.579925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.580023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.580048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.580156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.580243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.580268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.580392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.580478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.580504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.580592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.580717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.580743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.580837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.580959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.580984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.581108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.581228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.581253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.581346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.581442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.581466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.581584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.581669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.581700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.581819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.581945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.581970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.582094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.582183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.582207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.582333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.582424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.582447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.582541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.582654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.582678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.582783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.582869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.582893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.582981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.583097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.583122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.583214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.583304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.583327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.583422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.583517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.583541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.583667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.583794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.583819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.526 [2024-11-26 04:41:49.583905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.583998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.526 [2024-11-26 04:41:49.584022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.526 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.584122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.584224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.584248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.584386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.584474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.584497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.584589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.584679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.584723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.584824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.584942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.584965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.585089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.585212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.585235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.585324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.585422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.585447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.585543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.585666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.585698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.585819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.585908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.585931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.586054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.586178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.586202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.586297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.586387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.586412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.586528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.586626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.586651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.586780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.586904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.586928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.587018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.587113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.587137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.587242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.587385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.587410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.587505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.587627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.587652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.587753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.587843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.587867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.587965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.588064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.588088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.588208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.588301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.588326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.588422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.588542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.588565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.588717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.588810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.588834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.588952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.589046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.589072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.589234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.589333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.589357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.589453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.589548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.589571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.589695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.589791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.589815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.589905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.590053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.590077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.590165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.590258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.590282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.590376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.590498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.590523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.527 [2024-11-26 04:41:49.590649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.590782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.527 [2024-11-26 04:41:49.590807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.527 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.590930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.591060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.591085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.591184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.591279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.591303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.591421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.591514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.591542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.591663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.591783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.591808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.591900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.592017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.592041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.592162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.592255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.592280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.592367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.592514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.592539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.592629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.592712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.592736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.592827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.592915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.592939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.593063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.593181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.593205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.593352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.593443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.593469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.593570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.593691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.593716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.593817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.593916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.593945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.594069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.594163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.594187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.594312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.594410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.594434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.594564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.594656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.594680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.594771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.594863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.594887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.594970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.595070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.595094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.595213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.595301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.595325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.595414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.595526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.595550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.595648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.595755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.595780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.595869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.595964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.595988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.596085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.596203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.596231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.596357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.596440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.596463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.596558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.596651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.596676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.596802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.596925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.596951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.528 qpair failed and we were unable to recover it. 00:30:10.528 [2024-11-26 04:41:49.597076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.597176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.528 [2024-11-26 04:41:49.597201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.597326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.597444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.597468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.597566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.597712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.597737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.597859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.597990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.598014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.598111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.598231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.598255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.598349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.598441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.598465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.598592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.598718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.598747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.598849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.598945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.598969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.599065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.599152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.599176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.599274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.599360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.599384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.599475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.599568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.599591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.599691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.599823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.599848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.599975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.600072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.600096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.600192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.600286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.600312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.600399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.600516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.600540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.600657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.600758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.600783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.600878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.600991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.601015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.601139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.601222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.601246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.601343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.601436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.601459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.601588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.601680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.601711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.601847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.601971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.601995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.602097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.602215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.602239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.602335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.602460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.602484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.602608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.602702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.602727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.529 qpair failed and we were unable to recover it. 00:30:10.529 [2024-11-26 04:41:49.602849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.529 [2024-11-26 04:41:49.602952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.602977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.603072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.603163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.603188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.603292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.603409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.603434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.603533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.603652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.603676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.603804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.603891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.603916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.604029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.604144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.604167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.604255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.604345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.604369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.604492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.604581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.604604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.604714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.604837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.604861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.604947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.605044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.605068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.605157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.605274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.605298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.605383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.605473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.605497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.605597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.605744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.605769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.605862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.605955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.605978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.606099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.606194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.606218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.606310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.606408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.606434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.606529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.606651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.606675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.606774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.606864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.606888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.606985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.607102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.607125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.607221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.607342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.607367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.607469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.607563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.607589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.607718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.607807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.607832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.607927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.608076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.608101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.608201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.608323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.608347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.608439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.608565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.608589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.608695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.608781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.608805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.608896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.608990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.609014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.530 [2024-11-26 04:41:49.609160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.609283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.530 [2024-11-26 04:41:49.609307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.530 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.609398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.609520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.609545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.609665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.609761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.609786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.609880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.609979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.610005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.610107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.610204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.610229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.610377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.610495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.610518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.610649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.610774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.610799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.610887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.610982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.611006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.611130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.611252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.611278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.611375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.611461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.611485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.611606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.611712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.611737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.611831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.611946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.611970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.612061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.612151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.612176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.612274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.612361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.612386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.612480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.612569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.612592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.612716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.612813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.612837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.612941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.613039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.613062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.613154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.613274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.613298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.613384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.613497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.613521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.613647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.613749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.613774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.613898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.613993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.614017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.614114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.614206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.614231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.614361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.614450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.614474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.614566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.614694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.614719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.614841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.614930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.614954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.615076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.615196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.615219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.615317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.615412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.615436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.615535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.615651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.615675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.531 qpair failed and we were unable to recover it. 00:30:10.531 [2024-11-26 04:41:49.615789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.531 [2024-11-26 04:41:49.615916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.615940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.616046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.616160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.616184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.616276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.616372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.616397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.616526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.616626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.616650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.616793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.616941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.616965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.617055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.617176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.617200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.617317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.617439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.617462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.617562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.617695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.617719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.617814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.617932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.617956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.618071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.618160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.618184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.618273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.618390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.618415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.618510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.618632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.618656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.618762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.618852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.618877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.619029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.619121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.619145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.619242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.619355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.619379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.619468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.619567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.619591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.619682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.619775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.619798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.619926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.620022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.620047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.620146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.620240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.620264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.620386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.620474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.620497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.620596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.620721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.620747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.620865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.620960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.620984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.621073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.621168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.621193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.621342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.621465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.621490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.621586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.621706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.621731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.621827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.621915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.621940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.622090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.622181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.622205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.622324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.622414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.532 [2024-11-26 04:41:49.622438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.532 qpair failed and we were unable to recover it. 00:30:10.532 [2024-11-26 04:41:49.622560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.622652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.622677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.622776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.622926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.622949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.623047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.623135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.623159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.623281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.623399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.623422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.623511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.623629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.623652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.623749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.623848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.623872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.623973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.624066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.624091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.624187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.624312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.624336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.624457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.624547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.624571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.624663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.624775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.624801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.624919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.625023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.625047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.625196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.625280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.625304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.625399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.625496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.625519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.625610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.625726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.625751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.625874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.625962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.625986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.626083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.626231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.626254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.626384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.626500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.626523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.626621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.626756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.626781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.626908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.627028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.627053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.627169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.627260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.627284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.627376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.627506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.627530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.627626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.627718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.627742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.627831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.627924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.627948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.628041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.628190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.628214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.628310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.628430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.628454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.628546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.628645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.628670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.628770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.628890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.628914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.629043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.629194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.629218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.533 qpair failed and we were unable to recover it. 00:30:10.533 [2024-11-26 04:41:49.629313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.629426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.533 [2024-11-26 04:41:49.629451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.629548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.629668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.629700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.629831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.629923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.629952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.630075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.630196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.630222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.630316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.630405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.630428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.630530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.630653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.630677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.630781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.630900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.630925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.631025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.631152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.631176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.631270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.631366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.631390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.631478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.631566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.631591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.631691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.631812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.631837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.631927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.632032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.632057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.632158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.632277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.632320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.632441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.632541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.632565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.632669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.632783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.632808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.632906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.632997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.633021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.633139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.633233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.633258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.633376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.633470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.633496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.633626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.633723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.633748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.633841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.633955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.633980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.634067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.634159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.634182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.634303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.634421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.634445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.634542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.634667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.634706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.634830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.634926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.634951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.635041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.635159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.635184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.635278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.635370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.635394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.635488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.635611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.635636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.635749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.635848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.635872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.534 qpair failed and we were unable to recover it. 00:30:10.534 [2024-11-26 04:41:49.635993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.534 [2024-11-26 04:41:49.636079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.636102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.636196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.636288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.636312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.636464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.636557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.636581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.636673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.636777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.636801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.636921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.637041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.637071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.637167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.637257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.637281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.637380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.637478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.637503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.637593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.637744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.637770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.637863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.637955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.637978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.638074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.638168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.638194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.638312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.638434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.638459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.638554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.638643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.638666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.638773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.638897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.638921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.639006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.639124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.639149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.639268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.639358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.639382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.639476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.639591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.639615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.639711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.639801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.639825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.639931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.640051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.640074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.640160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.640260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.640283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.640368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.640463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.640486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.640585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.640668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.640700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.640801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.640898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.640923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.641040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.641161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.641185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.641305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.641422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.641446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.641539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.641663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.641695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.641853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.641965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.641990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.642091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.642180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.642204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.642298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.642424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.642448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.642595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.642691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.642717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.642834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.642927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.642952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.535 qpair failed and we were unable to recover it. 00:30:10.535 [2024-11-26 04:41:49.643048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.535 [2024-11-26 04:41:49.643137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.643160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.643278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.643399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.643422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.643510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.643600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.643624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.643737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.643830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.643853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.643945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.644063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.644087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.644210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.644303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.644327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.644449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.644537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.644561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.644661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.644795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.644822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.644917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.645002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.645027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.645135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.645258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.645282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.645382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.645476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.645501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.645596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.645693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.645717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.645840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.645983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.646007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.646091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.646205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.646229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.646328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.646420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.646444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.646535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.646626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.646650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.646752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.646849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.646873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.646965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.647055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.647082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.647213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.647326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.647350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.647445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.647536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.647561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.647652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.647778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.647803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.647892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.647985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.648009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.648124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.648209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.648233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.648357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.648508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.648532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.648626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.648719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.648744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.648872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.648961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.648985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.649079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.649201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.649225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.649314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.649437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.649461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.649559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.649650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.649674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.649817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.649913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.649937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.536 qpair failed and we were unable to recover it. 00:30:10.536 [2024-11-26 04:41:49.650047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.536 [2024-11-26 04:41:49.650135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.650159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.650312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.650438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.650462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.650615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.650733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.650758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.650856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.650980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.651004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.651154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.651267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.651291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.651423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.651547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.651571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.651657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.651777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.651802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.651918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.652010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.652034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.652184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.652279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.652302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.652390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.652475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.652499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.652648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.652771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.652796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.652891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.652979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.653003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.653129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.653225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.653250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.653350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.653473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.653497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.653615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.653729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.653755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.653855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.653974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.653998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.654094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.654186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.654210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.654331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.654448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.654471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.654563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.654662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.654691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.654818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.654904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.654928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.655052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.655178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.655201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.655294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.655387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.655411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.655495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.655616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.655641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.655772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.655865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.655890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.656003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.656120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.656143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.656270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.656369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.656394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.656511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.656625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.656649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.656761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.656876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.656900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.657024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.657117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.657141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.657264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.657379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.657402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.657521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.657636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.657660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.657767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.657855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.537 [2024-11-26 04:41:49.657879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.537 qpair failed and we were unable to recover it. 00:30:10.537 [2024-11-26 04:41:49.657985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.658076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.658100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.658216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.658304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.658327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.658444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.658565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.658589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.658676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.658809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.658834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.658924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.659043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.659067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.659171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.659266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.659290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.659381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.659469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.659493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.659587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.659713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.659738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.659828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.659976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.660001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.660098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.660221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.660245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.660336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.660427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.660451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.660549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.660699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.660724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.660826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.660918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.660941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.661032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.661129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.661154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.661273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.661377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.661401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.661489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.661606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.661631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.661728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.661841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.661865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.661953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.662067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.662090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.662178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.662297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.662321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.662411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.662509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.662532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.662618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.662708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.662732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.662839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.662965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.662990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.663116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.663202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.663227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.663324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.663418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.663444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.663596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.663707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.663733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.538 qpair failed and we were unable to recover it. 00:30:10.538 [2024-11-26 04:41:49.663832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.538 [2024-11-26 04:41:49.663946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.663971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.664065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.664212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.664236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.664333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.664463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.664488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.664584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.664732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.664758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.664852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.664941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.664966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.665062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.665179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.665203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.665301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.665393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.665417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.665535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.665657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.665681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.665807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.665923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.665951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.666040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.666154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.666178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.666301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.666419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.666442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.666559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.666647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.666670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.666767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.666857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.666881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.666970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.667087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.667112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.667210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.667299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.667324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.667420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.667516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.667541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.667630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.667728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.667753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.667850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.667962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.667986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.668107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.668222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.668250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.668371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.668494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.668519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.668611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.668707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.668732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.668830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.668922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.539 [2024-11-26 04:41:49.668945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.539 qpair failed and we were unable to recover it. 00:30:10.539 [2024-11-26 04:41:49.669068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.669160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.669184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.669303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.669400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.669425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.669518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.669639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.669663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.669762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.669858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.669883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.669982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.670105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.670130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.670223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.670319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.670342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.670456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.670579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.670607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.670727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.670823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.670847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.670946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.671068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.671093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.671183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.671309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.671334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.671453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.671601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.671625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.671724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.671824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.671849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.671950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.672039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.672064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.672188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.672302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.672326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.672415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.672503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.672526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.672644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.672768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.672792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.672924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.673015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.673046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.673146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.673237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.673260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.673385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.673482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.673506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.673630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.673723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.673747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.673845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.673960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.673984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.674095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.674184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.674207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.674334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.674461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.674486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.674577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.674695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.674720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.674816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.674911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.674935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.675060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.675152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.675176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.675298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.675391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.675416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.675541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.675668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.540 [2024-11-26 04:41:49.675700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.540 qpair failed and we were unable to recover it. 00:30:10.540 [2024-11-26 04:41:49.675790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.675896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.675919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.676018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.676132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.676156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.676281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.676372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.676396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.676487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.676609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.676633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.676731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.676824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.676848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.676974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.677058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.677081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.677200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.677291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.677316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.677440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.677534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.677557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.677666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.677790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.677815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.677918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.678016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.678041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.678128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.678223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.678250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.678379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.678468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.678491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.678584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.678705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.678730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.678828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.678958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.678981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.679102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.679194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.679218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.679351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.679444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.679468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.679559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.679656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.679679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.679810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.679931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.679954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.680080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.680180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.680208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.680301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.680428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.680452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.680542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.680663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.680705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.680809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.680927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.680951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.681076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.681163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.681186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.681284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.681405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.681428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.681526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.681649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.681673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.681769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.681861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.681886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.682008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.682097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.682120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.682245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.682366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.541 [2024-11-26 04:41:49.682391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.541 qpair failed and we were unable to recover it. 00:30:10.541 [2024-11-26 04:41:49.682487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.682581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.682606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.682737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.682825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.682850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.682939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.683030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.683055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.683147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.683261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.683285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.683408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.683506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.683529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.683624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.683754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.683779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.683879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.683971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.683995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.684119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.684244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.684268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.684424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.684516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.684541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.684636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.684739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.684775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.684901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.684990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.685018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.685115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.685234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.685260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.685355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.685466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.685490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.685578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.685699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.685725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.685820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.685922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.685953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.686051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.686146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.686170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.686286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.686412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.686436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.686529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.686621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.686646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.686749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.686845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.686870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.687001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.687147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.687175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.687271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.687366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.687391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.687493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.687587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.687614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.687716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.687808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.687841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.687970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.688090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.688113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.688209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.688337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.688362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.688451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.688562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.688587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.688683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.688806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.688833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.688959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.689051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.689077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.542 qpair failed and we were unable to recover it. 00:30:10.542 [2024-11-26 04:41:49.689233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.542 [2024-11-26 04:41:49.689319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.543 [2024-11-26 04:41:49.689344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.543 qpair failed and we were unable to recover it. 00:30:10.543 [2024-11-26 04:41:49.689438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.689556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.689581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.689674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.689779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.689803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.689930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.690065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.690094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.690185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.690282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.690307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.690408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.690528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.690553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.690647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.690739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.690764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.690859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.690951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.690977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.691100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.691186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.691221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.691315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.691400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.691424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.691515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.691611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.691637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.691757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.691849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.691873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.691962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.692104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.692128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.692218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.692320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.692346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.692500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.692623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.692648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.692742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.692889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.692914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.826 [2024-11-26 04:41:49.693010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.693100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.826 [2024-11-26 04:41:49.693125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.826 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.693223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.693318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.693342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.693435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.693558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.693583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.693681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.693776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.693801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.693920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.694010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.694034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.694121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.694238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.694262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.694350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.694448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.694473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.694593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.694696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.694727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.694855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.694944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.694968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.695066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.695184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.695208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.695307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.695433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.695457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.695553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.695640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.695665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.695768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.695854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.695878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.695973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.696092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.696117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.696231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.696347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.696371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.696460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.696554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.696578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.696667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.696774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.696798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.696921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.697046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.697070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.697174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.697289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.697313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.697405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.697520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.697545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.697629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.697721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.697746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.697846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.697948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.697973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.827 qpair failed and we were unable to recover it. 00:30:10.827 [2024-11-26 04:41:49.698067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.827 [2024-11-26 04:41:49.698161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.698185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.698305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.698403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.698427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.698518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.698637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.698661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.698764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.698864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.698888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.699015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.699101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.699124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.699213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.699302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.699326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.699455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.699559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.699583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.699679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.699795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.699820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.699943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.700068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.700092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.700180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.700276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.700300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.700391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.700527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.700552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.700648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.700752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.700777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.700868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.700954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.700978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.701101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.701219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.701242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.701333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.701450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.701474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.701597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.701714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.701739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.701837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.701924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.701948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.702070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.702164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.702190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.702281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.702408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.702432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.702562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.702645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.702670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.828 qpair failed and we were unable to recover it. 00:30:10.828 [2024-11-26 04:41:49.702774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.702861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.828 [2024-11-26 04:41:49.702886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.702976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.703113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.703137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.703263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.703359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.703382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.703499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.703595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.703618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.703744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.703848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.703872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.704001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.704098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.704122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.704209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.704329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.704352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.704439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.704536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.704560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.704653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.704788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.704813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.704903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.705016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.705041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.705142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.705238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.705263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.705353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.705470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.705494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.705600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.705684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.705714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.705817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.705905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.705929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.706021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.706120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.706144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.706241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.706336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.706360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.706456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.706550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.706580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.706676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.706805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.706830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.706933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.707030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.707054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.707146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.707233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.707257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.707376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.707503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.707526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.707621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.707720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.707744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.707865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.707956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.707979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.829 qpair failed and we were unable to recover it. 00:30:10.829 [2024-11-26 04:41:49.708067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.708159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.829 [2024-11-26 04:41:49.708184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.708285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.708429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.708453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.708542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.708630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.708653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.708797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.708887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.708911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.709037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.709168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.709192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.709286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.709382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.709407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.709528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.709618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.709642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.709746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.709836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.709860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.709957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.710049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.710074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.710175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.710290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.710313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.710404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.710520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.710544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.710660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.710759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.710783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.710873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.710956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.710980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.711080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.711200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.711225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.711326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.711421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.711446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.711569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.711661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.711692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.711809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.711905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.711929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.712031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.712122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.712145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.712244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.712337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.712361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.712452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.712553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.712577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.712668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.712793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.712819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.712914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.713002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.830 [2024-11-26 04:41:49.713026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.830 qpair failed and we were unable to recover it. 00:30:10.830 [2024-11-26 04:41:49.713119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.713216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.713240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.713330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.713416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.713440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.713585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.713692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.713717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.713806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.713920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.713945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.714036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.714131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.714154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.714250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.714338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.714361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.714484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.714575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.714600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.714692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.714810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.714834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.714927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.715024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.715048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.715144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.715265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.715289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.715395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.715551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.715576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.715710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.715830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.715853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.715971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.716075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.716099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.716192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.716309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.716334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.716425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.716517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.716541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.716669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.716764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.716789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.716886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.716990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.717014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.717109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.717202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.717225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.717347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.717433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.717457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.717544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.717663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.717691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.717776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.717895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.717919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.718007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.718121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.718145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.718237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.718393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.831 [2024-11-26 04:41:49.718422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.831 qpair failed and we were unable to recover it. 00:30:10.831 [2024-11-26 04:41:49.718568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.718665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.718694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.718793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.718913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.718938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.719054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.719141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.719165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.719261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.719356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.719379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.719473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.719565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.719589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.719683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.719784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.719810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.719914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.720003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.720027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.720120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.720216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.720241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.720333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.720479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.720503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.720607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.720723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.720749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.720851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.720967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.720991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.721087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.721214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.721238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.721333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.721423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.721448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.721538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.721661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.721690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.721782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.721906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.721931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.832 [2024-11-26 04:41:49.722030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.722154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.832 [2024-11-26 04:41:49.722178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.832 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.722302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.722383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.722407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.722539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.722624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.722649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.722772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.722857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.722882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.722965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.723085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.723108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.723238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.723353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.723377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.723509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.723601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.723624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.723720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.723816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.723840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.723928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.724030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.724054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.724168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.724254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.724277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.724368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.724453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.724478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.724602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.724693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.724718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.724811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.724910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.724935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.725031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.725151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.725174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.725265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.725358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.725382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.725502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.725601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.725625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.725736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.725833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.725857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.725953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.726039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.726063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.726193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.726279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.726303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.726408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.726529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.726553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.726649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.726766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.726791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-11-26 04:41:49.726887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.727007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.833 [2024-11-26 04:41:49.727031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.727153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.727244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.727268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.727362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.727454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.727478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.727595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.727724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.727748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.727833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.727917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.727948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.728048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.728195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.728219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.728313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.728401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.728424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.728539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.728631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.728656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.728784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.728888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.728912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.729004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.729098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.729122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.729217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.729334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.729358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.729456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.729547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.729572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.729710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.729804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.729829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.729920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.730021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.730046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.730152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.730246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.730270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.730396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.730517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.730541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.730642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.730762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.730786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.730879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.730969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.730993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.731089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.731212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.731235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.731342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.731432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.731456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.731549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.731665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.731694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.731792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.731909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.731934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.732059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.732173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.732196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-11-26 04:41:49.732287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.732373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.834 [2024-11-26 04:41:49.732398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.732481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.732594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.732618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.732749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.732835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.732858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.732960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.733056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.733079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.733162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.733254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.733280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.733436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.733551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.733575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.733660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.733775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.733801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.733921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.734012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.734036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.734127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.734222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.734245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.734340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.734431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.734455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.734538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.734663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.734697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.734802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.734903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.734927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.735027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.735114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.735138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.735258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.735345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.735370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.735463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.735587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.735612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.735731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.735850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.735874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.735979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.736068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.736092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.736183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.736278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.736301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.736400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.736490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.736515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.736644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.736771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.736796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.736915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.737005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.737028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.737126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.737246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.737269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-11-26 04:41:49.737395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.835 [2024-11-26 04:41:49.737486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.737510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.737605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.737722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.737746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.737839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.737935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.737958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.738053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.738176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.738200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.738326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.738423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.738448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.738540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.738629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.738652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.738754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.738904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.738927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.739047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.739167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.739190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.739281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.739386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.739410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.739533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.739621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.739645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.739777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.739892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.739920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.740019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.740143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.740167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.740268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.740363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.740387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.740477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.740571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.740595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.740684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.740861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.740885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.740975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.741097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.741120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.741210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.741337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.741361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.741510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.741609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.741632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.741733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.741819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.741843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.741940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.742034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.742059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.742153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.742283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.742307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.836 [2024-11-26 04:41:49.742401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.742518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.836 [2024-11-26 04:41:49.742541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.836 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.742668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.742766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.742791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.742886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.743006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.743030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.743151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.743263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.743288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.743406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.743500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.743524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.743649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.743757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.743782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.743880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.744000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.744024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.744116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.744239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.744264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.744365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.744450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.744473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.744568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.744664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.744693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.744824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.744920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.744944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.745034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.745151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.745175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.745273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.745385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.745409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.745507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.745627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.745652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.745751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.745872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.745896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.746018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.746107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.746131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.746222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.746312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.746336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.746445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.746536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.746560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.746676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.746783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.746807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.746925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.747018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.747042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.747137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.747234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.747260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.747388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.747478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.837 [2024-11-26 04:41:49.747503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.837 qpair failed and we were unable to recover it. 00:30:10.837 [2024-11-26 04:41:49.747605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.747730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.747755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.747847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.747937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.747960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.748084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.748174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.748199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.748316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.748404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.748428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.748533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.748619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.748643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.748767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.748855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.748878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.748972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.749061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.749085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.749189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.749302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.749326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.749447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.749536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.749561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.749651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.749744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.749768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.749857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.749954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.749978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.750099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.750188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.750212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.750333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.750421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.750445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.750552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.750641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.750665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.750795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.750914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.750939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.751036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.751183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.751207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.838 [2024-11-26 04:41:49.751303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.751395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.838 [2024-11-26 04:41:49.751420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.838 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.751542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.751635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.751659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.751780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.751895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.751923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.752051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.752137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.752161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.752247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.752331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.752355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.752474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.752564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.752588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.752716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.752807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.752832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.752957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.753046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.753070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.753176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.753265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.753289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.753382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.753484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.753509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.753605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.753702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.753726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.753811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.753929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.753952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.754043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.754127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.754151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.754248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.754342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.754366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.754485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.754604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.754628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.754767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.754858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.754882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.755034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.755128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.755156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.755274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.755359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.755383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.755533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.755623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.755647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.755765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.755851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.755875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.755963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.756044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.756068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.839 [2024-11-26 04:41:49.756154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.756249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.839 [2024-11-26 04:41:49.756273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.839 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.756379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.756502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.756527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.756614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.756714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.756739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.756869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.756959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.756983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.757077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.757157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.757181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.757273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.757376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.757399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.757487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.757607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.757631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.757723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.757819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.757843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.757937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.758054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.758078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.758180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.758269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.758293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.758384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.758484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.758508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.758635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.758742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.758766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.758888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.758981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.759006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.759140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.759223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.759247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.759336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.759427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.759451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.759571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.759660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.759684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.759817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.759904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.759929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.760020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.760132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.760156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.760238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.760339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.760363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.760453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.760569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.760594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.760709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.760808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.760832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.760922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.761039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.761063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.840 qpair failed and we were unable to recover it. 00:30:10.840 [2024-11-26 04:41:49.761189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.840 [2024-11-26 04:41:49.761279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.761307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.761427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.761541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.761565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.761696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.761788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.761813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.761907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.762055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.762079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.762180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.762309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.762333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.762430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.762520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.762543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.762663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.762794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.762818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.762911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.762999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.763023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.763141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.763239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.763265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.763358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.763479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.763505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.763621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.763709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.763734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.763835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.763956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.763980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.764080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.764161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.764185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.764278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.764368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.764394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.764498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.764614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.764638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.764739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.764827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.764850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.764968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.765064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.765088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.765181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.765274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.765298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.765389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.765511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.765536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.765626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.765755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.765780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.765879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.765970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.765995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.766122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.766211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.766234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.841 qpair failed and we were unable to recover it. 00:30:10.841 [2024-11-26 04:41:49.766360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.841 [2024-11-26 04:41:49.766452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.766478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.766602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.766753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.766778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.766877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.766977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.767000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.767154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.767249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.767273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.767368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.767464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.767487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.767581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.767701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.767726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.767823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.767921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.767945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.768064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.768157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.768182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.768274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.768395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.768419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.768516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.768607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.768632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.768761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.768863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.768887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.768986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.769105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.769128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.769244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.769333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.769358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.769456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.769550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.769574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.769695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.769819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.769843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.769940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.770029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.770055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.770156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.770276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.770300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.770393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.770488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.770511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.770599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.770691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.770715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.770813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.770917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.770941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.771046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.771145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.771169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.771318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.771410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.842 [2024-11-26 04:41:49.771434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.842 qpair failed and we were unable to recover it. 00:30:10.842 [2024-11-26 04:41:49.771532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.771623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.771647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.771779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.771898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.771922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.772011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.772102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.772128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.772246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.772361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.772385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.772481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.772601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.772625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.772718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.772812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.772835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.772926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.773014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.773038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.773128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.773247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.773276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.773368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.773463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.773487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.773578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.773665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.773693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.773784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.773865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.773889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.773990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.774103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.774127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.774226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.774315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.774339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.774456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.774576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.774600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.774693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.774791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.774815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.774907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.774993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.775016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.775115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.775236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.775260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.775349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.775437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.775462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.775587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.775731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.775756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.775840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.775931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.775955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.776061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.776173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.776197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.776289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.776374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.776398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.843 qpair failed and we were unable to recover it. 00:30:10.843 [2024-11-26 04:41:49.776506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.776600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.843 [2024-11-26 04:41:49.776625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.776724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.776844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.776868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.776963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.777061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.777085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.777207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.777296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.777319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.777416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.777512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.777536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.777654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.777751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.777775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.777914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.778012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.778035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.778127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.778245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.778269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.778370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.778493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.778517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.778642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.778737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.778761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.778859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.778957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.778981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.779077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.779190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.779214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.779331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.779426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.779450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.779571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.779666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.779695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.779787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.779881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.779905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.780034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.780125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.780149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.780244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.780345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.780371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.780496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.780580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.780604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.844 qpair failed and we were unable to recover it. 00:30:10.844 [2024-11-26 04:41:49.780730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.844 [2024-11-26 04:41:49.780853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.780876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.780978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.781076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.781100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.781201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.781289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.781313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.781401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.781495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.781518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.781638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.781733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.781758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.781850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.781944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.781968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.782093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.782213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.782236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.782353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.782438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.782462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.782596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.782729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.782759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.782852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.782949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.782973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.783090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.783215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.783239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.783330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.783430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.783454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.783572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.783714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.783738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.783836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.783961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.783984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.784082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.784177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.784201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.784291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.784381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.784405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.784494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.784575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.784600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.784697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.784819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.784843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.784932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.785058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.785086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.785179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.785290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.785313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.785409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.785556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.785581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.785669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.785761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.845 [2024-11-26 04:41:49.785785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.845 qpair failed and we were unable to recover it. 00:30:10.845 [2024-11-26 04:41:49.785880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.785968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.785991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.786082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.786200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.786223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.786314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.786433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.786457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.786555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.786682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.786711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.786810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.786947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.786971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.787060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.787176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.787200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.787315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.787426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.787451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.787542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.787641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.787665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.787763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.787856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.787880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.787981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.788081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.788105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.788201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.788320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.788343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.788434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.788557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.788581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.788675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.788801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.788825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.788913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.789003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.789027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.789124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.789243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.789267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.789386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.789480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.789504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.789630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.789755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.789780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.789874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.789968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.789992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.790091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.790211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.790235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.790359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.790483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.790508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.790598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.790716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.790742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.790867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.790984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.791007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.846 qpair failed and we were unable to recover it. 00:30:10.846 [2024-11-26 04:41:49.791109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.846 [2024-11-26 04:41:49.791193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.791217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.791310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.791435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.791460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.791556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.791674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.791704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.791800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.791894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.791920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.792044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.792164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.792188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.792280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.792373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.792398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.792489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.792617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.792641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.792769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.792861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.792885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.792980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.793102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.793127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.793214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.793307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.793332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.793453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.793535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.793559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.793653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.793750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.793774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.793875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.794000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.794025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.794145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.794233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.794256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.794347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.794438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.794463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.794557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.794691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.794721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.794847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.794935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.794959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.795083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.795175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.795198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.795285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.795370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.795394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.795510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.795597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.795620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.795722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.795851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.795875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.847 qpair failed and we were unable to recover it. 00:30:10.847 [2024-11-26 04:41:49.795995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.796115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.847 [2024-11-26 04:41:49.796138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.796229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.796322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.796346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.796446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.796573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.796598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.796712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.796834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.796858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.796952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.797085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.797109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.797210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.797336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.797360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.797488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.797579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.797603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.797721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.797806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.797831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.797956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.798049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.798073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.798161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.798257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.798280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.798427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.798518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.798541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.798627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.798752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.798777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.798902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.799019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.799044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.799134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.799234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.799259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.799385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.799479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.799504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.799621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.799756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.799781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.799869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.799960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.799984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.800103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.800197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.800223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.800319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.800420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.800445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.800572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.800660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.800690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.800784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.800904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.800929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.801020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.801109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.801133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.801216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.801297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.848 [2024-11-26 04:41:49.801322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.848 qpair failed and we were unable to recover it. 00:30:10.848 [2024-11-26 04:41:49.801415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.801562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.801586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.801679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.801788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.801814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.801916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.802010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.802034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.802161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.802250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.802274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.802368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.802487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.802511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.802613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.802716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.802741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.802827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.802919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.802943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.803068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.803162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.803187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.803306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.803425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.803449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.803544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.803631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.803655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.803764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.803854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.803878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.803977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.804069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.804093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.804188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.804309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.804334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.804421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.804544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.804568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.804683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.804794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.804819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.804917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.805009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.805033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.805151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.805240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.805264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.805373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.805464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.805488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.805583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.805668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.805708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.805807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.805893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.805916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.806034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.806154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.806178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.849 qpair failed and we were unable to recover it. 00:30:10.849 [2024-11-26 04:41:49.806303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.806394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.849 [2024-11-26 04:41:49.806419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.806516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.806634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.806663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.806762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.806848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.806872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.806970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.807084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.807109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.807233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.807327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.807350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.807447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.807536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.807560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.807649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.807754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.807786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.807904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.808026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.808050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.808153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.808245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.808268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.808352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.808444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.808470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.808564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.808712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.808738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.808856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.808944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.808968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.809107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.809255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.809279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.809401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.809488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.809512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.809637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.809732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.809757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.809855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.809970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.809994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.810095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.810174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.810197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.810323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.810438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.810461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.810558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.810659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.810682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.810778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.810878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.850 [2024-11-26 04:41:49.810901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.850 qpair failed and we were unable to recover it. 00:30:10.850 [2024-11-26 04:41:49.810991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.811108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.811131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.811222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.811311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.811334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.811433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.811514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.811538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.811622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.811713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.811737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.811830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.811922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.811946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.812070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.812160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.812184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.812272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.812363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.812386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.812476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.812561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.812585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.812674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.812807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.812831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.812932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.813024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.813047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.813137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.813256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.813280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.813380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.813477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.813500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.813615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.813741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.813766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.813858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.813954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.813979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.814071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.814165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.814188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.814281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.814395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.814419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.814512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.814600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.814624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.814744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.814863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.814887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.814977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.815074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.815097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.815185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.815285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.815308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.815401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.815487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.815512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.815630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.815735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.815760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.851 [2024-11-26 04:41:49.815851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.815970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.851 [2024-11-26 04:41:49.815999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.851 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.816120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.816213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.816238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.816330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.816445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.816469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.816597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.816692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.816716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.816817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.816907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.816931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.817051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.817139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.817163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.817260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.817348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.817373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.817526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.817617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.817641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.817732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.817833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.817858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.817950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.818046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.818070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.818162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.818278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.818305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.818401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.818521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.818544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.818639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.818760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.818784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.818883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.818974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.818999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.819097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.819243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.819266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.819389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.819487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.819511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.819631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.819755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.819780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.819869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.819955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.819979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.820095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.820214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.820237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.820323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.820443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.820467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.820593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.820712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.820737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.820831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.820924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.820948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.852 [2024-11-26 04:41:49.821051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.821148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.852 [2024-11-26 04:41:49.821172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.852 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.821264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.821386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.821409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.821540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.821626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.821650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.821749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.821844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.821867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.821988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.822113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.822137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.822228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.822317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.822340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.822440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.822523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.822547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.822639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.822736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.822761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.822880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.822966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.822991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.823120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.823238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.823263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.823352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.823451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.823475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.823561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.823653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.823677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.823802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.823893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.823917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.824022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.824132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.824156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.824256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.824372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.824396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.824494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.824596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.824621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.824715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.824840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.824864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.824964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.825082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.825106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.825211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.825340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.825365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.825464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.825592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.825616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.825713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.825859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.825884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.825977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.826074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.826098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.826191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.826315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.826339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.826467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.826583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.826608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.853 [2024-11-26 04:41:49.826706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.826829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.853 [2024-11-26 04:41:49.826853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.853 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.826941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.827058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.827081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.827182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.827272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.827296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.827413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.827533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.827557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.827645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.827750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.827775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.827865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.827989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.828018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.828173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.828265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.828288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.828381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.828476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.828501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.828596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.828726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.828751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.828870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.828963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.828987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.829092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.829236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.829260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.829360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.829457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.829481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.829601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.829702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.829726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.829819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.829905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.829929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.830051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.830144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.830167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.830264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.830386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.830409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.830531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.830622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.830645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.830740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.830837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.830861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.830958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.831048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.831072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.831165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.831278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.831302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.831401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.831497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.831521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.854 qpair failed and we were unable to recover it. 00:30:10.854 [2024-11-26 04:41:49.831650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.854 [2024-11-26 04:41:49.831752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.831776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.831899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.831991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.832014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.832101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.832190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.832214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.832309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.832401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.832425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.832523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.832612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.832636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.832730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.832856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.832881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.832977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.833100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.833124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.833224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.833319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.833343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.833436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.833529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.833552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.833666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.833773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.833798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.833917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.834019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.834045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.834135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.834224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.834249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.834340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.834485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.834508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.834614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.834708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.834733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.834828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.834947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.834970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.835066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.835181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.835205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.835324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.835445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.835468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.835594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.835684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.835717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.835811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.835898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.835923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.836043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.836126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.836150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.836254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.836369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.855 [2024-11-26 04:41:49.836394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.855 qpair failed and we were unable to recover it. 00:30:10.855 [2024-11-26 04:41:49.836491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.836578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.836601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.836721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.836806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.836829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.836926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.837016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.837039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.837146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.837261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.837284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.837406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.837503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.837528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.837628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.837721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.837747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.837852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.837970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.837994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.838090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.838182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.838206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.838325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.838445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.838470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.838570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.838658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.838683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.838794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.838915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.838939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.839033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.839125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.839150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.839269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.839362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.839386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.839490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.839609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.839633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.839734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.839825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.839853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.839952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.840097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.840121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.840223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.840367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.840391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.856 qpair failed and we were unable to recover it. 00:30:10.856 [2024-11-26 04:41:49.840513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.856 [2024-11-26 04:41:49.840601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.840625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.840727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.840813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.840837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.840955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.841067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.841092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.841182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.841270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.841293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.841416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.841498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.841523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.841616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.841746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.841772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.841870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.841992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.842029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.842149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.842265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.842289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.842387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.842480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.842504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.842623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.842732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.842757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.842874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.842992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.843015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.843109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.843199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.843225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.843315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.843434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.843459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.843551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.843633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.843658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.843840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.843924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.843949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.844046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.844167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.844192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.844280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.844400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.844425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.844513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.844598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.844622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.844731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.844824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.844848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.844949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.845045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.845070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.845159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.845272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.845297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.857 qpair failed and we were unable to recover it. 00:30:10.857 [2024-11-26 04:41:49.845394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.857 [2024-11-26 04:41:49.845483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.845507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.845609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.845730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.845754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.845851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.845943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.845968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.846086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.846213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.846237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.846330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.846444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.846468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.846590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.846674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.846703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.846826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.846917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.846941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.847031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.847158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.847183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.847279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.847399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.847423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.847521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.847619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.847642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.847774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.847861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.847884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.848015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.848136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.848159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.848286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.848378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.848402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.848493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.848610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.848634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.848772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.848867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.848891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.848983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.849104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.849130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.849228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.849317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.849343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.849462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.849557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.849586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.849710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.849819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.849847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.849975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.850098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.850124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.850220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.850345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.850371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.850472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.850568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.850594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.850699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.850854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.858 [2024-11-26 04:41:49.850879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.858 qpair failed and we were unable to recover it. 00:30:10.858 [2024-11-26 04:41:49.850980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.851087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.851112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.851265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.851357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.851384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.851495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.851587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.851612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.851718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.851816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.851842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.851935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.852028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.852059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.852182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.852284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.852315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.852439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.852531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.852558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.852661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.852769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.852795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.852893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.853052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.853077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.853166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.853261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.853293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.853393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.853510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.853535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.853644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.853753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.853778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.853898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.853993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.854020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.854115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.854207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.854234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.854356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.854447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.854477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.854581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.854672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.854702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.854800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.854925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.854951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.855073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.855167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.855192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.855289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.855379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.855404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.855499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.855589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.855614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.855710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.855830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.859 [2024-11-26 04:41:49.855855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.859 qpair failed and we were unable to recover it. 00:30:10.859 [2024-11-26 04:41:49.855949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.856044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.856069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.856175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.856294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.856319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.856439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.856567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.856592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.856692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.856799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.856829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.856922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.857042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.857067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.857172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.857294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.857319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.857439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.857539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.857571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.857677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.857782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.857807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.857902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.858005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.858031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.858129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.858229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.858254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.858359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.858477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.858502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.858621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.858726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.858751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.858848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.858940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.858965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.859088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.859177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.859202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.859309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.859435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.859460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.859553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.859640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.859664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.859781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.859930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.859956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.860049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.860148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.860175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.860299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.860390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.860416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.860569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.860703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.860730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.860823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.860915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.860940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.860 [2024-11-26 04:41:49.861046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.861172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.860 [2024-11-26 04:41:49.861198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.860 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.861320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.861417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.861442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.861537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.861625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.861649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.861756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.861887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.861912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.862020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.862137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.862162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.862286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.862410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.862435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.862528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.862626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.862652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.862788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.862918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.862943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.863051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.863142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.863167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.863295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.863415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.863441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.863529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.863623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.863648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.863751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.863875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.863900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.864004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.864090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.864115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.864240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.864334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.864360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.864488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.864613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.864639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.864740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.864837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.864861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.864961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.865044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.865069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.865192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.865319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.865344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.865430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.865523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.865548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.865667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.865778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.865803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.865897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.866022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.866058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.866146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.866240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.866267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.866365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.866458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.866484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.866608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.866699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.861 [2024-11-26 04:41:49.866725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.861 qpair failed and we were unable to recover it. 00:30:10.861 [2024-11-26 04:41:49.866822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.866940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.866965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.867125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.867223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.867248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.867342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.867435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.867460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.867585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.867667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.867697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.867799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.867922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.867949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.868042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.868149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.868174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.868265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.868358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.868383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.868517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.868640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.868665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.868816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.868925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.868954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.869101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.869196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.869221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.869317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.869433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.869458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.869581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.869679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.869713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.869819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.869944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.869968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.870063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.870158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.870185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.870278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.870399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.870426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.870553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.870645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.870670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.870782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.870906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.870933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.871071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.871167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.871192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.862 qpair failed and we were unable to recover it. 00:30:10.862 [2024-11-26 04:41:49.871292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.862 [2024-11-26 04:41:49.871392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.871417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.871520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.871652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.871677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.871781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.871873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.871898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.872021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.872142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.872167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.872372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.872459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.872484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.872610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.872715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.872741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.872839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.872931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.872956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.873055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.873143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.873168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.873288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.873489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.873514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.873600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.873727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.873752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.873851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.873947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.873972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.874072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.874198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.874224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.874322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.874413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.874439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.874534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.874624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.874649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.874780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.874906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.874932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.875061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.875184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.875209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.875303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.875416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.875441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.875545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.875631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.875656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.875752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.875851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.875877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.876082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.876204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.876230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.876351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.876447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.876472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.876586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.876724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.863 [2024-11-26 04:41:49.876752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.863 qpair failed and we were unable to recover it. 00:30:10.863 [2024-11-26 04:41:49.876877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.877008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.877032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.877128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.877230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.877254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.877354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.877447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.877471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.877572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.877663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.877695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.877823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.877941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.877965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.878058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.878149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.878174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.878269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.878391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.878416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.878504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.878601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.878626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.878719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.878840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.878864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.878956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.879060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.879084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.879207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.879321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.879346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.879441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.879591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.879616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.879740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.879832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.879856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.879982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.880075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.880100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.880231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.880318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.880342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.880436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.880551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.880575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.880710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.880839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.880863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.880997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.881087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.881111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.881208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.881354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.881378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.881478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.881596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.881619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.881739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.881834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.881858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.864 [2024-11-26 04:41:49.881981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.882097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.864 [2024-11-26 04:41:49.882120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.864 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.882238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.882381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.882405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.882526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.882625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.882650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.882748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.882843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.882867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.882959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.883075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.883100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.883232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.883325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.883351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.883436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.883524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.883547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.883672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.883775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.883799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.883900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.883996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.884020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.884143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.884259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.884283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.884387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.884484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.884510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.884604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.884730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.884757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.884893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.884987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.885012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.885165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.885253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.885278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.885402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.885492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.885518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.885646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.885739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.885765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.885886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.885974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.885998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.886084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.886173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.886197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.886289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.886423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.886448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.886572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.886664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.886693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.886784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.886886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.886913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.865 [2024-11-26 04:41:49.887005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.887125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.865 [2024-11-26 04:41:49.887149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.865 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.887274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.887363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.887388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.887493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.887623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.887647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.887746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.887842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.887867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.887963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.888056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.888080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.888177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.888264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.888288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.888404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.888540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.888564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.888650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.888751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.888781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.888877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.888999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.889023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.889146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.889240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.889264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.889367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.889454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.889478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.889604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.889703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.889730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.889820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.889942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.889966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.890057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.890161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.890185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.890282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.890377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.890403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.890554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.890643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.890667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.890766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.890853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.890877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.891027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.891119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.891148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.891262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.891383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.891409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.891508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.891596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.891621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.891729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.891856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.891881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.892010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.892107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.892132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.892229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.892317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.892342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.866 qpair failed and we were unable to recover it. 00:30:10.866 [2024-11-26 04:41:49.892433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.866 [2024-11-26 04:41:49.892535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.892559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.892678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.892806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.892833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.892935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.893034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.893058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.893160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.893253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.893277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.893400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.893500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.893529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.893618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.893716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.893742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.893836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.893958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.893982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.894072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.894161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.894185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.894328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.894450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.894475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.894564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.894661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.894691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.894813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.894911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.894937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.895029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.895146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.895171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.895274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.895362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.895387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.895480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.895600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.895624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.895759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.895846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.895871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.895969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.896064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.896089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.896215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.896334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.896358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.896482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.896568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.896593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.896695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.896791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.896815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.896929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.897055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.897081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.897227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.897348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.897372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.897494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.897590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.897614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.897713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.897815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.897839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.867 qpair failed and we were unable to recover it. 00:30:10.867 [2024-11-26 04:41:49.897954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.867 [2024-11-26 04:41:49.898079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.898105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.898196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.898333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.898357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.898460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.898582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.898606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.898699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.898821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.898844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.898947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.899041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.899065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.899153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.899238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.899262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.899358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.899475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.899499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.899616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.899713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.899737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.899830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.899949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.899973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.900074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.900189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.900212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.900337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.900421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.900444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.900563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.900663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.900692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.900792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.900888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.900912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.901027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.901121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.901146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.901238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.901358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.901381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.901467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.901549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.901572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.901663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.901796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.901820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.901917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.902013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.902036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.868 [2024-11-26 04:41:49.902125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.902229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.868 [2024-11-26 04:41:49.902253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.868 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.902377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.902467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.902491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.902605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.902717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.902746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.902855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.902953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.902978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.903104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.903214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.903240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.903361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.903510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.903535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.903742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.903846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.903873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.903966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.904059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.904084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.904208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.904332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.904357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.904449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.904540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.904563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.904693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.904816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.904842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.904940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.905056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.905081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.905180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.905300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.905324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.905417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.905507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.905531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.905623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.905726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.905750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.905851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.905944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.905969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.906103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.906200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.906225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.906357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.906454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.906480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.906594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.906742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.906768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.906897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.906993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.907017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.907119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.907214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.907239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.907329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.907447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.907471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.869 qpair failed and we were unable to recover it. 00:30:10.869 [2024-11-26 04:41:49.907594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.869 [2024-11-26 04:41:49.907697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.907722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.907814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.907904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.907928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.908051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.908175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.908201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.908305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.908397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.908423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.908516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.908606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.908630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.908739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.908853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.908877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.908976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.909097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.909121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.909208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.909335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.909360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.909457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.909549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.909573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.909698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.909792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.909817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.909942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.910049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.910074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.910171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.910256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.910281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.910414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.910559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.910588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.910717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.910814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.910839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.910941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.911056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.911080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.911175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.911294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.911318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.911434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.911559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.911583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.911692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.911795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.911821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.911917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.912014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.912039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.912140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.912233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.912258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.912356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.912482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.912507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.870 [2024-11-26 04:41:49.912598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.912697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.870 [2024-11-26 04:41:49.912722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.870 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.912822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.912914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.912942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.913065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.913154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.913178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.913271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.913391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.913415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.913531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.913622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.913646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.913749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.913842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.913865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.913954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.914075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.914100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.914228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.914318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.914342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.914457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.914554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.914580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.914679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.914778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.914802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.914889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.914987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.915010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.915115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.915202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.915228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.915363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.915450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.915474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.915591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.915710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.915736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.915824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.915922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.915945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.916026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.916158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.916183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.916286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.916379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.916403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.916490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.916587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.916611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.916725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.916816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.916840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.916934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.917054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.917079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.917172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.917269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.917294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.917399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.917518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.917542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.917643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.917771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.917795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.917892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.917978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.918003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.918130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.918216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.918241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.918339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.918429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.918453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.871 [2024-11-26 04:41:49.918575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.918695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.871 [2024-11-26 04:41:49.918720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.871 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.918813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.918928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.918953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.919042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.919169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.919194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.919287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.919371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.919396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.919512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.919595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.919619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.919716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.919807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.919832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.919929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.920022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.920046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.920168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.920264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.920287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.920380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.920494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.920519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.920623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.920715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.920740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.920861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.920956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.920981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.921079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.921176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.921201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.921292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.921405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.921429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.921525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.921615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.921639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.921764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.921894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.921919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.922013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.922160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.922184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.922274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.922364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.922393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.922511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.922599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.922624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.922753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.922842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.922867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.922958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.923050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.923075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.923176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.923269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.923293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.923415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.923507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.923533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.923630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.923768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.923794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.872 qpair failed and we were unable to recover it. 00:30:10.872 [2024-11-26 04:41:49.923912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.872 [2024-11-26 04:41:49.924000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.924025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.924151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.924238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.924263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.924359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.924442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.924467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.924549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.924637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.924671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.924778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.924901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.924925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.925045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.925140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.925165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.925291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.925412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.925437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.925531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.925648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.925673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.925774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.925872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.925897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.925998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.926114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.926139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.926233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.926357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.926381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.926474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.926591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.926615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.926705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.926831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.926856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.926952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.927068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.927092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.927191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.927307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.927331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.927415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.927529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.927554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.927643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.927756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.927781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.927927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.928014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.928039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.928135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.928249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.928274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.928365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.928454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.928480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.928580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.928700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.928725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.928846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.928934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.928959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.929081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.929168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.929193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.929287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.929403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.929427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.929556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.929646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.929672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.929772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.929891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.929915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.873 qpair failed and we were unable to recover it. 00:30:10.873 [2024-11-26 04:41:49.930016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.873 [2024-11-26 04:41:49.930131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.930156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.930256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.930343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.930367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.930466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.930555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.930578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.930673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.930765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.930790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.930877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.930970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.930996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.931147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.931238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.931263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.931351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.931467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.931492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.931620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.931713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.931738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.931831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.931922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.931947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.932072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.932191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.932216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.932310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.932431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.932455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.932570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.932696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.932721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.932841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.932937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.932961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.933048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.933194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.933219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.933322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.933416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.933441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.933532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.933617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.933642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.933752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.933835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.933860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.933989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.934075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.934099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.934225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.934320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.934348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.934473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.934587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.934611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.934765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.934885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.934910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.935030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.935126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.935152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.874 qpair failed and we were unable to recover it. 00:30:10.874 [2024-11-26 04:41:49.935255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.874 [2024-11-26 04:41:49.935403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.935428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.935513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.935605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.935629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.935720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.935820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.935846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.935945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.936057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.936081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.936166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.936247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.936271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.936367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.936482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.936507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.936594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.936694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.936719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.936817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.936902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.936926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.937040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.937125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.937149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.937270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.937361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.937386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.937474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.937588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.937613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.937713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.937862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.937886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.937972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.938054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.938078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.938179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.938274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.938300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.938401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.938523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.938548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.938638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.938752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.938777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.938867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.938958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.938983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.939105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.939192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.939215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.939314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.939429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.939454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.939547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.939664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.939698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.939784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.939884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.939907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.939994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.940079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.940103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.940189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.940315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.940338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.940459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.940575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.940600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.940695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.940785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.940810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.940928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.941042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.941066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.941156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.941248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.941271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.941423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.941517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.875 [2024-11-26 04:41:49.941542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.875 qpair failed and we were unable to recover it. 00:30:10.875 [2024-11-26 04:41:49.941635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.941723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.941748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.941844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.941935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.941959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.942047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.942160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.942184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.942285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.942378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.942402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.942551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.942665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.942706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.942827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.942921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.942945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.943063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.943158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.943181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.943278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.943401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.943425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.943523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.943615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.943639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.943737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.943859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.943883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.943983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.944104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.944128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.944221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.944320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.944345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.944435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.944559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.944584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.944676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.944804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.944828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.944919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.945010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.945035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.945131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.945218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.945242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.945343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.945431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.945454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.945576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.945704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.945729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.945822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.945941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.945965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.946060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.946154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.946183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.946334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.946417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.946441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.946532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.946647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.946672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.946787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.946878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.946903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.947025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.947140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.947164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.947257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.947354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.947377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.947495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.947590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.947614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.947707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.947827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.947851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.947968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.948085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.948109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.876 qpair failed and we were unable to recover it. 00:30:10.876 [2024-11-26 04:41:49.948196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.948313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.876 [2024-11-26 04:41:49.948337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.948427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.948516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.948539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.948640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.948727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.948752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.948879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.948968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.948992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.949113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.949200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.949224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.949311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.949430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.949454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.949546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.949635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.949661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.949765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.949852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.949876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.949976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.950094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.950118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.950233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.950321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.950344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.950438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.950591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.950615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.950747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.950845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.950869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.950963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.951051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.951076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.951177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.951294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.951318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.951421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.951508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.951533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.951624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.951736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.951761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.951855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.951938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.951962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.952068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.952157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.952181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.952269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.952363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.952387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.952483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.952605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.952630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.952724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.952831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.952855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.952943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.953060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.953084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.953200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.953295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.953319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.953415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.953534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.953558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.953650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.953749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.953775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.953895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.954030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.954054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.954152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.954268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.954292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.954416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.954506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.954530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.954630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.954723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.954748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.954841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.954926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.877 [2024-11-26 04:41:49.954951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.877 qpair failed and we were unable to recover it. 00:30:10.877 [2024-11-26 04:41:49.955052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.955141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.955164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.955279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.955367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.955391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.955492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.955589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.955619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.955748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.955870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.955894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.956015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.956115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.956139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.956257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.956346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.956370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.956456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.956551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.956575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.956669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.956789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.956813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.956928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.957019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.957043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.957138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.957260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.957284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.957376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.957468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.957491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.957611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.957710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.957736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.957831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.957938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.957968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.958068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.958167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.958190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.958308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.958402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.958427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.958524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.958614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.958638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.958731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.958827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.958851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.958975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.959087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.959111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.959202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.959295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.959320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.959439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.959537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.959560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.959655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.959778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.959803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.959894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.960010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.960035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.960138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.960229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.960254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.960359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.960457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.960481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.960580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.960665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.960694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.960786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.960880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.878 [2024-11-26 04:41:49.960904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.878 qpair failed and we were unable to recover it. 00:30:10.878 [2024-11-26 04:41:49.960994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.961082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.961106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.961204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.961295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.961319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.961444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.961530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.961554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.961664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.961766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.961791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.961911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.962005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.962029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.962124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.962218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.962242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.962336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.962425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.962449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.962557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.962640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.962663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.962772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.962891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.962916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.963009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.963096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.963119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.963245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.963347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.963373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.963468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.963558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.963582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.963680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.963800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.963824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.963920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.964006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.964031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.964154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.964252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.964276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.964372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.964457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.964481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.964620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.964715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.964740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.964837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.964987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.965012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.965104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.965206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.965230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.965327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.965421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.965446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.965568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.965666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.965697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.965790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.965881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.965906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.965994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.966082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.966118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.966209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.966306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.966330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.966426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.966551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.966575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.966666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.966790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.966815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.966905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.967018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.967042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.879 [2024-11-26 04:41:49.967170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.967255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.879 [2024-11-26 04:41:49.967282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.879 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.967410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.967501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.967526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.967647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.967806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.967831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.967931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.968023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.968047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.968168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.968256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.968280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.968371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.968464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.968488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.968588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.968706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.968731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.968822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.968914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.968938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.969039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.969128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.969151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.969270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.969356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.969382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.969478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.969596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.969621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.969723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.969821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.969846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.969930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.970034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.970058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.970155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.970245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.970269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.970392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.970476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.970501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.970634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.970728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.970753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.970844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.970959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.970983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.971085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.971176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.971203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.971302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.971418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.971442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.971533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.971615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.971640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.971768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.971859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.971883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.971995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.972088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.972113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.972202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.972290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.972314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.972408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.972498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.972522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.972615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.972715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.972741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.972837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.972956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.972980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.973105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.973193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.973217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.973316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.973437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.973462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.880 qpair failed and we were unable to recover it. 00:30:10.880 [2024-11-26 04:41:49.973554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.880 [2024-11-26 04:41:49.973674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.973703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.973795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.973911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.973936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.974033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.974123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.974147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.974247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.974339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.974363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.974491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.974574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.974599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.974757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.974853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.974878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.974968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.975091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.975116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.975237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.975358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.975382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.975473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.975594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.975619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.975721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.975806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.975831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.975920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.976010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.976035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.976120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.976212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.976236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.976352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.976469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.976494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.976581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.976709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.976734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.976825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.976916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.976941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.977059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.977181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.977207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.977329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.977418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.977443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.977534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.977628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.977652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.977750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.977835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.977858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.977954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.978065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.978090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.978183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.978308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.978332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.978426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.978574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.978598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.978705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.978832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.978857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.978956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.979051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.979081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.979183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.979305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.979330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.979422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.979541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.979566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.979652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.979745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.979769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.979884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.979977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.980002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.980099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.980186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.980210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.980330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.980415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.980439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.881 qpair failed and we were unable to recover it. 00:30:10.881 [2024-11-26 04:41:49.980564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.881 [2024-11-26 04:41:49.980650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.980675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.980767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.980885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.980910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.981002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.981117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.981141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.981227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.981317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.981341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.981444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.981560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.981585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.981682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.981780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.981804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.981906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.982001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.982026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.982135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.982254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.982278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.982371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.982460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.982484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.982577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.982699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.982725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.982825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.982916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.982940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.983062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.983149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.983173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.983263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.983381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.983405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.983551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.983640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.983664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.983768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.983891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.983916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.984009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.984155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.984180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.984279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.984401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.984427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.984514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.984633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.984658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.984758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.984853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.984876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.985004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.985124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.985148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.985241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.985363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.985386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.985492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.985581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.985605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.985695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.985842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.985867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.985953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.986105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.986128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.986212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.986309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.986333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.986453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.986541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.986565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.986656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.986780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.986804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.986895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.986986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.987012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.882 qpair failed and we were unable to recover it. 00:30:10.882 [2024-11-26 04:41:49.987103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.987225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.882 [2024-11-26 04:41:49.987249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.987344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.987431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.987455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.987553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.987642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.987665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.987815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.987935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.987963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.988089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.988180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.988205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.988298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.988435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.988460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.988610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.988711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.988738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.988858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.988952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.988977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.989099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.989189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.989214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.989335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.989421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.989446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.989563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.989653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.989676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.989772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.989865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.989889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.989986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.990129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.990154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.990252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.990352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.990376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.990469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.990591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.990616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.990706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.990828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.990852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.990947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.991070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.991100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.991202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.991328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.991353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.991445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.991563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.991588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.991677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.991770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.991794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.991898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.992047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.992072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.992162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.992280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.992304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.992399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.992496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.992520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.992616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.992731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.992757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.992851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.992999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.993025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.993115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.993204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.993229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.993324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.993451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.993480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.993574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.993714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.993740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.993838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.993925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.993949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.994069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.994168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.994193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.994318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.994411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.883 [2024-11-26 04:41:49.994436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.883 qpair failed and we were unable to recover it. 00:30:10.883 [2024-11-26 04:41:49.994531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.994624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.994649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.994746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.994870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.994894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.995020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.995119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.995143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.995270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.995374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.995398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.995516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.995613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.995637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.995791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.995894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.995923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.996025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.996147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.996172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.996265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.996391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.996415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.996518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.996612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.996635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.996761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.996859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.996883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.996975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.997074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.997098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.997197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.997291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.997316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.997413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.997532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.997557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.997644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.997747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.997774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.997903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.997999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.998023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.998110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.998233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.998257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.998350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.998470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.998495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.998615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.998734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.998758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.998885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.999012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.999036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.999137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.999223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.999248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.884 qpair failed and we were unable to recover it. 00:30:10.884 [2024-11-26 04:41:49.999366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.999489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.884 [2024-11-26 04:41:49.999513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:49.999606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:49.999706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:49.999731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:49.999820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:49.999945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:49.999969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.000072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.000164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.000188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.000306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.000418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.000442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.000535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.000631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.000655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.000779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.000871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.000895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.001020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.002928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.002964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.003084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.003191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.003217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.003321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.003426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.003450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.003546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.003650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.003674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.003798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.003899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.003923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.004027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.004124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.004148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.004252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.004350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.004376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.004466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.004560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.004585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.004712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.004826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.004855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.004966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.005076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.005102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.005198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.005288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.005313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.005411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.005507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.005532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.005629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.005744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.005772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.005874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.005971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.005997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.006121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.006216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.006242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.006342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.006434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.006460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.006559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.006648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.006673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.006784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.006886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.006913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.007011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.007105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.007130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.007231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.007323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.007348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.007443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.007532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.007557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.007655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.007761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.007787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.007886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.008001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.008027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.008128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.008228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.008253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.885 [2024-11-26 04:41:50.008351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.008465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.885 [2024-11-26 04:41:50.008490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.885 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.008576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.008682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.008725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.008831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.008930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.008955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.009048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.009169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.009196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.009326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.009449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.009474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.009570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.009666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.009707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.009800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.009889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.009915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.010048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.010152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.010178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.010281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.010401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.010426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.010553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.010661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.010694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.010795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.010894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.010919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.011052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.011146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.011171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.011263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.011414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.011438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.011537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.011663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.011702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.011794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.011892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.011918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.012096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.012199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.012228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.012341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.012440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.012467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.012568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.012665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.012699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.012805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.012905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.012930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.013020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.013225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.013250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.013344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.013483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.013508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.013609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.013714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.013740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.013831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.013921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.013946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.014047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.014141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.014166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.014272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.014401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.014428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.014552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.014660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.014693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.014795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.014894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.014919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.015017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.015136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.015161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.015265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.015357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.015381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.015509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.015599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.015623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.015741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.015832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.015858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.015957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.016048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.016074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.016172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.016256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.016280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.886 qpair failed and we were unable to recover it. 00:30:10.886 [2024-11-26 04:41:50.016396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.016493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.886 [2024-11-26 04:41:50.016517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.016623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.016721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.016746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.016846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.016964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.016989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.017089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.017190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.017220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.017319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.017444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.017486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.017618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.017745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.017780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.017907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.018733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.018770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.018925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.019051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.019094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.019242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.019352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.019376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.019476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.019575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.019600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.019716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.019812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.019837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.019927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.020052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.020076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.020173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.020260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.020290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.020391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.020515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.020540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.020641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.020746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.020772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.020868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.020966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.020990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.021098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.021219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.021249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.021399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.021500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.021528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.021635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.021750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.021775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.021872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.021971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.021996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.022092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.022189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.022215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.022342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.022431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.022456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.022605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.022705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.022732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.022838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.022944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.022969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.023077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.023200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.023225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.023354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.023451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.887 [2024-11-26 04:41:50.023477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:10.887 qpair failed and we were unable to recover it. 00:30:10.887 [2024-11-26 04:41:50.023617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.023722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.023749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.160 qpair failed and we were unable to recover it. 00:30:11.160 [2024-11-26 04:41:50.023841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.023934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.023959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.160 qpair failed and we were unable to recover it. 00:30:11.160 [2024-11-26 04:41:50.024080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.024171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.024198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.160 qpair failed and we were unable to recover it. 00:30:11.160 [2024-11-26 04:41:50.024326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.024424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.024450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.160 qpair failed and we were unable to recover it. 00:30:11.160 [2024-11-26 04:41:50.024554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.024643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.024668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.160 qpair failed and we were unable to recover it. 00:30:11.160 [2024-11-26 04:41:50.024780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.024906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.024932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.160 qpair failed and we were unable to recover it. 00:30:11.160 [2024-11-26 04:41:50.025031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.160 [2024-11-26 04:41:50.025159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.025184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.025286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.025411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.025438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.025558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.025653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.025678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.025847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.025947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.025972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.026091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.026190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.026215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.026302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.026395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.026420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.026522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.026641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.026667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.026781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.026892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.026922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.027034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.027131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.027157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.027264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.027363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.027389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.027515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.027618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.027644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.027754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.027854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.027885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.027973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.028074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.028102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.028219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.028342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.028367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.028455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.028549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.028576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.028667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.028781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.028807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.028910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.029029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.029054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.029142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.029254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.029279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.029370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.029477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.029502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.029596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.029700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.029727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.029821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.029908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.029933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.030038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.030134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.030160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.030277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.030368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.030395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.030494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.030581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.030607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.030697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.030818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.030845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.030937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.031031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.031059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.161 qpair failed and we were unable to recover it. 00:30:11.161 [2024-11-26 04:41:50.031189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.161 [2024-11-26 04:41:50.031286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.031313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.031436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.031530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.031555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.031646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.031749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.031774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.031905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.032036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.032061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.032186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.032279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.032304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.032435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.032530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.032556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.032653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.032762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.032788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.032883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.033012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.033037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.033129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.033218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.033244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.033366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.033483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.033508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.033603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.033729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.033756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.033909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.034039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.034065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.034157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.034297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.034324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.034445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.034532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.034557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.034706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.034853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.034882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.035022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.035122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.035147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.035244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.035366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.035393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.035525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.035664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.035700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.035802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.035896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.035923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.036072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.036173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.036200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.036331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.036448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.036473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.036593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.036693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.036719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.036822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.036909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.036934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.037061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.037181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.037206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.037329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.037426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.037453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.037554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.037665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.037702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.037828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.037951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.037977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.038107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.038201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.038227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.162 qpair failed and we were unable to recover it. 00:30:11.162 [2024-11-26 04:41:50.038327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.038461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.162 [2024-11-26 04:41:50.038487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.038611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.038712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.038738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.038828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.038918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.038942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.039035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.039122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.039148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.039251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.039378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.039403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.039494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.039624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.039649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.039752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.039861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.039887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.039989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.040105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.040133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.040345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.040449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.040474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.040596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.040728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.040754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.040876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.041010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.041035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.041166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.041266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.041292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.041439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.041531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.041557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.041649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.041755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.041782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.041874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.042004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.042030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.042115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.042241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.042267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.042358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.042450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.042477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.042573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.042666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.042698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.042819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.042910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.042935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.043040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.043160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.043184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.043272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.043363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.043390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.043497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.043623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.043649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.043778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.043880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.043906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.044004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.044100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.044127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.044259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.044413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.044439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.044540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.044634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.044660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.044777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.044904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.044929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.163 qpair failed and we were unable to recover it. 00:30:11.163 [2024-11-26 04:41:50.045038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.045249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.163 [2024-11-26 04:41:50.045274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.045382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.045501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.045526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.045624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.045754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.045780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.045895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.046014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.046039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.046126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.046251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.046277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.046401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.046505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.046530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.046625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.046757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.046784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.046904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.047011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.047036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.047165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.047261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.047286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.047377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.047475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.047500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.047705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.047814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.047841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.047933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.048067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.048095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.048190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.048290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.048316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.048406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.048523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.048547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.048641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.048738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.048764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.048859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.048954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.048980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.049133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.049227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.049252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.049454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.049546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.049573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.049713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.049814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.049839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.049955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.050058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.050084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.050212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.050312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.050337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.050463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.050561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.050587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.050682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.050778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.050803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.050907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.051013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.051039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.051137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.051234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.051261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.051383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.051476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.051502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.051598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.051694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.051721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.051847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.051944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.051972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.164 [2024-11-26 04:41:50.052088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.052288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.164 [2024-11-26 04:41:50.052313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.164 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.052404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.052529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.052556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.052654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.052787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.052817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.052917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.053023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.053049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.053162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.053253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.053278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.053380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.053509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.053536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.053666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.053786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.053811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.053905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.054023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.054048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.054173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.054261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.054286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.054382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.054530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.054556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.054649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.054794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.054820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.054911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.055011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.055036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.055128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.055217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.055247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.055342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.055494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.055520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.055616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.055745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.055771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.055871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.055960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.055985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.056114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.056212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.056237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.056361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.056484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.056509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.056613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.056715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.056742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.056846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.056943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.056969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.057074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.057201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.057226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.057317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.057428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.057453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.057576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.057667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.165 [2024-11-26 04:41:50.057723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.165 qpair failed and we were unable to recover it. 00:30:11.165 [2024-11-26 04:41:50.057849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.057945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.057971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.058095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.058215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.058240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.058336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.058474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.058499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.058621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.058713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.058740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.058843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.058948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.058974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.059069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.059165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.059190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.059280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.059416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.059441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.059578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.059683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.059716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.059821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.059922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.059947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.060078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.060202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.060232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.060385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.060479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.060504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.060603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.060712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.060738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.060837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.060938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.060964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.061054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.061149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.061177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.061309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.061404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.061430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.061569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.061714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.061740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.061833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.061960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.061987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.062088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.062216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.062241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.062336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.062459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.062485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.062582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.062676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.062708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.062812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.062930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.062955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.063052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.063146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.063172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.063289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.063386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.063411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.063518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.063612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.063639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.063748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.063846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.063873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.064033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.064176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.064201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.064296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.064416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.064442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.166 [2024-11-26 04:41:50.064539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.064668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.166 [2024-11-26 04:41:50.064701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.166 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.064829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.064938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.064965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.065062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.065183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.065211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.065318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.065415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.065443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.065570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.065716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.065743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.065842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.065940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.065965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.066089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.066185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.066210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.066313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.066436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.066462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.066549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.066674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.066708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.066811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.066904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.066929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.067051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.067171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.067196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.067320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.067441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.067467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.067618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.067717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.067743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.067841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.067935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.067960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.068059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.068208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.068233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.068322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.068438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.068463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.068584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.068711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.068737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.068832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.068952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.068978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.069126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.069223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.069249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.069346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.069499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.069524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.069619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.069723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.069749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.069857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.069974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.070000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.070119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.070222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.070247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.070349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.070440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.070465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.070561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.070692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.070719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.070814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.070914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.070940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.071061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.071179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.071204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.071304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.071424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.071450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.167 qpair failed and we were unable to recover it. 00:30:11.167 [2024-11-26 04:41:50.071571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.167 [2024-11-26 04:41:50.071673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.071707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.071804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.071896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.071921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.072052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.072171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.072196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.072299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.072390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.072415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.072500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.072625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.072650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.072764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.072854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.072879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.073017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.073115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.073140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.073234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.073320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.073345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.073470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.073558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.073583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.073679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.073832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.073857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.073978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.074099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.074125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.074216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.074312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.074337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.074439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.074528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.074553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.074647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.074766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.074792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.074916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.075035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.075060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.075163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.075304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.075330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.075418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.075515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.075541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.075644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.075744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.075770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.075891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.076013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.076038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.076135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.076232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.076258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.076410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.076532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.076557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.076655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.076755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.076780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.076883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.076973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.076998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.077122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.077217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.077242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.077341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.077435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.077461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.077590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.077692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.077718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.077857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.077988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.078015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.078108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.078196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.168 [2024-11-26 04:41:50.078221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.168 qpair failed and we were unable to recover it. 00:30:11.168 [2024-11-26 04:41:50.078348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.078440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.078466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.078591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.078712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.078738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.078862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.078957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.078983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.079085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.079185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.079210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.079304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.079419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.079444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.079546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.079642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.079668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.079800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.079899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.079924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.080048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.080161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.080189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.080294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.080383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.080408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.080500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.080601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.080625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.080717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.080845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.080871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.080985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.081092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.081119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.081209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.081301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.081326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.081415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.081501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.081525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.081631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.081761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.081786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.081914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.082010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.082034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.082128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.082244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.082268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.082374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.082468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.082493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.082625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.082726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.082752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.082853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.082950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.082975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.083071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.083168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.083192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.083289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.083382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.083406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.083527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.083616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.083641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.083779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.083871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.083896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.083990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.084103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.084127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.084217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.084334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.084358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.084453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.084550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.084573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.084669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.084770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.084794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.169 qpair failed and we were unable to recover it. 00:30:11.169 [2024-11-26 04:41:50.084890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.169 [2024-11-26 04:41:50.084985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.085009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.085131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.085220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.085244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.085343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.085463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.085488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.085611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.085705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.085730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.085834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.085930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.085955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.086078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.086197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.086221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.086317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.086420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.086444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.086537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.086636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.086660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.086798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.086898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.086921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.087026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.087128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.087153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.087244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.087340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.087365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.087484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.087609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.087633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.087736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.087834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.087859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.087963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.088050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.088074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.088156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.088246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.088271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.088358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.088474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.088498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.088588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.088705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.088730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.088829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.088922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.088946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.089065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.089160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.089186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.089303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.089406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.089432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.089533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.089653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.089677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.089790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.089885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.089909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.090031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.090115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.090139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.090258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.090380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.090404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.170 [2024-11-26 04:41:50.090499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.090587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.170 [2024-11-26 04:41:50.090612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.170 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.090704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.090824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.090849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.090938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.091037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.091061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.091155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.091243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.091267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.091383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.091529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.091554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.091651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.091760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.091790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.091890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.091992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.092017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.092104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.092191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.092215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.092350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.092438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.092462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.092548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.092643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.092667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.092772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.092865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.092888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.092983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.093133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.093157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.093263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.093362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.093388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.093507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.093596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.093620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.093713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.093831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.093855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.093955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.094042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.094071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.094199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.094288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.094311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.094407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.094527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.094552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.094683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.094784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.094809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.094913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.095009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.095035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.095130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.095253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.095278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.095378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.095467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.095490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.095615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.095710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.095737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.095867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.096071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.096095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.096187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.096308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.096334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.096429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.096525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.096553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.096646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.096745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.096770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.171 qpair failed and we were unable to recover it. 00:30:11.171 [2024-11-26 04:41:50.097241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.171 [2024-11-26 04:41:50.097348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.097372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.097470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.097593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.097618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.097716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.097808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.097835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.097922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.098016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.098040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.098135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.098256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.098281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.098378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 04:41:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:11.172 [2024-11-26 04:41:50.098502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.098527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.098620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 04:41:50 -- common/autotest_common.sh@862 -- # return 0 00:30:11.172 [2024-11-26 04:41:50.098752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.098779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.098872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.098975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.098999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 04:41:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:11.172 [2024-11-26 04:41:50.099095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.099230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.099255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.099355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 04:41:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:11.172 [2024-11-26 04:41:50.099441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.099466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.099593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 04:41:50 -- common/autotest_common.sh@10 -- # set +x 00:30:11.172 [2024-11-26 04:41:50.099740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.099765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.099863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.099952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.099976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.100072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.100194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.100219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.100313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.100416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.100440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.100564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.100691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.100716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.100834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.100960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.100984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.101107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.101195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.101219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.101303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.101422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.101447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.101598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.101709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.101735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.101834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.101918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.101942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.102040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.102189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.102213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.102300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.102420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.102445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.102541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.102670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.102704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.102818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.102910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.102935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.103034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.103130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.103155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.103239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.103364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.103388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.103490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.103579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.103604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.172 [2024-11-26 04:41:50.103713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.103805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.172 [2024-11-26 04:41:50.103830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.172 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.103932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.104057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.104082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.104170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.104298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.104322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.104434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.104525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.104549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.104666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.104766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.104791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.104892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.105015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.105039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.105156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.105275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.105299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.105402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.105551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.105575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.105671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.105816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.105841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.105969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.106065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.106091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.106189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.106280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.106306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.106429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.106534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.106562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.106667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.106781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.106807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.106900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.106997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.107022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.107123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.107244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.107268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.107399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.107492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.107519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.107642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.107784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.107810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.107906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.107995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.108020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.108140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.108232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.108256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.108353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.108466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.108492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.108582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.108703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.108729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.108821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.108944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.108968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.109092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.109189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.109213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.109300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.109393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.109417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.109522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.109617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.109640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.109750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.109847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.109871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.109967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.110086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.110110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.110238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.110326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.110350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.173 [2024-11-26 04:41:50.110443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.110597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.173 [2024-11-26 04:41:50.110622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.173 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.110716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.110804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.110829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.110923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.111026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.111050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.111188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.111277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.111307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.111429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.111562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.111587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.111677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.111808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.111833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.111926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.112020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.112045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.112142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.112238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.112262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.112385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.112474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.112498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.112590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.112712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.112737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.112829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.112920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.112945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73c390 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.113087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.113193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.113222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.113332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.113432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.113459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.113550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.113696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.113733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.113841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.113967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.114000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.114098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.114225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.114251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.114381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.114503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.114529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.114628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.114725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.114751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.114893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.114986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.115012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.115133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.115262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.115289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.115385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.115504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.115530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.115619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.115720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.115746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.115877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.115977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.116002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.116122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.116218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.116245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.116342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.116480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.116505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.116633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.116726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.174 [2024-11-26 04:41:50.116752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.174 qpair failed and we were unable to recover it. 00:30:11.174 [2024-11-26 04:41:50.116845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.116934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.116959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.117089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.117182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.117208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.117358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.117479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.117505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.117627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.117716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.117741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.117846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.117942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.117967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.118069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.118191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.118216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.118322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.118423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.118450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.118542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.118664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.118699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.118811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.118904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.118929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.119078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.119174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.119210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.119317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.119410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.119435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.119560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.119680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.119715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.119829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.119977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.120002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.120101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.120222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.120248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.120347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.120444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.120470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.120597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.120697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.120723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.120822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.120945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.120971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.121097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.121200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.121226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.121326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.121412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.121437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.121532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.121677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.121712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.121802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.121891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.121916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.122028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.122125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.122150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.122247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.122333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.122358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.122449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 04:41:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:11.175 [2024-11-26 04:41:50.122610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.122637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.122728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 [2024-11-26 04:41:50.122819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 04:41:50 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:11.175 [2024-11-26 04:41:50.122845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.175 qpair failed and we were unable to recover it. 00:30:11.175 [2024-11-26 04:41:50.122944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.175 04:41:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.175 [2024-11-26 04:41:50.123035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.123063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.123157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.123243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.123269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 04:41:50 -- common/autotest_common.sh@10 -- # set +x 00:30:11.176 [2024-11-26 04:41:50.123398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.123497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.123523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.123620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.123715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.123741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.123841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.123971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.123996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.124121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.124217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.124242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.124334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.124434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.124459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.124553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.124641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.124666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.124774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.124926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.124952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.125048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.125151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.125176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.125272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.125396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.125421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.125515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.125612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.125637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.125743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.125869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.125895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.125986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.126113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.126140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.126244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.126369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.126394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.126492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.126614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.126639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.126778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.126878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.126903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.127058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.127149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.127175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.127305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.127402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.127427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.127518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.127635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.127660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.127767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.127884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.127910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.128012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.128114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.128139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.128240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.128366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.128391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.128493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.128613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.128638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.128731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.128825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.128850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.128978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.129077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.129102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.129199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.129289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.129315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.176 [2024-11-26 04:41:50.129412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.129503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.176 [2024-11-26 04:41:50.129528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.176 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.129644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.129747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.129773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.129872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.129979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.130004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.130134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.130234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.130259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.130351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.130470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.130495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.130628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.130727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.130758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.130867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.130966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.130992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.131098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.131216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.131241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.131360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.131459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.131485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.131574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.131671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.131713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.131819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.131912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.131939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.132070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.132220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.132246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.132343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.132462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.132489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.132619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.132740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.132766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.132863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.132989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.133014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.133138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.133233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.133262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.133386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.133506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.133531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.133629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.133748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.133775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.133869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.133984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.134009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.134115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.134238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.134263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.134384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.134503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.134528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.134653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.134755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.134782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.134876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.134968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.134993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.135113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.135240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.135264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.135357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.135460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.135485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.135584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.135676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.135713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.135843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.135965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.135990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.136121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.136244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.136269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.177 [2024-11-26 04:41:50.136368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.136467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.177 [2024-11-26 04:41:50.136493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.177 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.136652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.136799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.136825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.136920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.137010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.137035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.137138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.137283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.137308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.137408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.137501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.137526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.137653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.137760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.137786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.137883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.137973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.137998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.138097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.138187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.138217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.138367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.138489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.138514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.138619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.138749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.138776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.138871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.139001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.139026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.139146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.139260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.139285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.139384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.139485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.139512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.139610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.139700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.139726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.139847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.139945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.139970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.140099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.140220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.140245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.140371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.140468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.140493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.140617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.140749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.140779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.140902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.141007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.141032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.141160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.141245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.141270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.141423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.141519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.141544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.141639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.141730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.141756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.141860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.141957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.141982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.142078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.142200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.142225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.142319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.142417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.142442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.142530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.142627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.142658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.142813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.142910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.142936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.143067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.143161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.143187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.143347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.143445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.143470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.178 qpair failed and we were unable to recover it. 00:30:11.178 [2024-11-26 04:41:50.143572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.178 [2024-11-26 04:41:50.143721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.143750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.143846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.143973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.143997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.144097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.144217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.144243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.144395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.144520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.144545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.144638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.144729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.144755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.144874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.144997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.145022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.145116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.145218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.145243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.145372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.145459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.145485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.145579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.145664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.145694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.145826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.145945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.145970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.146094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.146189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.146215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.146348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.146476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.146501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.146601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.146697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.146723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.146850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.146973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.146998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.147134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.147225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.147250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.147344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.147459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.147484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.147582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.147738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.147764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.147866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.147972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.147997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.148106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.148261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.148287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.148390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.148513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.148538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.148671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.148805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.148830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.148952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.149057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.149083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.149179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.149305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.149332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 Malloc0 00:30:11.179 [2024-11-26 04:41:50.149454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.149582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.149607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.179 [2024-11-26 04:41:50.149710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 04:41:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.179 [2024-11-26 04:41:50.149818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.179 [2024-11-26 04:41:50.149843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.179 qpair failed and we were unable to recover it. 00:30:11.180 04:41:50 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:11.180 [2024-11-26 04:41:50.149942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.150051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 04:41:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.180 [2024-11-26 04:41:50.150076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.150169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 04:41:50 -- common/autotest_common.sh@10 -- # set +x 00:30:11.180 [2024-11-26 04:41:50.150265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.150290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.150386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.150482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.150507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.150603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.150712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.150738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.150839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.150967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.150992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.151097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.151192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.151217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.151311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.151438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.151463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.151596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.151699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.151737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.151836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.151928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.151954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.152062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.152152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.152177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.152269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.152362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.152388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.152507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.152603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.152628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.152726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.152847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.152873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.152966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.153044] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:11.180 [2024-11-26 04:41:50.153073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.153098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.153205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.153334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.153358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.153482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.153574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.153601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.153701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.153807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.153832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.153919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.154034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.154059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.154163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.154260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.154285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.154414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.154506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.154530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.154627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.154743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.154769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.154870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.154972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.154997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.155089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.155219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.155245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.155367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.155509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.155536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.155646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.155791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.155818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.155912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.156037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.156064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.156160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.156254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.156280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.180 qpair failed and we were unable to recover it. 00:30:11.180 [2024-11-26 04:41:50.156375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.180 [2024-11-26 04:41:50.156477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.156502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.156603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.156701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.156737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.156836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.156959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.156984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.157097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.157198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.157223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.157320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.157444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.157470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.157567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.157695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.157721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.157837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.157941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.157966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.158068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.158168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.158193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.158316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.158408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.158433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.158530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.158652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.158677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.158800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.158894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.158919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.159034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.159156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.159181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.159303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.159398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.159424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.159522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.159649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.159673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb5c000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.159817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.159918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.159945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.160051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.160174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.160200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.160297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.160420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.160446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.160545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.160645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.160670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.160792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.160886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.160911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.161006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.161102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.161129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.161237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 04:41:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.181 [2024-11-26 04:41:50.161343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.161369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 04:41:50 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:11.181 [2024-11-26 04:41:50.161497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 04:41:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.181 [2024-11-26 04:41:50.161621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.161646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 04:41:50 -- common/autotest_common.sh@10 -- # set +x 00:30:11.181 [2024-11-26 04:41:50.161749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.161847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.161872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.161972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.162073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.162098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.162197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.162296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.162321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.162427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.162586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.162615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.162716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.162813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.162839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.181 qpair failed and we were unable to recover it. 00:30:11.181 [2024-11-26 04:41:50.162933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.181 [2024-11-26 04:41:50.163057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.163084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.163178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.163307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.163332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.163425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.163524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.163549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.163643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.163802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.163829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.163931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.164066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.164091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.164188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.164284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.164310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.164410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.164514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.164540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.164635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.164730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.164754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.164878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.164999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.165028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.165127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.165251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.165276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.165387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.165486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.165511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.165606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.165697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.165733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.165854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.165974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.166002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.166093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.166187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.166211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.166314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.166436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.166462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.166581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.166691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.166719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.166842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.166939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.166964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.167055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.167172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.167197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.167327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.167449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.167474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.167607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.167739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.167765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.167872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.167991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.168016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.168143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.168231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.168256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.168377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.168468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.168492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.168615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.168714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.168740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.168839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.168937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.168964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.169065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.169159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.169186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 [2024-11-26 04:41:50.169295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 04:41:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.182 [2024-11-26 04:41:50.169394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.182 [2024-11-26 04:41:50.169419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.182 qpair failed and we were unable to recover it. 00:30:11.182 04:41:50 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:11.183 [2024-11-26 04:41:50.169514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 04:41:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.183 [2024-11-26 04:41:50.169634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.169659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 04:41:50 -- common/autotest_common.sh@10 -- # set +x 00:30:11.183 [2024-11-26 04:41:50.169802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.169898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.169923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.170029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.170128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.170153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.170248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.170398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.170424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.170529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.170648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.170673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.170789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.170890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.170915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.171007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.171134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.171159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.171287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.171388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.171414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.171538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.171627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.171652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.171790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.171919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.171944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.172051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.172147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.172171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.172276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.172369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.172394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.172483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.172579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.172603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.172709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.172803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.172827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.172949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.173039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.173064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.173189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.173284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.173309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.173428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.173580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.173605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.173700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.173793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.173818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.173946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.174071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.174096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.174221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.174346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.174372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.174498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.174593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.174618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb60000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.174735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.174898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.174927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.175036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.175164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.175189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.175282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.175386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.175410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.175540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.175638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.175663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.175796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.175892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.175917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.176013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.176106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.176131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.183 qpair failed and we were unable to recover it. 00:30:11.183 [2024-11-26 04:41:50.176227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.176315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.183 [2024-11-26 04:41:50.176339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.176463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.176550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.176574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.176670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.176778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.176803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.176927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.177026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.177052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.177144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.177255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.177280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 04:41:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.184 [2024-11-26 04:41:50.177416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 04:41:50 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:11.184 [2024-11-26 04:41:50.177543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.177568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 04:41:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.184 [2024-11-26 04:41:50.177669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 04:41:50 -- common/autotest_common.sh@10 -- # set +x 00:30:11.184 [2024-11-26 04:41:50.177766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.177790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.177888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.177984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.178009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.178140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.178265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.178290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.178383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.178483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.178507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.178632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.178731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.178757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.178860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.178954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.178978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.179076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.179173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.179197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.179313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.179438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.179469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.179631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.179731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.179757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.179852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.179946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.179971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.180067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.180190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.180214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.180310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.180434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.180460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.180577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.180670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.180701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.180802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.180899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.180923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.181019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.181118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:11.184 [2024-11-26 04:41:50.181142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdb68000b90 with addr=10.0.0.2, port=4420 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 [2024-11-26 04:41:50.181294] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:11.184 [2024-11-26 04:41:50.183820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.184 [2024-11-26 04:41:50.183956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.184 [2024-11-26 04:41:50.183984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.184 [2024-11-26 04:41:50.183999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.184 [2024-11-26 04:41:50.184012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.184 [2024-11-26 04:41:50.184048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.184 qpair failed and we were unable to recover it. 00:30:11.184 04:41:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.184 04:41:50 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:11.184 04:41:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.185 04:41:50 -- common/autotest_common.sh@10 -- # set +x 00:30:11.185 04:41:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.185 04:41:50 -- host/target_disconnect.sh@58 -- # wait 3045196 00:30:11.185 [2024-11-26 04:41:50.193605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.193711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.193741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.193755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.193767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.193797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.203600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.203704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.203732] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.203746] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.203759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.203788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.213645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.213771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.213798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.213812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.213824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.213854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.223605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.223711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.223769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.223785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.223798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.223828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.233716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.233814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.233840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.233854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.233866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.233894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.243635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.243736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.243762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.243776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.243788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.243818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.253651] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.253760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.253786] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.253799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.253812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.253841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.263668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.263771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.263797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.263810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.263823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.263853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.273738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.273844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.273870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.273893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.273907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.273936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.283779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.283885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.283911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.283925] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.283938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.283967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.293781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.293884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.293909] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.293922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.293936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.293964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.303819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.303920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.303946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.303960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.303973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.304001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.313981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.185 [2024-11-26 04:41:50.314096] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.185 [2024-11-26 04:41:50.314121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.185 [2024-11-26 04:41:50.314135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.185 [2024-11-26 04:41:50.314148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.185 [2024-11-26 04:41:50.314177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.185 qpair failed and we were unable to recover it. 00:30:11.185 [2024-11-26 04:41:50.323931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.186 [2024-11-26 04:41:50.324030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.186 [2024-11-26 04:41:50.324055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.186 [2024-11-26 04:41:50.324069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.186 [2024-11-26 04:41:50.324082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.186 [2024-11-26 04:41:50.324111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.186 qpair failed and we were unable to recover it. 00:30:11.186 [2024-11-26 04:41:50.333954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.186 [2024-11-26 04:41:50.334066] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.186 [2024-11-26 04:41:50.334091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.186 [2024-11-26 04:41:50.334105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.186 [2024-11-26 04:41:50.334118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.186 [2024-11-26 04:41:50.334148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.186 qpair failed and we were unable to recover it. 00:30:11.186 [2024-11-26 04:41:50.343973] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.186 [2024-11-26 04:41:50.344070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.186 [2024-11-26 04:41:50.344095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.186 [2024-11-26 04:41:50.344109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.186 [2024-11-26 04:41:50.344121] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.186 [2024-11-26 04:41:50.344151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.186 qpair failed and we were unable to recover it. 00:30:11.186 [2024-11-26 04:41:50.353961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.186 [2024-11-26 04:41:50.354066] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.186 [2024-11-26 04:41:50.354093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.186 [2024-11-26 04:41:50.354108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.186 [2024-11-26 04:41:50.354121] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.186 [2024-11-26 04:41:50.354151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.186 qpair failed and we were unable to recover it. 00:30:11.186 [2024-11-26 04:41:50.363975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.186 [2024-11-26 04:41:50.364070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.186 [2024-11-26 04:41:50.364102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.186 [2024-11-26 04:41:50.364117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.186 [2024-11-26 04:41:50.364130] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.186 [2024-11-26 04:41:50.364159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.186 qpair failed and we were unable to recover it. 00:30:11.448 [2024-11-26 04:41:50.374044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.374164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.374191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.374205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.449 [2024-11-26 04:41:50.374218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.449 [2024-11-26 04:41:50.374248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.449 qpair failed and we were unable to recover it. 00:30:11.449 [2024-11-26 04:41:50.384068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.384167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.384193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.384206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.449 [2024-11-26 04:41:50.384219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.449 [2024-11-26 04:41:50.384254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.449 qpair failed and we were unable to recover it. 00:30:11.449 [2024-11-26 04:41:50.394061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.394161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.394187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.394201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.449 [2024-11-26 04:41:50.394214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.449 [2024-11-26 04:41:50.394243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.449 qpair failed and we were unable to recover it. 00:30:11.449 [2024-11-26 04:41:50.404090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.404191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.404216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.404230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.449 [2024-11-26 04:41:50.404243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.449 [2024-11-26 04:41:50.404279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.449 qpair failed and we were unable to recover it. 00:30:11.449 [2024-11-26 04:41:50.414151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.414255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.414281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.414295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.449 [2024-11-26 04:41:50.414307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.449 [2024-11-26 04:41:50.414348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.449 qpair failed and we were unable to recover it. 00:30:11.449 [2024-11-26 04:41:50.424155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.424253] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.424278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.424292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.449 [2024-11-26 04:41:50.424305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.449 [2024-11-26 04:41:50.424334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.449 qpair failed and we were unable to recover it. 00:30:11.449 [2024-11-26 04:41:50.434211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.434314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.434341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.434354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.449 [2024-11-26 04:41:50.434367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.449 [2024-11-26 04:41:50.434396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.449 qpair failed and we were unable to recover it. 00:30:11.449 [2024-11-26 04:41:50.444232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.444328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.444353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.444367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.449 [2024-11-26 04:41:50.444379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.449 [2024-11-26 04:41:50.444410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.449 qpair failed and we were unable to recover it. 00:30:11.449 [2024-11-26 04:41:50.454288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.454392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.454422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.454436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.449 [2024-11-26 04:41:50.454449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.449 [2024-11-26 04:41:50.454478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.449 qpair failed and we were unable to recover it. 00:30:11.449 [2024-11-26 04:41:50.464277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.464376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.464401] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.464414] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.449 [2024-11-26 04:41:50.464427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.449 [2024-11-26 04:41:50.464456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.449 qpair failed and we were unable to recover it. 00:30:11.449 [2024-11-26 04:41:50.474327] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.474422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.474448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.474462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.449 [2024-11-26 04:41:50.474474] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.449 [2024-11-26 04:41:50.474503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.449 qpair failed and we were unable to recover it. 00:30:11.449 [2024-11-26 04:41:50.484348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.484445] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.484470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.484484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.449 [2024-11-26 04:41:50.484498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.449 [2024-11-26 04:41:50.484528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.449 qpair failed and we were unable to recover it. 00:30:11.449 [2024-11-26 04:41:50.494419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.449 [2024-11-26 04:41:50.494539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.449 [2024-11-26 04:41:50.494564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.449 [2024-11-26 04:41:50.494578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.494592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.450 [2024-11-26 04:41:50.494627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.450 qpair failed and we were unable to recover it. 00:30:11.450 [2024-11-26 04:41:50.504450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.450 [2024-11-26 04:41:50.504546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.450 [2024-11-26 04:41:50.504572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.450 [2024-11-26 04:41:50.504585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.504598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.450 [2024-11-26 04:41:50.504629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.450 qpair failed and we were unable to recover it. 00:30:11.450 [2024-11-26 04:41:50.514518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.450 [2024-11-26 04:41:50.514613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.450 [2024-11-26 04:41:50.514638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.450 [2024-11-26 04:41:50.514652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.514664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.450 [2024-11-26 04:41:50.514699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.450 qpair failed and we were unable to recover it. 00:30:11.450 [2024-11-26 04:41:50.524458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.450 [2024-11-26 04:41:50.524559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.450 [2024-11-26 04:41:50.524584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.450 [2024-11-26 04:41:50.524598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.524611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.450 [2024-11-26 04:41:50.524641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.450 qpair failed and we were unable to recover it. 00:30:11.450 [2024-11-26 04:41:50.534587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.450 [2024-11-26 04:41:50.534738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.450 [2024-11-26 04:41:50.534765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.450 [2024-11-26 04:41:50.534778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.534792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.450 [2024-11-26 04:41:50.534820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.450 qpair failed and we were unable to recover it. 00:30:11.450 [2024-11-26 04:41:50.544511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.450 [2024-11-26 04:41:50.544605] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.450 [2024-11-26 04:41:50.544636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.450 [2024-11-26 04:41:50.544650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.544662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.450 [2024-11-26 04:41:50.544700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.450 qpair failed and we were unable to recover it. 00:30:11.450 [2024-11-26 04:41:50.554563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.450 [2024-11-26 04:41:50.554663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.450 [2024-11-26 04:41:50.554696] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.450 [2024-11-26 04:41:50.554712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.554724] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.450 [2024-11-26 04:41:50.554754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.450 qpair failed and we were unable to recover it. 00:30:11.450 [2024-11-26 04:41:50.564589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.450 [2024-11-26 04:41:50.564697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.450 [2024-11-26 04:41:50.564723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.450 [2024-11-26 04:41:50.564736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.564749] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.450 [2024-11-26 04:41:50.564780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.450 qpair failed and we were unable to recover it. 00:30:11.450 [2024-11-26 04:41:50.574655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.450 [2024-11-26 04:41:50.574776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.450 [2024-11-26 04:41:50.574802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.450 [2024-11-26 04:41:50.574816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.574828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.450 [2024-11-26 04:41:50.574860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.450 qpair failed and we were unable to recover it. 00:30:11.450 [2024-11-26 04:41:50.584658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.450 [2024-11-26 04:41:50.584759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.450 [2024-11-26 04:41:50.584785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.450 [2024-11-26 04:41:50.584798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.584816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.450 [2024-11-26 04:41:50.584846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.450 qpair failed and we were unable to recover it. 00:30:11.450 [2024-11-26 04:41:50.594667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.450 [2024-11-26 04:41:50.594775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.450 [2024-11-26 04:41:50.594805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.450 [2024-11-26 04:41:50.594819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.594831] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.450 [2024-11-26 04:41:50.594860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.450 qpair failed and we were unable to recover it. 00:30:11.450 [2024-11-26 04:41:50.604719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.450 [2024-11-26 04:41:50.604839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.450 [2024-11-26 04:41:50.604864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.450 [2024-11-26 04:41:50.604878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.604890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.450 [2024-11-26 04:41:50.604919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.450 qpair failed and we were unable to recover it. 00:30:11.450 [2024-11-26 04:41:50.614749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.450 [2024-11-26 04:41:50.614853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.450 [2024-11-26 04:41:50.614878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.450 [2024-11-26 04:41:50.614891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.450 [2024-11-26 04:41:50.614904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.451 [2024-11-26 04:41:50.614933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.451 qpair failed and we were unable to recover it. 00:30:11.451 [2024-11-26 04:41:50.624776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.451 [2024-11-26 04:41:50.624891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.451 [2024-11-26 04:41:50.624920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.451 [2024-11-26 04:41:50.624935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.451 [2024-11-26 04:41:50.624948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.451 [2024-11-26 04:41:50.624977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.451 qpair failed and we were unable to recover it. 00:30:11.451 [2024-11-26 04:41:50.634788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.451 [2024-11-26 04:41:50.634886] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.451 [2024-11-26 04:41:50.634912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.451 [2024-11-26 04:41:50.634926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.451 [2024-11-26 04:41:50.634938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.451 [2024-11-26 04:41:50.634968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.451 qpair failed and we were unable to recover it. 00:30:11.451 [2024-11-26 04:41:50.644826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.451 [2024-11-26 04:41:50.644921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.451 [2024-11-26 04:41:50.644947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.451 [2024-11-26 04:41:50.644960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.451 [2024-11-26 04:41:50.644973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.451 [2024-11-26 04:41:50.645002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.451 qpair failed and we were unable to recover it. 00:30:11.451 [2024-11-26 04:41:50.654872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.451 [2024-11-26 04:41:50.654982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.451 [2024-11-26 04:41:50.655011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.451 [2024-11-26 04:41:50.655026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.451 [2024-11-26 04:41:50.655039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.451 [2024-11-26 04:41:50.655069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.451 qpair failed and we were unable to recover it. 00:30:11.451 [2024-11-26 04:41:50.664901] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.451 [2024-11-26 04:41:50.665007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.451 [2024-11-26 04:41:50.665034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.451 [2024-11-26 04:41:50.665048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.451 [2024-11-26 04:41:50.665060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.451 [2024-11-26 04:41:50.665089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.451 qpair failed and we were unable to recover it. 00:30:11.713 [2024-11-26 04:41:50.674906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.713 [2024-11-26 04:41:50.675014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.713 [2024-11-26 04:41:50.675040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.713 [2024-11-26 04:41:50.675055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.713 [2024-11-26 04:41:50.675073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.713 [2024-11-26 04:41:50.675105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.713 qpair failed and we were unable to recover it. 00:30:11.713 [2024-11-26 04:41:50.684945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.713 [2024-11-26 04:41:50.685067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.713 [2024-11-26 04:41:50.685092] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.713 [2024-11-26 04:41:50.685106] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.713 [2024-11-26 04:41:50.685118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.713 [2024-11-26 04:41:50.685149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.713 qpair failed and we were unable to recover it. 00:30:11.713 [2024-11-26 04:41:50.694965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.713 [2024-11-26 04:41:50.695084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.713 [2024-11-26 04:41:50.695110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.713 [2024-11-26 04:41:50.695124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.713 [2024-11-26 04:41:50.695137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.713 [2024-11-26 04:41:50.695166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.713 qpair failed and we were unable to recover it. 00:30:11.713 [2024-11-26 04:41:50.705086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.713 [2024-11-26 04:41:50.705185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.713 [2024-11-26 04:41:50.705211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.713 [2024-11-26 04:41:50.705224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.713 [2024-11-26 04:41:50.705237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.713 [2024-11-26 04:41:50.705267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.713 qpair failed and we were unable to recover it. 00:30:11.713 [2024-11-26 04:41:50.715023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.713 [2024-11-26 04:41:50.715119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.713 [2024-11-26 04:41:50.715144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.713 [2024-11-26 04:41:50.715158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.713 [2024-11-26 04:41:50.715170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.713 [2024-11-26 04:41:50.715199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.713 qpair failed and we were unable to recover it. 00:30:11.713 [2024-11-26 04:41:50.725053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.713 [2024-11-26 04:41:50.725167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.713 [2024-11-26 04:41:50.725191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.713 [2024-11-26 04:41:50.725204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.714 [2024-11-26 04:41:50.725217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.714 [2024-11-26 04:41:50.725247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.714 qpair failed and we were unable to recover it. 00:30:11.714 [2024-11-26 04:41:50.735178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.714 [2024-11-26 04:41:50.735288] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.714 [2024-11-26 04:41:50.735312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.714 [2024-11-26 04:41:50.735326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.714 [2024-11-26 04:41:50.735339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.714 [2024-11-26 04:41:50.735369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.714 qpair failed and we were unable to recover it. 00:30:11.714 [2024-11-26 04:41:50.745229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.714 [2024-11-26 04:41:50.745323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.714 [2024-11-26 04:41:50.745348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.714 [2024-11-26 04:41:50.745362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.714 [2024-11-26 04:41:50.745376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.714 [2024-11-26 04:41:50.745406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.714 qpair failed and we were unable to recover it. 00:30:11.714 [2024-11-26 04:41:50.755161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.714 [2024-11-26 04:41:50.755297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.714 [2024-11-26 04:41:50.755322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.714 [2024-11-26 04:41:50.755336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.714 [2024-11-26 04:41:50.755349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.714 [2024-11-26 04:41:50.755379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.714 qpair failed and we were unable to recover it. 00:30:11.714 [2024-11-26 04:41:50.765169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.714 [2024-11-26 04:41:50.765299] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.714 [2024-11-26 04:41:50.765324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.714 [2024-11-26 04:41:50.765346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.714 [2024-11-26 04:41:50.765360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.714 [2024-11-26 04:41:50.765389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.714 qpair failed and we were unable to recover it. 00:30:11.714 [2024-11-26 04:41:50.775268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.714 [2024-11-26 04:41:50.775373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.714 [2024-11-26 04:41:50.775398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.714 [2024-11-26 04:41:50.775411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.714 [2024-11-26 04:41:50.775424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.714 [2024-11-26 04:41:50.775452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.714 qpair failed and we were unable to recover it. 00:30:11.714 [2024-11-26 04:41:50.785229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.714 [2024-11-26 04:41:50.785339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.714 [2024-11-26 04:41:50.785364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.714 [2024-11-26 04:41:50.785378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.714 [2024-11-26 04:41:50.785391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.714 [2024-11-26 04:41:50.785419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.714 qpair failed and we were unable to recover it. 00:30:11.714 [2024-11-26 04:41:50.795272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.714 [2024-11-26 04:41:50.795372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.714 [2024-11-26 04:41:50.795397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.714 [2024-11-26 04:41:50.795410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.714 [2024-11-26 04:41:50.795423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.714 [2024-11-26 04:41:50.795451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.714 qpair failed and we were unable to recover it. 00:30:11.714 [2024-11-26 04:41:50.805293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.714 [2024-11-26 04:41:50.805420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.714 [2024-11-26 04:41:50.805445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.714 [2024-11-26 04:41:50.805458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.714 [2024-11-26 04:41:50.805471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.714 [2024-11-26 04:41:50.805500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.714 qpair failed and we were unable to recover it. 00:30:11.714 [2024-11-26 04:41:50.815332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.714 [2024-11-26 04:41:50.815434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.714 [2024-11-26 04:41:50.815459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.714 [2024-11-26 04:41:50.815472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.714 [2024-11-26 04:41:50.815484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.714 [2024-11-26 04:41:50.815513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.714 qpair failed and we were unable to recover it. 00:30:11.714 [2024-11-26 04:41:50.825435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.714 [2024-11-26 04:41:50.825573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.714 [2024-11-26 04:41:50.825598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.714 [2024-11-26 04:41:50.825611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.714 [2024-11-26 04:41:50.825624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.714 [2024-11-26 04:41:50.825653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.714 qpair failed and we were unable to recover it. 00:30:11.714 [2024-11-26 04:41:50.835394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.714 [2024-11-26 04:41:50.835487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.714 [2024-11-26 04:41:50.835512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.714 [2024-11-26 04:41:50.835525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.714 [2024-11-26 04:41:50.835538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.714 [2024-11-26 04:41:50.835567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.715 qpair failed and we were unable to recover it. 00:30:11.715 [2024-11-26 04:41:50.845415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.715 [2024-11-26 04:41:50.845523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.715 [2024-11-26 04:41:50.845548] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.715 [2024-11-26 04:41:50.845561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.715 [2024-11-26 04:41:50.845574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.715 [2024-11-26 04:41:50.845603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.715 qpair failed and we were unable to recover it. 00:30:11.715 [2024-11-26 04:41:50.855432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.715 [2024-11-26 04:41:50.855533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.715 [2024-11-26 04:41:50.855562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.715 [2024-11-26 04:41:50.855577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.715 [2024-11-26 04:41:50.855590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.715 [2024-11-26 04:41:50.855619] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.715 qpair failed and we were unable to recover it. 00:30:11.715 [2024-11-26 04:41:50.865461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.715 [2024-11-26 04:41:50.865565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.715 [2024-11-26 04:41:50.865590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.715 [2024-11-26 04:41:50.865604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.715 [2024-11-26 04:41:50.865617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.715 [2024-11-26 04:41:50.865645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.715 qpair failed and we were unable to recover it. 00:30:11.715 [2024-11-26 04:41:50.875575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.715 [2024-11-26 04:41:50.875666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.715 [2024-11-26 04:41:50.875698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.715 [2024-11-26 04:41:50.875713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.715 [2024-11-26 04:41:50.875726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.715 [2024-11-26 04:41:50.875755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.715 qpair failed and we were unable to recover it. 00:30:11.715 [2024-11-26 04:41:50.885524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.715 [2024-11-26 04:41:50.885619] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.715 [2024-11-26 04:41:50.885644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.715 [2024-11-26 04:41:50.885658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.715 [2024-11-26 04:41:50.885670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.715 [2024-11-26 04:41:50.885718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.715 qpair failed and we were unable to recover it. 00:30:11.715 [2024-11-26 04:41:50.895575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.715 [2024-11-26 04:41:50.895683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.715 [2024-11-26 04:41:50.895718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.715 [2024-11-26 04:41:50.895733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.715 [2024-11-26 04:41:50.895745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.715 [2024-11-26 04:41:50.895775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.715 qpair failed and we were unable to recover it. 00:30:11.715 [2024-11-26 04:41:50.905588] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.715 [2024-11-26 04:41:50.905695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.715 [2024-11-26 04:41:50.905721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.715 [2024-11-26 04:41:50.905734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.715 [2024-11-26 04:41:50.905747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.715 [2024-11-26 04:41:50.905777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.715 qpair failed and we were unable to recover it. 00:30:11.715 [2024-11-26 04:41:50.915611] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.715 [2024-11-26 04:41:50.915737] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.715 [2024-11-26 04:41:50.915763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.715 [2024-11-26 04:41:50.915777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.715 [2024-11-26 04:41:50.915790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.715 [2024-11-26 04:41:50.915820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.715 qpair failed and we were unable to recover it. 00:30:11.715 [2024-11-26 04:41:50.925641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.715 [2024-11-26 04:41:50.925749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.715 [2024-11-26 04:41:50.925774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.715 [2024-11-26 04:41:50.925788] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.715 [2024-11-26 04:41:50.925800] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.715 [2024-11-26 04:41:50.925829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.715 qpair failed and we were unable to recover it. 00:30:11.975 [2024-11-26 04:41:50.935682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.975 [2024-11-26 04:41:50.935804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.975 [2024-11-26 04:41:50.935829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.975 [2024-11-26 04:41:50.935843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.975 [2024-11-26 04:41:50.935856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.975 [2024-11-26 04:41:50.935887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.975 qpair failed and we were unable to recover it. 00:30:11.975 [2024-11-26 04:41:50.945709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.975 [2024-11-26 04:41:50.945805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.975 [2024-11-26 04:41:50.945837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.975 [2024-11-26 04:41:50.945851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.975 [2024-11-26 04:41:50.945864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.975 [2024-11-26 04:41:50.945894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.975 qpair failed and we were unable to recover it. 00:30:11.975 [2024-11-26 04:41:50.955742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.975 [2024-11-26 04:41:50.955838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.975 [2024-11-26 04:41:50.955864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.975 [2024-11-26 04:41:50.955878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.975 [2024-11-26 04:41:50.955891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.975 [2024-11-26 04:41:50.955920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.975 qpair failed and we were unable to recover it. 00:30:11.975 [2024-11-26 04:41:50.965805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.975 [2024-11-26 04:41:50.965917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.975 [2024-11-26 04:41:50.965942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.975 [2024-11-26 04:41:50.965956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.975 [2024-11-26 04:41:50.965969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.975 [2024-11-26 04:41:50.966000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.975 qpair failed and we were unable to recover it. 00:30:11.975 [2024-11-26 04:41:50.975833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.975 [2024-11-26 04:41:50.975934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.976 [2024-11-26 04:41:50.975959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.976 [2024-11-26 04:41:50.975972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.976 [2024-11-26 04:41:50.975985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.976 [2024-11-26 04:41:50.976013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.976 qpair failed and we were unable to recover it. 00:30:11.976 [2024-11-26 04:41:50.985811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.976 [2024-11-26 04:41:50.985910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.976 [2024-11-26 04:41:50.985934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.976 [2024-11-26 04:41:50.985948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.976 [2024-11-26 04:41:50.985960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.976 [2024-11-26 04:41:50.986011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.976 qpair failed and we were unable to recover it. 00:30:11.976 [2024-11-26 04:41:50.995853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.976 [2024-11-26 04:41:50.995959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.976 [2024-11-26 04:41:50.995987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.976 [2024-11-26 04:41:50.996001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.976 [2024-11-26 04:41:50.996014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.976 [2024-11-26 04:41:50.996043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.976 qpair failed and we were unable to recover it. 00:30:11.976 [2024-11-26 04:41:51.005887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.976 [2024-11-26 04:41:51.005991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.976 [2024-11-26 04:41:51.006016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.976 [2024-11-26 04:41:51.006030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.976 [2024-11-26 04:41:51.006043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.976 [2024-11-26 04:41:51.006071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.976 qpair failed and we were unable to recover it. 00:30:11.976 [2024-11-26 04:41:51.015912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.976 [2024-11-26 04:41:51.016010] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.976 [2024-11-26 04:41:51.016035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.976 [2024-11-26 04:41:51.016049] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.976 [2024-11-26 04:41:51.016061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.976 [2024-11-26 04:41:51.016091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.976 qpair failed and we were unable to recover it. 00:30:11.976 [2024-11-26 04:41:51.025957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.976 [2024-11-26 04:41:51.026057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.976 [2024-11-26 04:41:51.026081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.976 [2024-11-26 04:41:51.026095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.976 [2024-11-26 04:41:51.026108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.976 [2024-11-26 04:41:51.026138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.976 qpair failed and we were unable to recover it. 00:30:11.976 [2024-11-26 04:41:51.035963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.976 [2024-11-26 04:41:51.036060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.976 [2024-11-26 04:41:51.036090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.976 [2024-11-26 04:41:51.036104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.976 [2024-11-26 04:41:51.036117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.976 [2024-11-26 04:41:51.036147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.976 qpair failed and we were unable to recover it. 00:30:11.976 [2024-11-26 04:41:51.045992] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.976 [2024-11-26 04:41:51.046090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.976 [2024-11-26 04:41:51.046115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.976 [2024-11-26 04:41:51.046129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.976 [2024-11-26 04:41:51.046142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.976 [2024-11-26 04:41:51.046171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.976 qpair failed and we were unable to recover it. 00:30:11.976 [2024-11-26 04:41:51.056023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.976 [2024-11-26 04:41:51.056123] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.976 [2024-11-26 04:41:51.056147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.976 [2024-11-26 04:41:51.056160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.976 [2024-11-26 04:41:51.056173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.976 [2024-11-26 04:41:51.056202] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.976 qpair failed and we were unable to recover it. 00:30:11.976 [2024-11-26 04:41:51.066062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.976 [2024-11-26 04:41:51.066163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.976 [2024-11-26 04:41:51.066207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.976 [2024-11-26 04:41:51.066225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.976 [2024-11-26 04:41:51.066238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:11.976 [2024-11-26 04:41:51.066272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:11.976 qpair failed and we were unable to recover it. 00:30:11.976 [2024-11-26 04:41:51.076087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.976 [2024-11-26 04:41:51.076181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.976 [2024-11-26 04:41:51.076213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.976 [2024-11-26 04:41:51.076228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.976 [2024-11-26 04:41:51.076248] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:11.976 [2024-11-26 04:41:51.076279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:11.976 qpair failed and we were unable to recover it. 00:30:11.976 [2024-11-26 04:41:51.086080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.976 [2024-11-26 04:41:51.086177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.976 [2024-11-26 04:41:51.086204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.976 [2024-11-26 04:41:51.086219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.976 [2024-11-26 04:41:51.086232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:11.976 [2024-11-26 04:41:51.086261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:11.976 qpair failed and we were unable to recover it. 00:30:11.977 [2024-11-26 04:41:51.096247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.977 [2024-11-26 04:41:51.096384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.977 [2024-11-26 04:41:51.096413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.977 [2024-11-26 04:41:51.096428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.977 [2024-11-26 04:41:51.096440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:11.977 [2024-11-26 04:41:51.096468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:11.977 qpair failed and we were unable to recover it. 00:30:11.977 [2024-11-26 04:41:51.106182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.977 [2024-11-26 04:41:51.106284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.977 [2024-11-26 04:41:51.106314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.977 [2024-11-26 04:41:51.106331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.977 [2024-11-26 04:41:51.106344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:11.977 [2024-11-26 04:41:51.106374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:11.977 qpair failed and we were unable to recover it. 00:30:11.977 [2024-11-26 04:41:51.116224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.977 [2024-11-26 04:41:51.116337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.977 [2024-11-26 04:41:51.116366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.977 [2024-11-26 04:41:51.116380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.977 [2024-11-26 04:41:51.116393] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:11.977 [2024-11-26 04:41:51.116423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:11.977 qpair failed and we were unable to recover it. 00:30:11.977 [2024-11-26 04:41:51.126207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.977 [2024-11-26 04:41:51.126314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.977 [2024-11-26 04:41:51.126340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.977 [2024-11-26 04:41:51.126354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.977 [2024-11-26 04:41:51.126367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:11.977 [2024-11-26 04:41:51.126396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:11.977 qpair failed and we were unable to recover it. 00:30:11.977 [2024-11-26 04:41:51.136272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.977 [2024-11-26 04:41:51.136389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.977 [2024-11-26 04:41:51.136414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.977 [2024-11-26 04:41:51.136428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.977 [2024-11-26 04:41:51.136440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:11.977 [2024-11-26 04:41:51.136468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:11.977 qpair failed and we were unable to recover it. 00:30:11.977 [2024-11-26 04:41:51.146278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.977 [2024-11-26 04:41:51.146376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.977 [2024-11-26 04:41:51.146402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.977 [2024-11-26 04:41:51.146416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.977 [2024-11-26 04:41:51.146429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:11.977 [2024-11-26 04:41:51.146456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:11.977 qpair failed and we were unable to recover it. 00:30:11.977 [2024-11-26 04:41:51.156321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.977 [2024-11-26 04:41:51.156447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.977 [2024-11-26 04:41:51.156471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.977 [2024-11-26 04:41:51.156484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.977 [2024-11-26 04:41:51.156496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:11.977 [2024-11-26 04:41:51.156523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:11.977 qpair failed and we were unable to recover it. 00:30:11.977 [2024-11-26 04:41:51.166328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.977 [2024-11-26 04:41:51.166463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.977 [2024-11-26 04:41:51.166489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.977 [2024-11-26 04:41:51.166505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.977 [2024-11-26 04:41:51.166524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:11.977 [2024-11-26 04:41:51.166553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:11.977 qpair failed and we were unable to recover it. 00:30:11.977 [2024-11-26 04:41:51.176411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.977 [2024-11-26 04:41:51.176552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.977 [2024-11-26 04:41:51.176580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.977 [2024-11-26 04:41:51.176595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.977 [2024-11-26 04:41:51.176607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:11.977 [2024-11-26 04:41:51.176635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:11.977 qpair failed and we were unable to recover it. 00:30:11.977 [2024-11-26 04:41:51.186478] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.977 [2024-11-26 04:41:51.186570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.977 [2024-11-26 04:41:51.186596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.977 [2024-11-26 04:41:51.186609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.977 [2024-11-26 04:41:51.186622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:11.977 [2024-11-26 04:41:51.186649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:11.977 qpair failed and we were unable to recover it. 00:30:11.977 [2024-11-26 04:41:51.196430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.236 [2024-11-26 04:41:51.196559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.236 [2024-11-26 04:41:51.196585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.236 [2024-11-26 04:41:51.196600] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.236 [2024-11-26 04:41:51.196613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.236 [2024-11-26 04:41:51.196640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.236 qpair failed and we were unable to recover it. 00:30:12.236 [2024-11-26 04:41:51.206575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.206674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.206706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.206721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.206734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.237 [2024-11-26 04:41:51.206762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.237 qpair failed and we were unable to recover it. 00:30:12.237 [2024-11-26 04:41:51.216488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.216599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.216624] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.216638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.216651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.237 [2024-11-26 04:41:51.216677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.237 qpair failed and we were unable to recover it. 00:30:12.237 [2024-11-26 04:41:51.226503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.226604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.226628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.226642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.226655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.237 [2024-11-26 04:41:51.226682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.237 qpair failed and we were unable to recover it. 00:30:12.237 [2024-11-26 04:41:51.236546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.236642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.236670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.236699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.236716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.237 [2024-11-26 04:41:51.236746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.237 qpair failed and we were unable to recover it. 00:30:12.237 [2024-11-26 04:41:51.246548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.246648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.246673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.246696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.246711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.237 [2024-11-26 04:41:51.246740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.237 qpair failed and we were unable to recover it. 00:30:12.237 [2024-11-26 04:41:51.256623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.256734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.256760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.256774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.256792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.237 [2024-11-26 04:41:51.256821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.237 qpair failed and we were unable to recover it. 00:30:12.237 [2024-11-26 04:41:51.266618] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.266728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.266754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.266767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.266780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.237 [2024-11-26 04:41:51.266811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.237 qpair failed and we were unable to recover it. 00:30:12.237 [2024-11-26 04:41:51.276646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.276767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.276793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.276807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.276819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.237 [2024-11-26 04:41:51.276847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.237 qpair failed and we were unable to recover it. 00:30:12.237 [2024-11-26 04:41:51.286701] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.286807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.286832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.286846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.286858] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.237 [2024-11-26 04:41:51.286886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.237 qpair failed and we were unable to recover it. 00:30:12.237 [2024-11-26 04:41:51.296770] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.296877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.296906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.296920] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.296933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.237 [2024-11-26 04:41:51.296962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.237 qpair failed and we were unable to recover it. 00:30:12.237 [2024-11-26 04:41:51.306775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.306903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.306930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.306944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.306957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.237 [2024-11-26 04:41:51.306986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.237 qpair failed and we were unable to recover it. 00:30:12.237 [2024-11-26 04:41:51.316787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.316906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.316935] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.316949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.316962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.237 [2024-11-26 04:41:51.316990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.237 qpair failed and we were unable to recover it. 00:30:12.237 [2024-11-26 04:41:51.326795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.237 [2024-11-26 04:41:51.326890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.237 [2024-11-26 04:41:51.326916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.237 [2024-11-26 04:41:51.326930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.237 [2024-11-26 04:41:51.326942] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.238 [2024-11-26 04:41:51.326970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.238 qpair failed and we were unable to recover it. 00:30:12.238 [2024-11-26 04:41:51.336885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.238 [2024-11-26 04:41:51.336996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.238 [2024-11-26 04:41:51.337022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.238 [2024-11-26 04:41:51.337035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.238 [2024-11-26 04:41:51.337048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.238 [2024-11-26 04:41:51.337075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.238 qpair failed and we were unable to recover it. 00:30:12.238 [2024-11-26 04:41:51.346852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.238 [2024-11-26 04:41:51.346951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.238 [2024-11-26 04:41:51.346976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.238 [2024-11-26 04:41:51.346990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.238 [2024-11-26 04:41:51.347009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.238 [2024-11-26 04:41:51.347037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.238 qpair failed and we were unable to recover it. 00:30:12.238 [2024-11-26 04:41:51.356955] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.238 [2024-11-26 04:41:51.357067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.238 [2024-11-26 04:41:51.357093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.238 [2024-11-26 04:41:51.357107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.238 [2024-11-26 04:41:51.357120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.238 [2024-11-26 04:41:51.357147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.238 qpair failed and we were unable to recover it. 00:30:12.238 [2024-11-26 04:41:51.366946] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.238 [2024-11-26 04:41:51.367041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.238 [2024-11-26 04:41:51.367068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.238 [2024-11-26 04:41:51.367082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.238 [2024-11-26 04:41:51.367095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.238 [2024-11-26 04:41:51.367123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.238 qpair failed and we were unable to recover it. 00:30:12.238 [2024-11-26 04:41:51.377025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.238 [2024-11-26 04:41:51.377127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.238 [2024-11-26 04:41:51.377153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.238 [2024-11-26 04:41:51.377167] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.238 [2024-11-26 04:41:51.377180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.238 [2024-11-26 04:41:51.377207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.238 qpair failed and we were unable to recover it. 00:30:12.238 [2024-11-26 04:41:51.386999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.238 [2024-11-26 04:41:51.387143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.238 [2024-11-26 04:41:51.387171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.238 [2024-11-26 04:41:51.387185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.238 [2024-11-26 04:41:51.387198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.238 [2024-11-26 04:41:51.387227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.238 qpair failed and we were unable to recover it. 00:30:12.238 [2024-11-26 04:41:51.397059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.238 [2024-11-26 04:41:51.397193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.238 [2024-11-26 04:41:51.397218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.238 [2024-11-26 04:41:51.397232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.238 [2024-11-26 04:41:51.397245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.238 [2024-11-26 04:41:51.397272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.238 qpair failed and we were unable to recover it. 00:30:12.238 [2024-11-26 04:41:51.407115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.238 [2024-11-26 04:41:51.407220] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.238 [2024-11-26 04:41:51.407246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.238 [2024-11-26 04:41:51.407260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.238 [2024-11-26 04:41:51.407272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.238 [2024-11-26 04:41:51.407299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.238 qpair failed and we were unable to recover it. 00:30:12.238 [2024-11-26 04:41:51.417182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.238 [2024-11-26 04:41:51.417283] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.238 [2024-11-26 04:41:51.417308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.238 [2024-11-26 04:41:51.417322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.238 [2024-11-26 04:41:51.417335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.238 [2024-11-26 04:41:51.417361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.238 qpair failed and we were unable to recover it. 00:30:12.238 [2024-11-26 04:41:51.427105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.238 [2024-11-26 04:41:51.427243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.238 [2024-11-26 04:41:51.427268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.238 [2024-11-26 04:41:51.427281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.238 [2024-11-26 04:41:51.427294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.238 [2024-11-26 04:41:51.427321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.238 qpair failed and we were unable to recover it. 00:30:12.238 [2024-11-26 04:41:51.437172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.238 [2024-11-26 04:41:51.437268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.238 [2024-11-26 04:41:51.437294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.238 [2024-11-26 04:41:51.437308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.238 [2024-11-26 04:41:51.437326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.238 [2024-11-26 04:41:51.437354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.238 qpair failed and we were unable to recover it. 00:30:12.238 [2024-11-26 04:41:51.447190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.238 [2024-11-26 04:41:51.447285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.238 [2024-11-26 04:41:51.447310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.238 [2024-11-26 04:41:51.447324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.239 [2024-11-26 04:41:51.447337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.239 [2024-11-26 04:41:51.447365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.239 qpair failed and we were unable to recover it. 00:30:12.239 [2024-11-26 04:41:51.457251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.239 [2024-11-26 04:41:51.457361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.239 [2024-11-26 04:41:51.457386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.239 [2024-11-26 04:41:51.457400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.239 [2024-11-26 04:41:51.457413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.239 [2024-11-26 04:41:51.457440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.239 qpair failed and we were unable to recover it. 00:30:12.497 [2024-11-26 04:41:51.467218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.497 [2024-11-26 04:41:51.467315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.497 [2024-11-26 04:41:51.467341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.497 [2024-11-26 04:41:51.467354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.497 [2024-11-26 04:41:51.467367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.497 [2024-11-26 04:41:51.467395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.497 qpair failed and we were unable to recover it. 00:30:12.497 [2024-11-26 04:41:51.477268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.497 [2024-11-26 04:41:51.477362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.497 [2024-11-26 04:41:51.477388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.497 [2024-11-26 04:41:51.477402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.497 [2024-11-26 04:41:51.477414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.497 [2024-11-26 04:41:51.477441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.497 qpair failed and we were unable to recover it. 00:30:12.497 [2024-11-26 04:41:51.487307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.497 [2024-11-26 04:41:51.487409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.497 [2024-11-26 04:41:51.487434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.497 [2024-11-26 04:41:51.487448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.497 [2024-11-26 04:41:51.487461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.497 [2024-11-26 04:41:51.487488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.497 qpair failed and we were unable to recover it. 00:30:12.497 [2024-11-26 04:41:51.497376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.497 [2024-11-26 04:41:51.497522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.497 [2024-11-26 04:41:51.497547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.497 [2024-11-26 04:41:51.497561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.497 [2024-11-26 04:41:51.497574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.497 [2024-11-26 04:41:51.497601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.497 qpair failed and we were unable to recover it. 00:30:12.497 [2024-11-26 04:41:51.507387] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.497 [2024-11-26 04:41:51.507516] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.497 [2024-11-26 04:41:51.507541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.497 [2024-11-26 04:41:51.507556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.497 [2024-11-26 04:41:51.507568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.497 [2024-11-26 04:41:51.507596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.497 qpair failed and we were unable to recover it. 00:30:12.497 [2024-11-26 04:41:51.517381] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.497 [2024-11-26 04:41:51.517505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.497 [2024-11-26 04:41:51.517530] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.497 [2024-11-26 04:41:51.517545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.517557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.517585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.527503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.527648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.527672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.527704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.527719] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.527747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.537451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.537580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.537606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.537620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.537632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.537660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.547517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.547655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.547697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.547717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.547729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.547759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.557492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.557593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.557619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.557633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.557646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.557674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.567529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.567624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.567649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.567662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.567675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.567709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.577591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.577703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.577729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.577743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.577756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.577783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.587585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.587692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.587718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.587732] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.587745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.587772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.597609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.597712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.597737] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.597751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.597764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.597791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.607622] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.607727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.607752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.607766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.607779] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.607807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.617697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.617804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.617830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.617851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.617866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.617896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.627801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.627902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.627929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.627951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.627965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.628006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.637735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.637833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.637862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.637886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.637900] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.637929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.647830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.647961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.647987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.648000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.648013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.648041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.657795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.657901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.657926] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.657940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.657953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.657980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.667827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.667931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.667957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.667971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.667983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.668011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.677874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.677997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.678022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.678036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.678049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.678076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.687894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.687992] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.688018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.688032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.688045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.688072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.697945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.698058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.698083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.698097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.698110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.698138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.707922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.708023] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.708049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.708068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.708081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.708110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.498 [2024-11-26 04:41:51.717945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.498 [2024-11-26 04:41:51.718038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.498 [2024-11-26 04:41:51.718064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.498 [2024-11-26 04:41:51.718078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.498 [2024-11-26 04:41:51.718090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.498 [2024-11-26 04:41:51.718118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.498 qpair failed and we were unable to recover it. 00:30:12.758 [2024-11-26 04:41:51.727954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.758 [2024-11-26 04:41:51.728060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.758 [2024-11-26 04:41:51.728085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.758 [2024-11-26 04:41:51.728099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.758 [2024-11-26 04:41:51.728111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.758 [2024-11-26 04:41:51.728139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.758 qpair failed and we were unable to recover it. 00:30:12.758 [2024-11-26 04:41:51.738055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.758 [2024-11-26 04:41:51.738158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.758 [2024-11-26 04:41:51.738183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.758 [2024-11-26 04:41:51.738197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.758 [2024-11-26 04:41:51.738209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.758 [2024-11-26 04:41:51.738236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.758 qpair failed and we were unable to recover it. 00:30:12.758 [2024-11-26 04:41:51.748060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.758 [2024-11-26 04:41:51.748160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.758 [2024-11-26 04:41:51.748185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.758 [2024-11-26 04:41:51.748199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.758 [2024-11-26 04:41:51.748211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.758 [2024-11-26 04:41:51.748239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.758 qpair failed and we were unable to recover it. 00:30:12.758 [2024-11-26 04:41:51.758088] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.758 [2024-11-26 04:41:51.758198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.758 [2024-11-26 04:41:51.758224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.758 [2024-11-26 04:41:51.758238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.758 [2024-11-26 04:41:51.758250] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.758278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.768120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.768218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.768243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.768257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.768269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.768296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.778177] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.778281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.778307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.778320] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.778333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.778360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.788141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.788274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.788299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.788312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.788326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.788353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.798286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.798415] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.798440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.798461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.798475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.798502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.808334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.808468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.808493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.808506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.808519] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.808546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.818239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.818339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.818365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.818379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.818391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.818418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.828273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.828428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.828453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.828466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.828479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.828507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.838303] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.838420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.838444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.838458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.838469] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.838497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.848329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.848431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.848456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.848469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.848481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.848509] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.858445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.858547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.858572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.858586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.858598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.858625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.868365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.868469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.868494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.868507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.868520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.868547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.878396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.878495] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.878520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.878534] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.878545] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.878573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.888432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.888527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.888551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.888571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.888585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.888614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.898477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.898583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.898608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.898622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.898634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.898661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.908498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.908602] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.908627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.908641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.908654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.908680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.918574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.918694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.918720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.918733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.918745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.918773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.928561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.928658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.928683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.928709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.928722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.928750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.938612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.938733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.938758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.938772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.938785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.938812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.948599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.948746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.948771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.948785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.948797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.948826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.958731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.958830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.958855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.958869] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.958882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.958910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.968737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.759 [2024-11-26 04:41:51.968862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.759 [2024-11-26 04:41:51.968887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.759 [2024-11-26 04:41:51.968901] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.759 [2024-11-26 04:41:51.968913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.759 [2024-11-26 04:41:51.968940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.759 qpair failed and we were unable to recover it. 00:30:12.759 [2024-11-26 04:41:51.978718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.760 [2024-11-26 04:41:51.978845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.760 [2024-11-26 04:41:51.978874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.760 [2024-11-26 04:41:51.978894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.760 [2024-11-26 04:41:51.978907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:12.760 [2024-11-26 04:41:51.978936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:12.760 qpair failed and we were unable to recover it. 00:30:13.021 [2024-11-26 04:41:51.988789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.021 [2024-11-26 04:41:51.988894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.021 [2024-11-26 04:41:51.988920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.021 [2024-11-26 04:41:51.988933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.021 [2024-11-26 04:41:51.988946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.021 [2024-11-26 04:41:51.988976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.021 qpair failed and we were unable to recover it. 00:30:13.021 [2024-11-26 04:41:51.998774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.021 [2024-11-26 04:41:51.998874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.021 [2024-11-26 04:41:51.998900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.021 [2024-11-26 04:41:51.998914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.021 [2024-11-26 04:41:51.998926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.021 [2024-11-26 04:41:51.998955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.021 qpair failed and we were unable to recover it. 00:30:13.021 [2024-11-26 04:41:52.008780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.021 [2024-11-26 04:41:52.008877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.021 [2024-11-26 04:41:52.008902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.021 [2024-11-26 04:41:52.008917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.021 [2024-11-26 04:41:52.008930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.021 [2024-11-26 04:41:52.008957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.021 qpair failed and we were unable to recover it. 00:30:13.021 [2024-11-26 04:41:52.018957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.021 [2024-11-26 04:41:52.019060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.021 [2024-11-26 04:41:52.019085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.021 [2024-11-26 04:41:52.019098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.022 [2024-11-26 04:41:52.019111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.022 [2024-11-26 04:41:52.019139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.022 qpair failed and we were unable to recover it. 00:30:13.022 [2024-11-26 04:41:52.028968] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.022 [2024-11-26 04:41:52.029114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.022 [2024-11-26 04:41:52.029139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.022 [2024-11-26 04:41:52.029152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.022 [2024-11-26 04:41:52.029166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.022 [2024-11-26 04:41:52.029193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.022 qpair failed and we were unable to recover it. 00:30:13.022 [2024-11-26 04:41:52.038902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.022 [2024-11-26 04:41:52.039002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.022 [2024-11-26 04:41:52.039027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.022 [2024-11-26 04:41:52.039041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.022 [2024-11-26 04:41:52.039054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.022 [2024-11-26 04:41:52.039082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.022 qpair failed and we were unable to recover it. 00:30:13.022 [2024-11-26 04:41:52.048934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.022 [2024-11-26 04:41:52.049030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.022 [2024-11-26 04:41:52.049055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.022 [2024-11-26 04:41:52.049069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.022 [2024-11-26 04:41:52.049081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.022 [2024-11-26 04:41:52.049109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.022 qpair failed and we were unable to recover it. 00:30:13.022 [2024-11-26 04:41:52.058932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.022 [2024-11-26 04:41:52.059036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.022 [2024-11-26 04:41:52.059060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.022 [2024-11-26 04:41:52.059074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.022 [2024-11-26 04:41:52.059086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.022 [2024-11-26 04:41:52.059113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.022 qpair failed and we were unable to recover it. 00:30:13.022 [2024-11-26 04:41:52.068963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.022 [2024-11-26 04:41:52.069068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.022 [2024-11-26 04:41:52.069098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.022 [2024-11-26 04:41:52.069113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.022 [2024-11-26 04:41:52.069125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.022 [2024-11-26 04:41:52.069152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.022 qpair failed and we were unable to recover it. 00:30:13.022 [2024-11-26 04:41:52.079011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.022 [2024-11-26 04:41:52.079138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.022 [2024-11-26 04:41:52.079163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.022 [2024-11-26 04:41:52.079177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.022 [2024-11-26 04:41:52.079189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.022 [2024-11-26 04:41:52.079218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.022 qpair failed and we were unable to recover it. 00:30:13.022 [2024-11-26 04:41:52.089036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.022 [2024-11-26 04:41:52.089138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.022 [2024-11-26 04:41:52.089163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.022 [2024-11-26 04:41:52.089177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.022 [2024-11-26 04:41:52.089189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.022 [2024-11-26 04:41:52.089216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.022 qpair failed and we were unable to recover it. 00:30:13.022 [2024-11-26 04:41:52.099078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.022 [2024-11-26 04:41:52.099181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.022 [2024-11-26 04:41:52.099205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.022 [2024-11-26 04:41:52.099219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.022 [2024-11-26 04:41:52.099231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.022 [2024-11-26 04:41:52.099257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.022 qpair failed and we were unable to recover it. 00:30:13.022 [2024-11-26 04:41:52.109059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.022 [2024-11-26 04:41:52.109153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.022 [2024-11-26 04:41:52.109178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.022 [2024-11-26 04:41:52.109191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.022 [2024-11-26 04:41:52.109204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.022 [2024-11-26 04:41:52.109231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.022 qpair failed and we were unable to recover it. 00:30:13.022 [2024-11-26 04:41:52.119129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.022 [2024-11-26 04:41:52.119246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.022 [2024-11-26 04:41:52.119271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.022 [2024-11-26 04:41:52.119285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.022 [2024-11-26 04:41:52.119298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.023 [2024-11-26 04:41:52.119325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.023 qpair failed and we were unable to recover it. 00:30:13.023 [2024-11-26 04:41:52.129106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.023 [2024-11-26 04:41:52.129220] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.023 [2024-11-26 04:41:52.129246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.023 [2024-11-26 04:41:52.129260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.023 [2024-11-26 04:41:52.129273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.023 [2024-11-26 04:41:52.129300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.023 qpair failed and we were unable to recover it. 00:30:13.023 [2024-11-26 04:41:52.139186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.023 [2024-11-26 04:41:52.139289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.023 [2024-11-26 04:41:52.139317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.023 [2024-11-26 04:41:52.139331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.023 [2024-11-26 04:41:52.139344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.023 [2024-11-26 04:41:52.139371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.023 qpair failed and we were unable to recover it. 00:30:13.023 [2024-11-26 04:41:52.149183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.023 [2024-11-26 04:41:52.149322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.023 [2024-11-26 04:41:52.149348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.023 [2024-11-26 04:41:52.149362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.023 [2024-11-26 04:41:52.149375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.023 [2024-11-26 04:41:52.149402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.023 qpair failed and we were unable to recover it. 00:30:13.023 [2024-11-26 04:41:52.159204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.023 [2024-11-26 04:41:52.159302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.023 [2024-11-26 04:41:52.159331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.023 [2024-11-26 04:41:52.159345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.023 [2024-11-26 04:41:52.159357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.023 [2024-11-26 04:41:52.159384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.023 qpair failed and we were unable to recover it. 00:30:13.023 [2024-11-26 04:41:52.169273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.023 [2024-11-26 04:41:52.169381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.023 [2024-11-26 04:41:52.169409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.023 [2024-11-26 04:41:52.169424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.023 [2024-11-26 04:41:52.169437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.023 [2024-11-26 04:41:52.169465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.023 qpair failed and we were unable to recover it. 00:30:13.023 [2024-11-26 04:41:52.179283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.023 [2024-11-26 04:41:52.179391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.023 [2024-11-26 04:41:52.179415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.023 [2024-11-26 04:41:52.179429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.023 [2024-11-26 04:41:52.179443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.023 [2024-11-26 04:41:52.179470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.023 qpair failed and we were unable to recover it. 00:30:13.023 [2024-11-26 04:41:52.189337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.023 [2024-11-26 04:41:52.189451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.023 [2024-11-26 04:41:52.189476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.023 [2024-11-26 04:41:52.189490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.023 [2024-11-26 04:41:52.189502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.023 [2024-11-26 04:41:52.189530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.023 qpair failed and we were unable to recover it. 00:30:13.023 [2024-11-26 04:41:52.199487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.023 [2024-11-26 04:41:52.199616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.023 [2024-11-26 04:41:52.199641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.023 [2024-11-26 04:41:52.199654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.023 [2024-11-26 04:41:52.199667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.023 [2024-11-26 04:41:52.199707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.023 qpair failed and we were unable to recover it. 00:30:13.023 [2024-11-26 04:41:52.209368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.023 [2024-11-26 04:41:52.209460] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.023 [2024-11-26 04:41:52.209485] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.023 [2024-11-26 04:41:52.209498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.023 [2024-11-26 04:41:52.209511] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.023 [2024-11-26 04:41:52.209538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.023 qpair failed and we were unable to recover it. 00:30:13.023 [2024-11-26 04:41:52.219433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.023 [2024-11-26 04:41:52.219534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.023 [2024-11-26 04:41:52.219559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.023 [2024-11-26 04:41:52.219573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.023 [2024-11-26 04:41:52.219585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.023 [2024-11-26 04:41:52.219612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.023 qpair failed and we were unable to recover it. 00:30:13.023 [2024-11-26 04:41:52.229457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.023 [2024-11-26 04:41:52.229578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.023 [2024-11-26 04:41:52.229603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.024 [2024-11-26 04:41:52.229617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.024 [2024-11-26 04:41:52.229630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.024 [2024-11-26 04:41:52.229657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.024 qpair failed and we were unable to recover it. 00:30:13.024 [2024-11-26 04:41:52.239456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.024 [2024-11-26 04:41:52.239552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.024 [2024-11-26 04:41:52.239577] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.024 [2024-11-26 04:41:52.239591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.024 [2024-11-26 04:41:52.239603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.024 [2024-11-26 04:41:52.239630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.024 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-26 04:41:52.249489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.284 [2024-11-26 04:41:52.249621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.284 [2024-11-26 04:41:52.249651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.284 [2024-11-26 04:41:52.249666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.284 [2024-11-26 04:41:52.249679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.284 [2024-11-26 04:41:52.249718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-26 04:41:52.259546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.284 [2024-11-26 04:41:52.259697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.284 [2024-11-26 04:41:52.259722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.284 [2024-11-26 04:41:52.259735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.284 [2024-11-26 04:41:52.259748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.284 [2024-11-26 04:41:52.259776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-26 04:41:52.269550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.284 [2024-11-26 04:41:52.269704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.284 [2024-11-26 04:41:52.269730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.284 [2024-11-26 04:41:52.269744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.284 [2024-11-26 04:41:52.269757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.284 [2024-11-26 04:41:52.269785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-26 04:41:52.279691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.284 [2024-11-26 04:41:52.279799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.284 [2024-11-26 04:41:52.279823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.284 [2024-11-26 04:41:52.279837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.284 [2024-11-26 04:41:52.279850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.284 [2024-11-26 04:41:52.279877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-26 04:41:52.289632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.284 [2024-11-26 04:41:52.289755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.284 [2024-11-26 04:41:52.289781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.284 [2024-11-26 04:41:52.289794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.284 [2024-11-26 04:41:52.289807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.284 [2024-11-26 04:41:52.289841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-26 04:41:52.299623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.284 [2024-11-26 04:41:52.299732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.284 [2024-11-26 04:41:52.299757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.284 [2024-11-26 04:41:52.299771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.284 [2024-11-26 04:41:52.299783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.284 [2024-11-26 04:41:52.299811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.284 [2024-11-26 04:41:52.309673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.284 [2024-11-26 04:41:52.309794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.284 [2024-11-26 04:41:52.309822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.284 [2024-11-26 04:41:52.309837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.284 [2024-11-26 04:41:52.309850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.284 [2024-11-26 04:41:52.309879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.284 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.319746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.319902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.319928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.319942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.319955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.319982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.329792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.329911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.329935] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.329949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.329961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.329988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.339800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.339899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.339929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.339945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.339957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.339984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.349834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.349936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.349962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.349976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.349989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.350016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.359855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.359959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.359984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.359997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.360010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.360037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.369818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.369912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.369937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.369950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.369963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.369990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.379871] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.379971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.379995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.380009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.380021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.380054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.389989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.390119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.390145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.390159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.390172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.390199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.399938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.400034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.400062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.400076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.400089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.400117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.409926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.410052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.410076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.410089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.410102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.410129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.420079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.420184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.420209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.420223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.420235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.420263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.430078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.430180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.430214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.430229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.430242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.430269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.285 [2024-11-26 04:41:52.440023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.285 [2024-11-26 04:41:52.440147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.285 [2024-11-26 04:41:52.440172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.285 [2024-11-26 04:41:52.440186] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.285 [2024-11-26 04:41:52.440199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.285 [2024-11-26 04:41:52.440225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.285 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-26 04:41:52.450060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.286 [2024-11-26 04:41:52.450153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.286 [2024-11-26 04:41:52.450178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.286 [2024-11-26 04:41:52.450191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.286 [2024-11-26 04:41:52.450204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.286 [2024-11-26 04:41:52.450231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-26 04:41:52.460139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.286 [2024-11-26 04:41:52.460246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.286 [2024-11-26 04:41:52.460274] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.286 [2024-11-26 04:41:52.460288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.286 [2024-11-26 04:41:52.460300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.286 [2024-11-26 04:41:52.460328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-26 04:41:52.470174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.286 [2024-11-26 04:41:52.470288] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.286 [2024-11-26 04:41:52.470313] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.286 [2024-11-26 04:41:52.470326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.286 [2024-11-26 04:41:52.470339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.286 [2024-11-26 04:41:52.470372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-26 04:41:52.480146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.286 [2024-11-26 04:41:52.480240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.286 [2024-11-26 04:41:52.480265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.286 [2024-11-26 04:41:52.480279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.286 [2024-11-26 04:41:52.480291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.286 [2024-11-26 04:41:52.480318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-26 04:41:52.490210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.286 [2024-11-26 04:41:52.490335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.286 [2024-11-26 04:41:52.490360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.286 [2024-11-26 04:41:52.490374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.286 [2024-11-26 04:41:52.490386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.286 [2024-11-26 04:41:52.490414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.286 [2024-11-26 04:41:52.500207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.286 [2024-11-26 04:41:52.500318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.286 [2024-11-26 04:41:52.500343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.286 [2024-11-26 04:41:52.500356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.286 [2024-11-26 04:41:52.500369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.286 [2024-11-26 04:41:52.500396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.286 qpair failed and we were unable to recover it. 00:30:13.546 [2024-11-26 04:41:52.510242] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.546 [2024-11-26 04:41:52.510352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.546 [2024-11-26 04:41:52.510378] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.546 [2024-11-26 04:41:52.510392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.546 [2024-11-26 04:41:52.510405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.546 [2024-11-26 04:41:52.510433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.546 qpair failed and we were unable to recover it. 00:30:13.546 [2024-11-26 04:41:52.520292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.546 [2024-11-26 04:41:52.520387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.546 [2024-11-26 04:41:52.520417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.546 [2024-11-26 04:41:52.520432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.546 [2024-11-26 04:41:52.520444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.546 [2024-11-26 04:41:52.520471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.546 qpair failed and we were unable to recover it. 00:30:13.546 [2024-11-26 04:41:52.530328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.546 [2024-11-26 04:41:52.530453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.546 [2024-11-26 04:41:52.530484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.546 [2024-11-26 04:41:52.530498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.546 [2024-11-26 04:41:52.530510] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.546 [2024-11-26 04:41:52.530538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.546 qpair failed and we were unable to recover it. 00:30:13.546 [2024-11-26 04:41:52.540345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.546 [2024-11-26 04:41:52.540450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.546 [2024-11-26 04:41:52.540478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.546 [2024-11-26 04:41:52.540491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.546 [2024-11-26 04:41:52.540504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.546 [2024-11-26 04:41:52.540531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.546 qpair failed and we were unable to recover it. 00:30:13.546 [2024-11-26 04:41:52.550347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.546 [2024-11-26 04:41:52.550447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.546 [2024-11-26 04:41:52.550472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.546 [2024-11-26 04:41:52.550486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.546 [2024-11-26 04:41:52.550499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.546 [2024-11-26 04:41:52.550526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.560381] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.547 [2024-11-26 04:41:52.560482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.547 [2024-11-26 04:41:52.560509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.547 [2024-11-26 04:41:52.560522] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.547 [2024-11-26 04:41:52.560535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.547 [2024-11-26 04:41:52.560568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.570434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.547 [2024-11-26 04:41:52.570533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.547 [2024-11-26 04:41:52.570557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.547 [2024-11-26 04:41:52.570571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.547 [2024-11-26 04:41:52.570584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.547 [2024-11-26 04:41:52.570611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.580445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.547 [2024-11-26 04:41:52.580548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.547 [2024-11-26 04:41:52.580574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.547 [2024-11-26 04:41:52.580588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.547 [2024-11-26 04:41:52.580600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.547 [2024-11-26 04:41:52.580627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.590477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.547 [2024-11-26 04:41:52.590575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.547 [2024-11-26 04:41:52.590600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.547 [2024-11-26 04:41:52.590614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.547 [2024-11-26 04:41:52.590627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.547 [2024-11-26 04:41:52.590654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.600514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.547 [2024-11-26 04:41:52.600613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.547 [2024-11-26 04:41:52.600639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.547 [2024-11-26 04:41:52.600652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.547 [2024-11-26 04:41:52.600665] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.547 [2024-11-26 04:41:52.600699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.610540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.547 [2024-11-26 04:41:52.610654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.547 [2024-11-26 04:41:52.610694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.547 [2024-11-26 04:41:52.610712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.547 [2024-11-26 04:41:52.610727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.547 [2024-11-26 04:41:52.610757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.620574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.547 [2024-11-26 04:41:52.620677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.547 [2024-11-26 04:41:52.620714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.547 [2024-11-26 04:41:52.620729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.547 [2024-11-26 04:41:52.620741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.547 [2024-11-26 04:41:52.620769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.630576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.547 [2024-11-26 04:41:52.630675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.547 [2024-11-26 04:41:52.630707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.547 [2024-11-26 04:41:52.630722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.547 [2024-11-26 04:41:52.630735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.547 [2024-11-26 04:41:52.630762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.640616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.547 [2024-11-26 04:41:52.640726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.547 [2024-11-26 04:41:52.640751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.547 [2024-11-26 04:41:52.640765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.547 [2024-11-26 04:41:52.640778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.547 [2024-11-26 04:41:52.640805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.650641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.547 [2024-11-26 04:41:52.650742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.547 [2024-11-26 04:41:52.650767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.547 [2024-11-26 04:41:52.650781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.547 [2024-11-26 04:41:52.650798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.547 [2024-11-26 04:41:52.650827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.660667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.547 [2024-11-26 04:41:52.660783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.547 [2024-11-26 04:41:52.660808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.547 [2024-11-26 04:41:52.660822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.547 [2024-11-26 04:41:52.660834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.547 [2024-11-26 04:41:52.660862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.670716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.547 [2024-11-26 04:41:52.670814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.547 [2024-11-26 04:41:52.670839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.547 [2024-11-26 04:41:52.670853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.547 [2024-11-26 04:41:52.670866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.547 [2024-11-26 04:41:52.670894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.547 qpair failed and we were unable to recover it. 00:30:13.547 [2024-11-26 04:41:52.680820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.548 [2024-11-26 04:41:52.680923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.548 [2024-11-26 04:41:52.680948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.548 [2024-11-26 04:41:52.680963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.548 [2024-11-26 04:41:52.680975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.548 [2024-11-26 04:41:52.681003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.548 qpair failed and we were unable to recover it. 00:30:13.548 [2024-11-26 04:41:52.690768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.548 [2024-11-26 04:41:52.690866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.548 [2024-11-26 04:41:52.690891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.548 [2024-11-26 04:41:52.690904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.548 [2024-11-26 04:41:52.690916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.548 [2024-11-26 04:41:52.690944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.548 qpair failed and we were unable to recover it. 00:30:13.548 [2024-11-26 04:41:52.700793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.548 [2024-11-26 04:41:52.700899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.548 [2024-11-26 04:41:52.700928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.548 [2024-11-26 04:41:52.700943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.548 [2024-11-26 04:41:52.700955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.548 [2024-11-26 04:41:52.700982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.548 qpair failed and we were unable to recover it. 00:30:13.548 [2024-11-26 04:41:52.710836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.548 [2024-11-26 04:41:52.710954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.548 [2024-11-26 04:41:52.710979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.548 [2024-11-26 04:41:52.710993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.548 [2024-11-26 04:41:52.711005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.548 [2024-11-26 04:41:52.711033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.548 qpair failed and we were unable to recover it. 00:30:13.548 [2024-11-26 04:41:52.720852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.548 [2024-11-26 04:41:52.720946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.548 [2024-11-26 04:41:52.720971] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.548 [2024-11-26 04:41:52.720985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.548 [2024-11-26 04:41:52.720997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.548 [2024-11-26 04:41:52.721025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.548 qpair failed and we were unable to recover it. 00:30:13.548 [2024-11-26 04:41:52.730897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.548 [2024-11-26 04:41:52.730987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.548 [2024-11-26 04:41:52.731012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.548 [2024-11-26 04:41:52.731026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.548 [2024-11-26 04:41:52.731038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.548 [2024-11-26 04:41:52.731065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.548 qpair failed and we were unable to recover it. 00:30:13.548 [2024-11-26 04:41:52.740920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.548 [2024-11-26 04:41:52.741043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.548 [2024-11-26 04:41:52.741067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.548 [2024-11-26 04:41:52.741081] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.548 [2024-11-26 04:41:52.741099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.548 [2024-11-26 04:41:52.741129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.548 qpair failed and we were unable to recover it. 00:30:13.548 [2024-11-26 04:41:52.750907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.548 [2024-11-26 04:41:52.751016] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.548 [2024-11-26 04:41:52.751041] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.548 [2024-11-26 04:41:52.751055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.548 [2024-11-26 04:41:52.751068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.548 [2024-11-26 04:41:52.751096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.548 qpair failed and we were unable to recover it. 00:30:13.548 [2024-11-26 04:41:52.760952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.548 [2024-11-26 04:41:52.761053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.548 [2024-11-26 04:41:52.761079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.548 [2024-11-26 04:41:52.761093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.548 [2024-11-26 04:41:52.761106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.548 [2024-11-26 04:41:52.761133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.548 qpair failed and we were unable to recover it. 00:30:13.808 [2024-11-26 04:41:52.771007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.808 [2024-11-26 04:41:52.771136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.808 [2024-11-26 04:41:52.771162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.808 [2024-11-26 04:41:52.771176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.808 [2024-11-26 04:41:52.771189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.808 [2024-11-26 04:41:52.771217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.808 qpair failed and we were unable to recover it. 00:30:13.808 [2024-11-26 04:41:52.781024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.808 [2024-11-26 04:41:52.781127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.808 [2024-11-26 04:41:52.781153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.808 [2024-11-26 04:41:52.781167] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.808 [2024-11-26 04:41:52.781180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.808 [2024-11-26 04:41:52.781207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.808 qpair failed and we were unable to recover it. 00:30:13.808 [2024-11-26 04:41:52.791062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.808 [2024-11-26 04:41:52.791176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.808 [2024-11-26 04:41:52.791202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.808 [2024-11-26 04:41:52.791216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.808 [2024-11-26 04:41:52.791228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.808 [2024-11-26 04:41:52.791255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.808 qpair failed and we were unable to recover it. 00:30:13.808 [2024-11-26 04:41:52.801099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.808 [2024-11-26 04:41:52.801227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.808 [2024-11-26 04:41:52.801253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.808 [2024-11-26 04:41:52.801267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.808 [2024-11-26 04:41:52.801280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.808 [2024-11-26 04:41:52.801307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.808 qpair failed and we were unable to recover it. 00:30:13.808 [2024-11-26 04:41:52.811153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.808 [2024-11-26 04:41:52.811262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.808 [2024-11-26 04:41:52.811286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.808 [2024-11-26 04:41:52.811300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.808 [2024-11-26 04:41:52.811313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.808 [2024-11-26 04:41:52.811340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.808 qpair failed and we were unable to recover it. 00:30:13.808 [2024-11-26 04:41:52.821143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.808 [2024-11-26 04:41:52.821264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.808 [2024-11-26 04:41:52.821289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.808 [2024-11-26 04:41:52.821303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.808 [2024-11-26 04:41:52.821315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.808 [2024-11-26 04:41:52.821345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.808 qpair failed and we were unable to recover it. 00:30:13.808 [2024-11-26 04:41:52.831221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.808 [2024-11-26 04:41:52.831333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.808 [2024-11-26 04:41:52.831358] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.808 [2024-11-26 04:41:52.831372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.808 [2024-11-26 04:41:52.831390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.808 [2024-11-26 04:41:52.831418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.808 qpair failed and we were unable to recover it. 00:30:13.808 [2024-11-26 04:41:52.841194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.808 [2024-11-26 04:41:52.841296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.808 [2024-11-26 04:41:52.841322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.808 [2024-11-26 04:41:52.841336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.808 [2024-11-26 04:41:52.841349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.808 [2024-11-26 04:41:52.841376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.851259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.851396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.851421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.851435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.851448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.851475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.861243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.861344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.861369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.861383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.861395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.861423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.871262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.871358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.871383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.871397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.871409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.871436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.881324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.881426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.881450] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.881464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.881477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.881504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.891319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.891416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.891440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.891453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.891466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.891494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.901378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.901494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.901521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.901535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.901551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.901583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.911370] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.911483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.911509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.911523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.911536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.911565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.921407] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.921529] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.921553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.921567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.921585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.921613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.931457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.931567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.931595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.931609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.931622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.931650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.941482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.941592] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.941617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.941631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.941644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.941673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.951501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.951628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.951653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.951667] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.951679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.951714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.961555] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.961651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.961676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.961703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.961717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.961744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.971545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.809 [2024-11-26 04:41:52.971648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.809 [2024-11-26 04:41:52.971674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.809 [2024-11-26 04:41:52.971697] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.809 [2024-11-26 04:41:52.971712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.809 [2024-11-26 04:41:52.971740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.809 qpair failed and we were unable to recover it. 00:30:13.809 [2024-11-26 04:41:52.981574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.810 [2024-11-26 04:41:52.981675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.810 [2024-11-26 04:41:52.981707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.810 [2024-11-26 04:41:52.981721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.810 [2024-11-26 04:41:52.981734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.810 [2024-11-26 04:41:52.981761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.810 qpair failed and we were unable to recover it. 00:30:13.810 [2024-11-26 04:41:52.991597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.810 [2024-11-26 04:41:52.991743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.810 [2024-11-26 04:41:52.991768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.810 [2024-11-26 04:41:52.991782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.810 [2024-11-26 04:41:52.991794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.810 [2024-11-26 04:41:52.991822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.810 qpair failed and we were unable to recover it. 00:30:13.810 [2024-11-26 04:41:53.001647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.810 [2024-11-26 04:41:53.001771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.810 [2024-11-26 04:41:53.001796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.810 [2024-11-26 04:41:53.001810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.810 [2024-11-26 04:41:53.001822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.810 [2024-11-26 04:41:53.001850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.810 qpair failed and we were unable to recover it. 00:30:13.810 [2024-11-26 04:41:53.011679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.810 [2024-11-26 04:41:53.011787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.810 [2024-11-26 04:41:53.011812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.810 [2024-11-26 04:41:53.011826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.810 [2024-11-26 04:41:53.011844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.810 [2024-11-26 04:41:53.011873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.810 qpair failed and we were unable to recover it. 00:30:13.810 [2024-11-26 04:41:53.021677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.810 [2024-11-26 04:41:53.021782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.810 [2024-11-26 04:41:53.021807] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.810 [2024-11-26 04:41:53.021821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.810 [2024-11-26 04:41:53.021833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:13.810 [2024-11-26 04:41:53.021861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:13.810 qpair failed and we were unable to recover it. 00:30:14.069 [2024-11-26 04:41:53.031749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.069 [2024-11-26 04:41:53.031858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.069 [2024-11-26 04:41:53.031883] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.069 [2024-11-26 04:41:53.031897] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.069 [2024-11-26 04:41:53.031910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.069 [2024-11-26 04:41:53.031937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.069 qpair failed and we were unable to recover it. 00:30:14.069 [2024-11-26 04:41:53.041880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.069 [2024-11-26 04:41:53.041981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.069 [2024-11-26 04:41:53.042006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.069 [2024-11-26 04:41:53.042020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.069 [2024-11-26 04:41:53.042032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.069 [2024-11-26 04:41:53.042059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.069 qpair failed and we were unable to recover it. 00:30:14.069 [2024-11-26 04:41:53.051779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.069 [2024-11-26 04:41:53.051878] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.069 [2024-11-26 04:41:53.051903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.069 [2024-11-26 04:41:53.051917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.069 [2024-11-26 04:41:53.051929] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.069 [2024-11-26 04:41:53.051956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.069 qpair failed and we were unable to recover it. 00:30:14.069 [2024-11-26 04:41:53.061872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.069 [2024-11-26 04:41:53.061990] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.069 [2024-11-26 04:41:53.062015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.062029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.062041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.070 [2024-11-26 04:41:53.062069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.070 qpair failed and we were unable to recover it. 00:30:14.070 [2024-11-26 04:41:53.071839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.070 [2024-11-26 04:41:53.071938] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.070 [2024-11-26 04:41:53.071964] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.071977] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.071990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.070 [2024-11-26 04:41:53.072017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.070 qpair failed and we were unable to recover it. 00:30:14.070 [2024-11-26 04:41:53.081861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.070 [2024-11-26 04:41:53.081960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.070 [2024-11-26 04:41:53.081984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.081998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.082010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.070 [2024-11-26 04:41:53.082039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.070 qpair failed and we were unable to recover it. 00:30:14.070 [2024-11-26 04:41:53.091913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.070 [2024-11-26 04:41:53.092036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.070 [2024-11-26 04:41:53.092061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.092075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.092087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.070 [2024-11-26 04:41:53.092114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.070 qpair failed and we were unable to recover it. 00:30:14.070 [2024-11-26 04:41:53.101970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.070 [2024-11-26 04:41:53.102103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.070 [2024-11-26 04:41:53.102128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.102142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.102159] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.070 [2024-11-26 04:41:53.102186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.070 qpair failed and we were unable to recover it. 00:30:14.070 [2024-11-26 04:41:53.111961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.070 [2024-11-26 04:41:53.112072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.070 [2024-11-26 04:41:53.112097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.112110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.112123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.070 [2024-11-26 04:41:53.112150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.070 qpair failed and we were unable to recover it. 00:30:14.070 [2024-11-26 04:41:53.121981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.070 [2024-11-26 04:41:53.122077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.070 [2024-11-26 04:41:53.122102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.122116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.122128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.070 [2024-11-26 04:41:53.122155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.070 qpair failed and we were unable to recover it. 00:30:14.070 [2024-11-26 04:41:53.132017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.070 [2024-11-26 04:41:53.132111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.070 [2024-11-26 04:41:53.132136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.132150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.132162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.070 [2024-11-26 04:41:53.132191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.070 qpair failed and we were unable to recover it. 00:30:14.070 [2024-11-26 04:41:53.142068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.070 [2024-11-26 04:41:53.142219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.070 [2024-11-26 04:41:53.142244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.142258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.142271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.070 [2024-11-26 04:41:53.142298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.070 qpair failed and we were unable to recover it. 00:30:14.070 [2024-11-26 04:41:53.152100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.070 [2024-11-26 04:41:53.152235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.070 [2024-11-26 04:41:53.152260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.152274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.152287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.070 [2024-11-26 04:41:53.152315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.070 qpair failed and we were unable to recover it. 00:30:14.070 [2024-11-26 04:41:53.162112] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.070 [2024-11-26 04:41:53.162208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.070 [2024-11-26 04:41:53.162231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.162244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.162257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.070 [2024-11-26 04:41:53.162283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.070 qpair failed and we were unable to recover it. 00:30:14.070 [2024-11-26 04:41:53.172183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.070 [2024-11-26 04:41:53.172278] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.070 [2024-11-26 04:41:53.172303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.172316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.172328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.070 [2024-11-26 04:41:53.172355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.070 qpair failed and we were unable to recover it. 00:30:14.070 [2024-11-26 04:41:53.182203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.070 [2024-11-26 04:41:53.182336] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.070 [2024-11-26 04:41:53.182360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.070 [2024-11-26 04:41:53.182374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.070 [2024-11-26 04:41:53.182387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.071 [2024-11-26 04:41:53.182414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.071 qpair failed and we were unable to recover it. 00:30:14.071 [2024-11-26 04:41:53.192289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.071 [2024-11-26 04:41:53.192389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.071 [2024-11-26 04:41:53.192414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.071 [2024-11-26 04:41:53.192435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.071 [2024-11-26 04:41:53.192448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.071 [2024-11-26 04:41:53.192475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.071 qpair failed and we were unable to recover it. 00:30:14.071 [2024-11-26 04:41:53.202252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.071 [2024-11-26 04:41:53.202382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.071 [2024-11-26 04:41:53.202408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.071 [2024-11-26 04:41:53.202422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.071 [2024-11-26 04:41:53.202434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.071 [2024-11-26 04:41:53.202461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.071 qpair failed and we were unable to recover it. 00:30:14.071 [2024-11-26 04:41:53.212358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.071 [2024-11-26 04:41:53.212454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.071 [2024-11-26 04:41:53.212478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.071 [2024-11-26 04:41:53.212492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.071 [2024-11-26 04:41:53.212504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.071 [2024-11-26 04:41:53.212531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.071 qpair failed and we were unable to recover it. 00:30:14.071 [2024-11-26 04:41:53.222385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.071 [2024-11-26 04:41:53.222485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.071 [2024-11-26 04:41:53.222509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.071 [2024-11-26 04:41:53.222523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.071 [2024-11-26 04:41:53.222535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.071 [2024-11-26 04:41:53.222562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.071 qpair failed and we were unable to recover it. 00:30:14.071 [2024-11-26 04:41:53.232364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.071 [2024-11-26 04:41:53.232479] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.071 [2024-11-26 04:41:53.232503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.071 [2024-11-26 04:41:53.232516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.071 [2024-11-26 04:41:53.232529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.071 [2024-11-26 04:41:53.232556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.071 qpair failed and we were unable to recover it. 00:30:14.071 [2024-11-26 04:41:53.242359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.071 [2024-11-26 04:41:53.242473] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.071 [2024-11-26 04:41:53.242498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.071 [2024-11-26 04:41:53.242512] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.071 [2024-11-26 04:41:53.242524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.071 [2024-11-26 04:41:53.242552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.071 qpair failed and we were unable to recover it. 00:30:14.071 [2024-11-26 04:41:53.252366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.071 [2024-11-26 04:41:53.252463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.071 [2024-11-26 04:41:53.252488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.071 [2024-11-26 04:41:53.252502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.071 [2024-11-26 04:41:53.252514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.071 [2024-11-26 04:41:53.252541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.071 qpair failed and we were unable to recover it. 00:30:14.071 [2024-11-26 04:41:53.262429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.071 [2024-11-26 04:41:53.262574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.071 [2024-11-26 04:41:53.262599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.071 [2024-11-26 04:41:53.262613] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.071 [2024-11-26 04:41:53.262625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.071 [2024-11-26 04:41:53.262653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.071 qpair failed and we were unable to recover it. 00:30:14.071 [2024-11-26 04:41:53.272420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.071 [2024-11-26 04:41:53.272516] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.071 [2024-11-26 04:41:53.272541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.071 [2024-11-26 04:41:53.272555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.071 [2024-11-26 04:41:53.272567] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.071 [2024-11-26 04:41:53.272594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.071 qpair failed and we were unable to recover it. 00:30:14.071 [2024-11-26 04:41:53.282474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.071 [2024-11-26 04:41:53.282572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.071 [2024-11-26 04:41:53.282596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.071 [2024-11-26 04:41:53.282620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.071 [2024-11-26 04:41:53.282633] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.071 [2024-11-26 04:41:53.282660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.071 qpair failed and we were unable to recover it. 00:30:14.331 [2024-11-26 04:41:53.292496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.331 [2024-11-26 04:41:53.292597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.331 [2024-11-26 04:41:53.292623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.331 [2024-11-26 04:41:53.292638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.331 [2024-11-26 04:41:53.292650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.331 [2024-11-26 04:41:53.292677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.331 qpair failed and we were unable to recover it. 00:30:14.331 [2024-11-26 04:41:53.302546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.331 [2024-11-26 04:41:53.302655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.331 [2024-11-26 04:41:53.302680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.331 [2024-11-26 04:41:53.302702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.331 [2024-11-26 04:41:53.302716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.331 [2024-11-26 04:41:53.302743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.331 qpair failed and we were unable to recover it. 00:30:14.331 [2024-11-26 04:41:53.312557] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.331 [2024-11-26 04:41:53.312655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.331 [2024-11-26 04:41:53.312681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.331 [2024-11-26 04:41:53.312703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.331 [2024-11-26 04:41:53.312716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.331 [2024-11-26 04:41:53.312744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.331 qpair failed and we were unable to recover it. 00:30:14.331 [2024-11-26 04:41:53.322595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.331 [2024-11-26 04:41:53.322698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.331 [2024-11-26 04:41:53.322723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.331 [2024-11-26 04:41:53.322737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.331 [2024-11-26 04:41:53.322750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.331 [2024-11-26 04:41:53.322777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.331 qpair failed and we were unable to recover it. 00:30:14.331 [2024-11-26 04:41:53.332620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.331 [2024-11-26 04:41:53.332719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.331 [2024-11-26 04:41:53.332745] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.331 [2024-11-26 04:41:53.332759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.331 [2024-11-26 04:41:53.332771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.331 [2024-11-26 04:41:53.332799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.331 qpair failed and we were unable to recover it. 00:30:14.331 [2024-11-26 04:41:53.342655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.331 [2024-11-26 04:41:53.342783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.331 [2024-11-26 04:41:53.342808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.331 [2024-11-26 04:41:53.342822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.331 [2024-11-26 04:41:53.342835] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.331 [2024-11-26 04:41:53.342862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.331 qpair failed and we were unable to recover it. 00:30:14.331 [2024-11-26 04:41:53.352719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.331 [2024-11-26 04:41:53.352818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.331 [2024-11-26 04:41:53.352843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.331 [2024-11-26 04:41:53.352856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.331 [2024-11-26 04:41:53.352870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.331 [2024-11-26 04:41:53.352899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.331 qpair failed and we were unable to recover it. 00:30:14.331 [2024-11-26 04:41:53.362749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.331 [2024-11-26 04:41:53.362850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.331 [2024-11-26 04:41:53.362875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.331 [2024-11-26 04:41:53.362889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.331 [2024-11-26 04:41:53.362901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.331 [2024-11-26 04:41:53.362929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.331 qpair failed and we were unable to recover it. 00:30:14.331 [2024-11-26 04:41:53.372847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.331 [2024-11-26 04:41:53.372942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.331 [2024-11-26 04:41:53.372968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.331 [2024-11-26 04:41:53.372988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.331 [2024-11-26 04:41:53.373001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.331 [2024-11-26 04:41:53.373029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.331 qpair failed and we were unable to recover it. 00:30:14.331 [2024-11-26 04:41:53.382789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.331 [2024-11-26 04:41:53.382892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.331 [2024-11-26 04:41:53.382917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.331 [2024-11-26 04:41:53.382931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.331 [2024-11-26 04:41:53.382943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.331 [2024-11-26 04:41:53.382971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.331 qpair failed and we were unable to recover it. 00:30:14.331 [2024-11-26 04:41:53.392858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.331 [2024-11-26 04:41:53.393005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.331 [2024-11-26 04:41:53.393030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.331 [2024-11-26 04:41:53.393044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.331 [2024-11-26 04:41:53.393056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.331 [2024-11-26 04:41:53.393085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.331 qpair failed and we were unable to recover it. 00:30:14.331 [2024-11-26 04:41:53.402840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.331 [2024-11-26 04:41:53.402942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.331 [2024-11-26 04:41:53.402967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.331 [2024-11-26 04:41:53.402981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.331 [2024-11-26 04:41:53.402992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.331 [2024-11-26 04:41:53.403020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.412926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.413018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.413042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.413056] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.413068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.413096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.423004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.423105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.423130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.423144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.423156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.423185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.432997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.433124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.433150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.433164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.433177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.433205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.443017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.443163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.443188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.443202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.443215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.443242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.452999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.453095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.453121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.453135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.453147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.453175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.463104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.463208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.463232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.463252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.463265] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.463293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.473084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.473183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.473208] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.473222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.473234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.473261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.483070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.483201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.483226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.483239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.483251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.483278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.493083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.493188] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.493213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.493226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.493239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.493267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.503116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.503219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.503244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.503258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.503271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.503298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.513182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.513306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.513331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.513344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.513357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.513384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.523197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.523331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.523356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.523370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.523381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.523409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.533245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.533349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.332 [2024-11-26 04:41:53.533377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.332 [2024-11-26 04:41:53.533391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.332 [2024-11-26 04:41:53.533404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.332 [2024-11-26 04:41:53.533432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.332 qpair failed and we were unable to recover it. 00:30:14.332 [2024-11-26 04:41:53.543333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.332 [2024-11-26 04:41:53.543461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.333 [2024-11-26 04:41:53.543486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.333 [2024-11-26 04:41:53.543499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.333 [2024-11-26 04:41:53.543512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.333 [2024-11-26 04:41:53.543540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.333 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.553254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.592 [2024-11-26 04:41:53.553354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.592 [2024-11-26 04:41:53.553379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.592 [2024-11-26 04:41:53.553399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.592 [2024-11-26 04:41:53.553412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.592 [2024-11-26 04:41:53.553439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.592 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.563315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.592 [2024-11-26 04:41:53.563434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.592 [2024-11-26 04:41:53.563459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.592 [2024-11-26 04:41:53.563473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.592 [2024-11-26 04:41:53.563485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.592 [2024-11-26 04:41:53.563512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.592 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.573407] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.592 [2024-11-26 04:41:53.573510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.592 [2024-11-26 04:41:53.573534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.592 [2024-11-26 04:41:53.573549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.592 [2024-11-26 04:41:53.573561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.592 [2024-11-26 04:41:53.573588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.592 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.583366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.592 [2024-11-26 04:41:53.583469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.592 [2024-11-26 04:41:53.583493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.592 [2024-11-26 04:41:53.583507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.592 [2024-11-26 04:41:53.583520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.592 [2024-11-26 04:41:53.583547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.592 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.593368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.592 [2024-11-26 04:41:53.593507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.592 [2024-11-26 04:41:53.593531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.592 [2024-11-26 04:41:53.593544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.592 [2024-11-26 04:41:53.593557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.592 [2024-11-26 04:41:53.593585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.592 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.603433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.592 [2024-11-26 04:41:53.603541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.592 [2024-11-26 04:41:53.603566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.592 [2024-11-26 04:41:53.603580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.592 [2024-11-26 04:41:53.603592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.592 [2024-11-26 04:41:53.603621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.592 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.613443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.592 [2024-11-26 04:41:53.613541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.592 [2024-11-26 04:41:53.613570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.592 [2024-11-26 04:41:53.613585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.592 [2024-11-26 04:41:53.613598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.592 [2024-11-26 04:41:53.613627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.592 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.623521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.592 [2024-11-26 04:41:53.623672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.592 [2024-11-26 04:41:53.623708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.592 [2024-11-26 04:41:53.623724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.592 [2024-11-26 04:41:53.623736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.592 [2024-11-26 04:41:53.623764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.592 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.633489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.592 [2024-11-26 04:41:53.633590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.592 [2024-11-26 04:41:53.633615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.592 [2024-11-26 04:41:53.633628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.592 [2024-11-26 04:41:53.633641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.592 [2024-11-26 04:41:53.633670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.592 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.643526] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.592 [2024-11-26 04:41:53.643629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.592 [2024-11-26 04:41:53.643660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.592 [2024-11-26 04:41:53.643675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.592 [2024-11-26 04:41:53.643697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.592 [2024-11-26 04:41:53.643727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.592 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.653535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.592 [2024-11-26 04:41:53.653634] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.592 [2024-11-26 04:41:53.653663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.592 [2024-11-26 04:41:53.653676] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.592 [2024-11-26 04:41:53.653698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.592 [2024-11-26 04:41:53.653731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.592 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.663682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.592 [2024-11-26 04:41:53.663789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.592 [2024-11-26 04:41:53.663814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.592 [2024-11-26 04:41:53.663828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.592 [2024-11-26 04:41:53.663840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.592 [2024-11-26 04:41:53.663867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.592 qpair failed and we were unable to recover it. 00:30:14.592 [2024-11-26 04:41:53.673719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.673820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.673844] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.673858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.673870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.673898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.683642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.683760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.683787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.683801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.683817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.683848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.693681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.693793] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.693818] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.693831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.693844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.693871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.703799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.703907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.703932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.703945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.703958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.703986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.713795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.713905] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.713930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.713944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.713956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.713983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.723816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.723916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.723941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.723956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.723968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.723995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.733778] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.733873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.733903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.733917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.733930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.733957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.743853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.743984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.744009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.744023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.744035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.744064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.753895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.754005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.754030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.754044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.754057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.754085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.763907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.764004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.764028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.764042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.764054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.764081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.773905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.773998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.774024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.774037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.774050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.774077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.783955] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.784061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.784086] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.784100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.784113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.784140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.793969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.794076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.794101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.593 [2024-11-26 04:41:53.794115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.593 [2024-11-26 04:41:53.794129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.593 [2024-11-26 04:41:53.794158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.593 qpair failed and we were unable to recover it. 00:30:14.593 [2024-11-26 04:41:53.803988] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.593 [2024-11-26 04:41:53.804086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.593 [2024-11-26 04:41:53.804111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.594 [2024-11-26 04:41:53.804124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.594 [2024-11-26 04:41:53.804137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.594 [2024-11-26 04:41:53.804164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.594 qpair failed and we were unable to recover it. 00:30:14.855 [2024-11-26 04:41:53.814047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.855 [2024-11-26 04:41:53.814142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.855 [2024-11-26 04:41:53.814167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.855 [2024-11-26 04:41:53.814182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.855 [2024-11-26 04:41:53.814195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.855 [2024-11-26 04:41:53.814224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.855 qpair failed and we were unable to recover it. 00:30:14.855 [2024-11-26 04:41:53.824119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.855 [2024-11-26 04:41:53.824227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.855 [2024-11-26 04:41:53.824257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.855 [2024-11-26 04:41:53.824276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.855 [2024-11-26 04:41:53.824290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.855 [2024-11-26 04:41:53.824317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.855 qpair failed and we were unable to recover it. 00:30:14.855 [2024-11-26 04:41:53.834076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.855 [2024-11-26 04:41:53.834173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.855 [2024-11-26 04:41:53.834198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.855 [2024-11-26 04:41:53.834212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.855 [2024-11-26 04:41:53.834224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.855 [2024-11-26 04:41:53.834251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.855 qpair failed and we were unable to recover it. 00:30:14.855 [2024-11-26 04:41:53.844147] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.855 [2024-11-26 04:41:53.844247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.855 [2024-11-26 04:41:53.844273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.855 [2024-11-26 04:41:53.844287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.855 [2024-11-26 04:41:53.844299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.855 [2024-11-26 04:41:53.844327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.855 qpair failed and we were unable to recover it. 00:30:14.855 [2024-11-26 04:41:53.854212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.855 [2024-11-26 04:41:53.854338] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.855 [2024-11-26 04:41:53.854362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.855 [2024-11-26 04:41:53.854376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.855 [2024-11-26 04:41:53.854388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.855 [2024-11-26 04:41:53.854415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.855 qpair failed and we were unable to recover it. 00:30:14.855 [2024-11-26 04:41:53.864177] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.855 [2024-11-26 04:41:53.864279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.855 [2024-11-26 04:41:53.864304] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.855 [2024-11-26 04:41:53.864318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.855 [2024-11-26 04:41:53.864330] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.855 [2024-11-26 04:41:53.864363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.855 qpair failed and we were unable to recover it. 00:30:14.855 [2024-11-26 04:41:53.874217] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.855 [2024-11-26 04:41:53.874320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.855 [2024-11-26 04:41:53.874345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.855 [2024-11-26 04:41:53.874359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.855 [2024-11-26 04:41:53.874371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.855 [2024-11-26 04:41:53.874398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.855 qpair failed and we were unable to recover it. 00:30:14.855 [2024-11-26 04:41:53.884254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.855 [2024-11-26 04:41:53.884400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.855 [2024-11-26 04:41:53.884428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.855 [2024-11-26 04:41:53.884442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.855 [2024-11-26 04:41:53.884454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.855 [2024-11-26 04:41:53.884482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.855 qpair failed and we were unable to recover it. 00:30:14.855 [2024-11-26 04:41:53.894337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.855 [2024-11-26 04:41:53.894435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.855 [2024-11-26 04:41:53.894461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.855 [2024-11-26 04:41:53.894475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.855 [2024-11-26 04:41:53.894487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.855 [2024-11-26 04:41:53.894516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.855 qpair failed and we were unable to recover it. 00:30:14.855 [2024-11-26 04:41:53.904338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.855 [2024-11-26 04:41:53.904457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.855 [2024-11-26 04:41:53.904482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.855 [2024-11-26 04:41:53.904496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.855 [2024-11-26 04:41:53.904508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.855 [2024-11-26 04:41:53.904536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.855 qpair failed and we were unable to recover it. 00:30:14.855 [2024-11-26 04:41:53.914403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.855 [2024-11-26 04:41:53.914503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.855 [2024-11-26 04:41:53.914533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.855 [2024-11-26 04:41:53.914547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.855 [2024-11-26 04:41:53.914560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:53.914588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:53.924359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:53.924487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:53.924513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:53.924526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:53.924539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:53.924566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:53.934406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:53.934501] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:53.934526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:53.934540] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:53.934552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:53.934580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:53.944410] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:53.944510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:53.944535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:53.944549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:53.944561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:53.944588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:53.954474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:53.954574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:53.954599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:53.954613] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:53.954626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:53.954663] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:53.964464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:53.964568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:53.964593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:53.964607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:53.964619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:53.964647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:53.974483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:53.974578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:53.974603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:53.974617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:53.974630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:53.974657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:53.984515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:53.984615] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:53.984640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:53.984654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:53.984667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:53.984701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:53.994590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:53.994716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:53.994742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:53.994759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:53.994771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:53.994799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:54.004600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:54.004728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:54.004765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:54.004783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:54.004796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:54.004824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:54.014639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:54.014742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:54.014769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:54.014790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:54.014802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:54.014830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:54.024666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:54.024789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:54.024815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:54.024830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:54.024843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:54.024872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:54.034650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:54.034764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:54.034790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:54.034814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:54.034826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:54.034855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:54.044718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.856 [2024-11-26 04:41:54.044828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.856 [2024-11-26 04:41:54.044854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.856 [2024-11-26 04:41:54.044877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.856 [2024-11-26 04:41:54.044890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.856 [2024-11-26 04:41:54.044924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.856 qpair failed and we were unable to recover it. 00:30:14.856 [2024-11-26 04:41:54.054723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.857 [2024-11-26 04:41:54.054822] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.857 [2024-11-26 04:41:54.054848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.857 [2024-11-26 04:41:54.054862] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.857 [2024-11-26 04:41:54.054875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.857 [2024-11-26 04:41:54.054904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.857 qpair failed and we were unable to recover it. 00:30:14.857 [2024-11-26 04:41:54.064777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.857 [2024-11-26 04:41:54.064932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.857 [2024-11-26 04:41:54.064959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.857 [2024-11-26 04:41:54.064974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.857 [2024-11-26 04:41:54.064986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.857 [2024-11-26 04:41:54.065028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.857 qpair failed and we were unable to recover it. 00:30:14.857 [2024-11-26 04:41:54.074788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.857 [2024-11-26 04:41:54.074900] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.857 [2024-11-26 04:41:54.074924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.857 [2024-11-26 04:41:54.074938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.857 [2024-11-26 04:41:54.074950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:14.857 [2024-11-26 04:41:54.074978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.857 qpair failed and we were unable to recover it. 00:30:15.118 [2024-11-26 04:41:54.084929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.118 [2024-11-26 04:41:54.085042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.118 [2024-11-26 04:41:54.085068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.118 [2024-11-26 04:41:54.085083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.118 [2024-11-26 04:41:54.085095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.118 [2024-11-26 04:41:54.085125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.118 qpair failed and we were unable to recover it. 00:30:15.118 [2024-11-26 04:41:54.094843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.118 [2024-11-26 04:41:54.094943] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.118 [2024-11-26 04:41:54.094976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.118 [2024-11-26 04:41:54.094991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.118 [2024-11-26 04:41:54.095005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.118 [2024-11-26 04:41:54.095034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.118 qpair failed and we were unable to recover it. 00:30:15.118 [2024-11-26 04:41:54.104923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.118 [2024-11-26 04:41:54.105036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.118 [2024-11-26 04:41:54.105061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.118 [2024-11-26 04:41:54.105076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.118 [2024-11-26 04:41:54.105089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.118 [2024-11-26 04:41:54.105132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.118 qpair failed and we were unable to recover it. 00:30:15.118 [2024-11-26 04:41:54.114888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.118 [2024-11-26 04:41:54.114991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.118 [2024-11-26 04:41:54.115017] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.118 [2024-11-26 04:41:54.115031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.118 [2024-11-26 04:41:54.115043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.118 [2024-11-26 04:41:54.115071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.118 qpair failed and we were unable to recover it. 00:30:15.118 [2024-11-26 04:41:54.124950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.118 [2024-11-26 04:41:54.125052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.118 [2024-11-26 04:41:54.125076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.118 [2024-11-26 04:41:54.125091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.118 [2024-11-26 04:41:54.125103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.118 [2024-11-26 04:41:54.125130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.118 qpair failed and we were unable to recover it. 00:30:15.118 [2024-11-26 04:41:54.134941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.118 [2024-11-26 04:41:54.135061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.118 [2024-11-26 04:41:54.135086] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.118 [2024-11-26 04:41:54.135100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.135113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.135147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.144986] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.145092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.145117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.145131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.145145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.145173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.154991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.155126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.155152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.155166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.155179] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.155208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.165061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.165186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.165213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.165228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.165241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.165268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.175144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.175279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.175305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.175320] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.175334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.175362] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.185142] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.185251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.185280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.185295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.185308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.185336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.195203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.195302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.195326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.195340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.195352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.195380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.205162] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.205264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.205288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.205303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.205315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.205344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.215252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.215348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.215372] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.215386] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.215400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.215428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.225210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.225312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.225336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.225350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.225363] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.225396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.235238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.235357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.235382] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.235396] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.235409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.235438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.245285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.245390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.245417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.245432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.245445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.245475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.255332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.255426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.255450] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.255464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.255476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.255505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.265356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.119 [2024-11-26 04:41:54.265459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.119 [2024-11-26 04:41:54.265483] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.119 [2024-11-26 04:41:54.265498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.119 [2024-11-26 04:41:54.265510] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.119 [2024-11-26 04:41:54.265537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.119 qpair failed and we were unable to recover it. 00:30:15.119 [2024-11-26 04:41:54.275368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.120 [2024-11-26 04:41:54.275510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.120 [2024-11-26 04:41:54.275541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.120 [2024-11-26 04:41:54.275556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.120 [2024-11-26 04:41:54.275569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.120 [2024-11-26 04:41:54.275598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.120 qpair failed and we were unable to recover it. 00:30:15.120 [2024-11-26 04:41:54.285402] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.120 [2024-11-26 04:41:54.285497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.120 [2024-11-26 04:41:54.285521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.120 [2024-11-26 04:41:54.285535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.120 [2024-11-26 04:41:54.285548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.120 [2024-11-26 04:41:54.285576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.120 qpair failed and we were unable to recover it. 00:30:15.120 [2024-11-26 04:41:54.295518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.120 [2024-11-26 04:41:54.295617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.120 [2024-11-26 04:41:54.295641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.120 [2024-11-26 04:41:54.295655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.120 [2024-11-26 04:41:54.295667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.120 [2024-11-26 04:41:54.295702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.120 qpair failed and we were unable to recover it. 00:30:15.120 [2024-11-26 04:41:54.305446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.120 [2024-11-26 04:41:54.305552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.120 [2024-11-26 04:41:54.305577] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.120 [2024-11-26 04:41:54.305591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.120 [2024-11-26 04:41:54.305604] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.120 [2024-11-26 04:41:54.305632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.120 qpair failed and we were unable to recover it. 00:30:15.120 [2024-11-26 04:41:54.315567] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.120 [2024-11-26 04:41:54.315673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.120 [2024-11-26 04:41:54.315704] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.120 [2024-11-26 04:41:54.315719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.120 [2024-11-26 04:41:54.315737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.120 [2024-11-26 04:41:54.315766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.120 qpair failed and we were unable to recover it. 00:30:15.120 [2024-11-26 04:41:54.325603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.120 [2024-11-26 04:41:54.325710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.120 [2024-11-26 04:41:54.325738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.120 [2024-11-26 04:41:54.325753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.120 [2024-11-26 04:41:54.325766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.120 [2024-11-26 04:41:54.325794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.120 qpair failed and we were unable to recover it. 00:30:15.120 [2024-11-26 04:41:54.335558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.120 [2024-11-26 04:41:54.335661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.120 [2024-11-26 04:41:54.335694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.120 [2024-11-26 04:41:54.335711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.120 [2024-11-26 04:41:54.335723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.120 [2024-11-26 04:41:54.335753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.120 qpair failed and we were unable to recover it. 00:30:15.381 [2024-11-26 04:41:54.345581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.381 [2024-11-26 04:41:54.345684] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.381 [2024-11-26 04:41:54.345718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.381 [2024-11-26 04:41:54.345733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.381 [2024-11-26 04:41:54.345745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.381 [2024-11-26 04:41:54.345774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.381 qpair failed and we were unable to recover it. 00:30:15.381 [2024-11-26 04:41:54.355597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.381 [2024-11-26 04:41:54.355705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.381 [2024-11-26 04:41:54.355730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.355744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.355757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.355785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.365630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.365740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.365770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.365785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.365797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.365826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.375651] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.375790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.375817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.375832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.375845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.375874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.385692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.385796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.385820] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.385835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.385847] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.385875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.395706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.395827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.395852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.395867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.395881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.395909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.405755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.405856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.405884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.405900] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.405919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.405950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.415769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.415879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.415904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.415918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.415931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.415960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.425902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.426008] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.426033] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.426046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.426060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.426089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.435868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.435994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.436021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.436035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.436049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.436077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.445863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.445960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.445987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.446002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.446015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.446043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.455911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.456027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.456054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.456070] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.456083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.456111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.465916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.466020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.466044] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.466058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.466071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.466098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.475958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.476062] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.476086] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.382 [2024-11-26 04:41:54.476100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.382 [2024-11-26 04:41:54.476113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.382 [2024-11-26 04:41:54.476142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.382 qpair failed and we were unable to recover it. 00:30:15.382 [2024-11-26 04:41:54.485963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.382 [2024-11-26 04:41:54.486073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.382 [2024-11-26 04:41:54.486098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.383 [2024-11-26 04:41:54.486112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.383 [2024-11-26 04:41:54.486126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.383 [2024-11-26 04:41:54.486154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.383 qpair failed and we were unable to recover it. 00:30:15.383 [2024-11-26 04:41:54.495985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.383 [2024-11-26 04:41:54.496080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.383 [2024-11-26 04:41:54.496105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.383 [2024-11-26 04:41:54.496119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.383 [2024-11-26 04:41:54.496139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.383 [2024-11-26 04:41:54.496168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.383 qpair failed and we were unable to recover it. 00:30:15.383 [2024-11-26 04:41:54.506042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.383 [2024-11-26 04:41:54.506169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.383 [2024-11-26 04:41:54.506194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.383 [2024-11-26 04:41:54.506208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.383 [2024-11-26 04:41:54.506222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.383 [2024-11-26 04:41:54.506250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.383 qpair failed and we were unable to recover it. 00:30:15.383 [2024-11-26 04:41:54.516044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.383 [2024-11-26 04:41:54.516140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.383 [2024-11-26 04:41:54.516165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.383 [2024-11-26 04:41:54.516179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.383 [2024-11-26 04:41:54.516192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.383 [2024-11-26 04:41:54.516220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.383 qpair failed and we were unable to recover it. 00:30:15.383 [2024-11-26 04:41:54.526052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.383 [2024-11-26 04:41:54.526154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.383 [2024-11-26 04:41:54.526178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.383 [2024-11-26 04:41:54.526192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.383 [2024-11-26 04:41:54.526207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.383 [2024-11-26 04:41:54.526235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.383 qpair failed and we were unable to recover it. 00:30:15.383 [2024-11-26 04:41:54.536082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.383 [2024-11-26 04:41:54.536182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.383 [2024-11-26 04:41:54.536206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.383 [2024-11-26 04:41:54.536220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.383 [2024-11-26 04:41:54.536234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.383 [2024-11-26 04:41:54.536261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.383 qpair failed and we were unable to recover it. 00:30:15.383 [2024-11-26 04:41:54.546168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.383 [2024-11-26 04:41:54.546273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.383 [2024-11-26 04:41:54.546297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.383 [2024-11-26 04:41:54.546311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.383 [2024-11-26 04:41:54.546324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.383 [2024-11-26 04:41:54.546351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.383 qpair failed and we were unable to recover it. 00:30:15.383 [2024-11-26 04:41:54.556154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.383 [2024-11-26 04:41:54.556255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.383 [2024-11-26 04:41:54.556280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.383 [2024-11-26 04:41:54.556294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.383 [2024-11-26 04:41:54.556308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.383 [2024-11-26 04:41:54.556336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.383 qpair failed and we were unable to recover it. 00:30:15.383 [2024-11-26 04:41:54.566199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.383 [2024-11-26 04:41:54.566295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.383 [2024-11-26 04:41:54.566320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.383 [2024-11-26 04:41:54.566335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.383 [2024-11-26 04:41:54.566348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.383 [2024-11-26 04:41:54.566376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.383 qpair failed and we were unable to recover it. 00:30:15.383 [2024-11-26 04:41:54.576232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.383 [2024-11-26 04:41:54.576341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.383 [2024-11-26 04:41:54.576365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.383 [2024-11-26 04:41:54.576379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.383 [2024-11-26 04:41:54.576392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.383 [2024-11-26 04:41:54.576420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.383 qpair failed and we were unable to recover it. 00:30:15.383 [2024-11-26 04:41:54.586355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.383 [2024-11-26 04:41:54.586469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.383 [2024-11-26 04:41:54.586496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.383 [2024-11-26 04:41:54.586510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.383 [2024-11-26 04:41:54.586529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.383 [2024-11-26 04:41:54.586560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.383 qpair failed and we were unable to recover it. 00:30:15.383 [2024-11-26 04:41:54.596283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.383 [2024-11-26 04:41:54.596389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.383 [2024-11-26 04:41:54.596417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.383 [2024-11-26 04:41:54.596432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.383 [2024-11-26 04:41:54.596445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.383 [2024-11-26 04:41:54.596474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.383 qpair failed and we were unable to recover it. 00:30:15.644 [2024-11-26 04:41:54.606316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.644 [2024-11-26 04:41:54.606418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.644 [2024-11-26 04:41:54.606444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.644 [2024-11-26 04:41:54.606458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.644 [2024-11-26 04:41:54.606471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.644 [2024-11-26 04:41:54.606500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.644 qpair failed and we were unable to recover it. 00:30:15.644 [2024-11-26 04:41:54.616338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.644 [2024-11-26 04:41:54.616434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.644 [2024-11-26 04:41:54.616459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.644 [2024-11-26 04:41:54.616473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.644 [2024-11-26 04:41:54.616485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.644 [2024-11-26 04:41:54.616513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.644 qpair failed and we were unable to recover it. 00:30:15.644 [2024-11-26 04:41:54.626385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.644 [2024-11-26 04:41:54.626505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.644 [2024-11-26 04:41:54.626529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.644 [2024-11-26 04:41:54.626544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.644 [2024-11-26 04:41:54.626556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.644 [2024-11-26 04:41:54.626585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.644 qpair failed and we were unable to recover it. 00:30:15.644 [2024-11-26 04:41:54.636481] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.644 [2024-11-26 04:41:54.636613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.644 [2024-11-26 04:41:54.636637] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.644 [2024-11-26 04:41:54.636651] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.644 [2024-11-26 04:41:54.636665] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.644 [2024-11-26 04:41:54.636700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.644 qpair failed and we were unable to recover it. 00:30:15.644 [2024-11-26 04:41:54.646427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.644 [2024-11-26 04:41:54.646526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.644 [2024-11-26 04:41:54.646551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.644 [2024-11-26 04:41:54.646564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.644 [2024-11-26 04:41:54.646578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.644 [2024-11-26 04:41:54.646607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.644 qpair failed and we were unable to recover it. 00:30:15.644 [2024-11-26 04:41:54.656569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.644 [2024-11-26 04:41:54.656711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.656738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.656753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.656771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.656802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.666498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.666652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.666680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.666707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.666721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.666750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.676511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.676613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.676638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.676652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.676672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.676708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.686529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.686636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.686660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.686675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.686697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.686728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.696669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.696772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.696798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.696812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.696825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.696854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.706648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.706761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.706785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.706799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.706812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.706841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.716640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.716748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.716773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.716787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.716800] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.716827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.726677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.726803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.726831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.726847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.726863] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.726896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.736681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.736789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.736815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.736829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.736843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.736871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.746783] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.746886] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.746912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.746927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.746940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.746968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.756744] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.756857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.756883] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.756898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.756910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.756939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.766849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.766949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.766975] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.766995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.767016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.767044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.776931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.777050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.777076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.645 [2024-11-26 04:41:54.777090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.645 [2024-11-26 04:41:54.777103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.645 [2024-11-26 04:41:54.777131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.645 qpair failed and we were unable to recover it. 00:30:15.645 [2024-11-26 04:41:54.786932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.645 [2024-11-26 04:41:54.787079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.645 [2024-11-26 04:41:54.787106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.646 [2024-11-26 04:41:54.787121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.646 [2024-11-26 04:41:54.787133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.646 [2024-11-26 04:41:54.787161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.646 qpair failed and we were unable to recover it. 00:30:15.646 [2024-11-26 04:41:54.796841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.646 [2024-11-26 04:41:54.796945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.646 [2024-11-26 04:41:54.796970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.646 [2024-11-26 04:41:54.796983] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.646 [2024-11-26 04:41:54.796996] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.646 [2024-11-26 04:41:54.797023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.646 qpair failed and we were unable to recover it. 00:30:15.646 [2024-11-26 04:41:54.806920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.646 [2024-11-26 04:41:54.807020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.646 [2024-11-26 04:41:54.807046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.646 [2024-11-26 04:41:54.807060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.646 [2024-11-26 04:41:54.807073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.646 [2024-11-26 04:41:54.807100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.646 qpair failed and we were unable to recover it. 00:30:15.646 [2024-11-26 04:41:54.816919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.646 [2024-11-26 04:41:54.817020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.646 [2024-11-26 04:41:54.817046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.646 [2024-11-26 04:41:54.817060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.646 [2024-11-26 04:41:54.817074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.646 [2024-11-26 04:41:54.817104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.646 qpair failed and we were unable to recover it. 00:30:15.646 [2024-11-26 04:41:54.826969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.646 [2024-11-26 04:41:54.827113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.646 [2024-11-26 04:41:54.827139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.646 [2024-11-26 04:41:54.827152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.646 [2024-11-26 04:41:54.827165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.646 [2024-11-26 04:41:54.827201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.646 qpair failed and we were unable to recover it. 00:30:15.646 [2024-11-26 04:41:54.836982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.646 [2024-11-26 04:41:54.837084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.646 [2024-11-26 04:41:54.837109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.646 [2024-11-26 04:41:54.837122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.646 [2024-11-26 04:41:54.837136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.646 [2024-11-26 04:41:54.837163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.646 qpair failed and we were unable to recover it. 00:30:15.646 [2024-11-26 04:41:54.846997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.646 [2024-11-26 04:41:54.847087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.646 [2024-11-26 04:41:54.847112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.646 [2024-11-26 04:41:54.847126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.646 [2024-11-26 04:41:54.847139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.646 [2024-11-26 04:41:54.847166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.646 qpair failed and we were unable to recover it. 00:30:15.646 [2024-11-26 04:41:54.857040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.646 [2024-11-26 04:41:54.857138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.646 [2024-11-26 04:41:54.857163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.646 [2024-11-26 04:41:54.857182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.646 [2024-11-26 04:41:54.857195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.646 [2024-11-26 04:41:54.857223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.646 qpair failed and we were unable to recover it. 00:30:15.906 [2024-11-26 04:41:54.867067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.906 [2024-11-26 04:41:54.867172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.906 [2024-11-26 04:41:54.867197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.906 [2024-11-26 04:41:54.867219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.906 [2024-11-26 04:41:54.867232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.906 [2024-11-26 04:41:54.867260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.906 qpair failed and we were unable to recover it. 00:30:15.906 [2024-11-26 04:41:54.877187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.906 [2024-11-26 04:41:54.877291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.906 [2024-11-26 04:41:54.877315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.906 [2024-11-26 04:41:54.877332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.906 [2024-11-26 04:41:54.877346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.906 [2024-11-26 04:41:54.877373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.906 qpair failed and we were unable to recover it. 00:30:15.906 [2024-11-26 04:41:54.887131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.906 [2024-11-26 04:41:54.887252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.906 [2024-11-26 04:41:54.887277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.906 [2024-11-26 04:41:54.887291] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.906 [2024-11-26 04:41:54.887303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.906 [2024-11-26 04:41:54.887331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.906 qpair failed and we were unable to recover it. 00:30:15.906 [2024-11-26 04:41:54.897161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.906 [2024-11-26 04:41:54.897295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.906 [2024-11-26 04:41:54.897321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.906 [2024-11-26 04:41:54.897335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.906 [2024-11-26 04:41:54.897349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.906 [2024-11-26 04:41:54.897376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.906 qpair failed and we were unable to recover it. 00:30:15.906 [2024-11-26 04:41:54.907215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.906 [2024-11-26 04:41:54.907319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.906 [2024-11-26 04:41:54.907344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.906 [2024-11-26 04:41:54.907358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.906 [2024-11-26 04:41:54.907370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.906 [2024-11-26 04:41:54.907398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.906 qpair failed and we were unable to recover it. 00:30:15.906 [2024-11-26 04:41:54.917242] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.906 [2024-11-26 04:41:54.917341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.906 [2024-11-26 04:41:54.917366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.906 [2024-11-26 04:41:54.917379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.906 [2024-11-26 04:41:54.917392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.906 [2024-11-26 04:41:54.917419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.906 qpair failed and we were unable to recover it. 00:30:15.906 [2024-11-26 04:41:54.927221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.906 [2024-11-26 04:41:54.927318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.906 [2024-11-26 04:41:54.927343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.906 [2024-11-26 04:41:54.927357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.906 [2024-11-26 04:41:54.927371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.906 [2024-11-26 04:41:54.927398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.906 qpair failed and we were unable to recover it. 00:30:15.906 [2024-11-26 04:41:54.937253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.906 [2024-11-26 04:41:54.937344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.906 [2024-11-26 04:41:54.937369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.906 [2024-11-26 04:41:54.937382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.906 [2024-11-26 04:41:54.937394] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.906 [2024-11-26 04:41:54.937422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.906 qpair failed and we were unable to recover it. 00:30:15.906 [2024-11-26 04:41:54.947289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.906 [2024-11-26 04:41:54.947432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.906 [2024-11-26 04:41:54.947458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.906 [2024-11-26 04:41:54.947478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.906 [2024-11-26 04:41:54.947492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:54.947519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:54.957305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:54.957402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:54.957426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.907 [2024-11-26 04:41:54.957439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.907 [2024-11-26 04:41:54.957452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:54.957479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:54.967341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:54.967453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:54.967481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.907 [2024-11-26 04:41:54.967496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.907 [2024-11-26 04:41:54.967508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:54.967536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:54.977400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:54.977517] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:54.977543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.907 [2024-11-26 04:41:54.977557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.907 [2024-11-26 04:41:54.977569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:54.977597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:54.987424] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:54.987525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:54.987550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.907 [2024-11-26 04:41:54.987563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.907 [2024-11-26 04:41:54.987577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:54.987604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:54.997467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:54.997587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:54.997612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.907 [2024-11-26 04:41:54.997626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.907 [2024-11-26 04:41:54.997638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:54.997666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:55.007546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:55.007643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:55.007669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.907 [2024-11-26 04:41:55.007682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.907 [2024-11-26 04:41:55.007703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:55.007730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:55.017517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:55.017632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:55.017657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.907 [2024-11-26 04:41:55.017671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.907 [2024-11-26 04:41:55.017683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:55.017724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:55.027564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:55.027724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:55.027751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.907 [2024-11-26 04:41:55.027765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.907 [2024-11-26 04:41:55.027777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:55.027804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:55.037556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:55.037653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:55.037678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.907 [2024-11-26 04:41:55.037710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.907 [2024-11-26 04:41:55.037724] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:55.037754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:55.047607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:55.047721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:55.047746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.907 [2024-11-26 04:41:55.047760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.907 [2024-11-26 04:41:55.047772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:55.047802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:55.057666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:55.057784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:55.057809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.907 [2024-11-26 04:41:55.057823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.907 [2024-11-26 04:41:55.057837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:55.057864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:55.067666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:55.067791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:55.067817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.907 [2024-11-26 04:41:55.067831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.907 [2024-11-26 04:41:55.067843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.907 [2024-11-26 04:41:55.067872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.907 qpair failed and we were unable to recover it. 00:30:15.907 [2024-11-26 04:41:55.077660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.907 [2024-11-26 04:41:55.077798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.907 [2024-11-26 04:41:55.077824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.908 [2024-11-26 04:41:55.077838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.908 [2024-11-26 04:41:55.077850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.908 [2024-11-26 04:41:55.077877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.908 qpair failed and we were unable to recover it. 00:30:15.908 [2024-11-26 04:41:55.087735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.908 [2024-11-26 04:41:55.087838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.908 [2024-11-26 04:41:55.087862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.908 [2024-11-26 04:41:55.087876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.908 [2024-11-26 04:41:55.087888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.908 [2024-11-26 04:41:55.087917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.908 qpair failed and we were unable to recover it. 00:30:15.908 [2024-11-26 04:41:55.097742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.908 [2024-11-26 04:41:55.097850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.908 [2024-11-26 04:41:55.097876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.908 [2024-11-26 04:41:55.097889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.908 [2024-11-26 04:41:55.097902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.908 [2024-11-26 04:41:55.097929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.908 qpair failed and we were unable to recover it. 00:30:15.908 [2024-11-26 04:41:55.107831] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.908 [2024-11-26 04:41:55.107945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.908 [2024-11-26 04:41:55.107979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.908 [2024-11-26 04:41:55.107994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.908 [2024-11-26 04:41:55.108005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.908 [2024-11-26 04:41:55.108033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.908 qpair failed and we were unable to recover it. 00:30:15.908 [2024-11-26 04:41:55.117807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.908 [2024-11-26 04:41:55.117937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.908 [2024-11-26 04:41:55.117963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.908 [2024-11-26 04:41:55.117978] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.908 [2024-11-26 04:41:55.117990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:15.908 [2024-11-26 04:41:55.118018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.908 qpair failed and we were unable to recover it. 00:30:16.167 [2024-11-26 04:41:55.127879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.167 [2024-11-26 04:41:55.127986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.167 [2024-11-26 04:41:55.128011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.167 [2024-11-26 04:41:55.128031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.167 [2024-11-26 04:41:55.128045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.167 [2024-11-26 04:41:55.128072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.167 qpair failed and we were unable to recover it. 00:30:16.167 [2024-11-26 04:41:55.137839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.167 [2024-11-26 04:41:55.137940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.167 [2024-11-26 04:41:55.137965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.167 [2024-11-26 04:41:55.137979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.167 [2024-11-26 04:41:55.137991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.167 [2024-11-26 04:41:55.138021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.167 qpair failed and we were unable to recover it. 00:30:16.167 [2024-11-26 04:41:55.147888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.167 [2024-11-26 04:41:55.147991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.167 [2024-11-26 04:41:55.148016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.167 [2024-11-26 04:41:55.148030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.167 [2024-11-26 04:41:55.148042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.167 [2024-11-26 04:41:55.148069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.167 qpair failed and we were unable to recover it. 00:30:16.167 [2024-11-26 04:41:55.157942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.167 [2024-11-26 04:41:55.158045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.167 [2024-11-26 04:41:55.158070] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.167 [2024-11-26 04:41:55.158084] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.167 [2024-11-26 04:41:55.158096] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.167 [2024-11-26 04:41:55.158123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.167 qpair failed and we were unable to recover it. 00:30:16.167 [2024-11-26 04:41:55.167959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.167 [2024-11-26 04:41:55.168059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.167 [2024-11-26 04:41:55.168083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.167 [2024-11-26 04:41:55.168096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.167 [2024-11-26 04:41:55.168107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.167 [2024-11-26 04:41:55.168134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.167 qpair failed and we were unable to recover it. 00:30:16.167 [2024-11-26 04:41:55.177964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.167 [2024-11-26 04:41:55.178064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.167 [2024-11-26 04:41:55.178089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.167 [2024-11-26 04:41:55.178103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.167 [2024-11-26 04:41:55.178114] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.167 [2024-11-26 04:41:55.178142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.167 qpair failed and we were unable to recover it. 00:30:16.167 [2024-11-26 04:41:55.188012] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.167 [2024-11-26 04:41:55.188120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.167 [2024-11-26 04:41:55.188144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.167 [2024-11-26 04:41:55.188158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.167 [2024-11-26 04:41:55.188170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.167 [2024-11-26 04:41:55.188197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.167 qpair failed and we were unable to recover it. 00:30:16.167 [2024-11-26 04:41:55.198082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.167 [2024-11-26 04:41:55.198200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.167 [2024-11-26 04:41:55.198225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.167 [2024-11-26 04:41:55.198238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.167 [2024-11-26 04:41:55.198252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.167 [2024-11-26 04:41:55.198279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.167 qpair failed and we were unable to recover it. 00:30:16.167 [2024-11-26 04:41:55.208060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.208159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.208184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.208198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.208210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.208238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.218100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.218199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.218224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.218243] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.218257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.218284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.228147] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.228241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.228266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.228279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.228292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.228318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.238181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.238297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.238322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.238336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.238349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.238376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.248205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.248305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.248333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.248347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.248360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.248388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.258245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.258373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.258398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.258411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.258423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.258450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.268313] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.268413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.268438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.268452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.268464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.268492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.278276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.278387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.278412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.278425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.278438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.278465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.288365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.288464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.288490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.288503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.288515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.288545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.298319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.298461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.298487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.298500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.298513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.298540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.308378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.308481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.308511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.308526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.308539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.308566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.318419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.318528] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.318553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.318566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.318579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.318606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.328425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.168 [2024-11-26 04:41:55.328519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.168 [2024-11-26 04:41:55.328545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.168 [2024-11-26 04:41:55.328560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.168 [2024-11-26 04:41:55.328573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.168 [2024-11-26 04:41:55.328600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.168 qpair failed and we were unable to recover it. 00:30:16.168 [2024-11-26 04:41:55.338446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.169 [2024-11-26 04:41:55.338542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.169 [2024-11-26 04:41:55.338570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.169 [2024-11-26 04:41:55.338585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.169 [2024-11-26 04:41:55.338599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.169 [2024-11-26 04:41:55.338626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.169 qpair failed and we were unable to recover it. 00:30:16.169 [2024-11-26 04:41:55.348483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.169 [2024-11-26 04:41:55.348581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.169 [2024-11-26 04:41:55.348606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.169 [2024-11-26 04:41:55.348620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.169 [2024-11-26 04:41:55.348632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.169 [2024-11-26 04:41:55.348659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.169 qpair failed and we were unable to recover it. 00:30:16.169 [2024-11-26 04:41:55.358489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.169 [2024-11-26 04:41:55.358593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.169 [2024-11-26 04:41:55.358618] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.169 [2024-11-26 04:41:55.358632] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.169 [2024-11-26 04:41:55.358644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.169 [2024-11-26 04:41:55.358673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.169 qpair failed and we were unable to recover it. 00:30:16.169 [2024-11-26 04:41:55.368605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.169 [2024-11-26 04:41:55.368705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.169 [2024-11-26 04:41:55.368730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.169 [2024-11-26 04:41:55.368744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.169 [2024-11-26 04:41:55.368756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.169 [2024-11-26 04:41:55.368785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.169 qpair failed and we were unable to recover it. 00:30:16.169 [2024-11-26 04:41:55.378566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.169 [2024-11-26 04:41:55.378669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.169 [2024-11-26 04:41:55.378706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.169 [2024-11-26 04:41:55.378721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.169 [2024-11-26 04:41:55.378734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.169 [2024-11-26 04:41:55.378761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.169 qpair failed and we were unable to recover it. 00:30:16.427 [2024-11-26 04:41:55.388740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.427 [2024-11-26 04:41:55.388857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.427 [2024-11-26 04:41:55.388882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.427 [2024-11-26 04:41:55.388896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.427 [2024-11-26 04:41:55.388909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.427 [2024-11-26 04:41:55.388937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.427 qpair failed and we were unable to recover it. 00:30:16.427 [2024-11-26 04:41:55.398614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.427 [2024-11-26 04:41:55.398722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.427 [2024-11-26 04:41:55.398753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.427 [2024-11-26 04:41:55.398768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.427 [2024-11-26 04:41:55.398780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.428 [2024-11-26 04:41:55.398808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.428 qpair failed and we were unable to recover it. 00:30:16.428 [2024-11-26 04:41:55.408667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.428 [2024-11-26 04:41:55.408785] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.428 [2024-11-26 04:41:55.408811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.428 [2024-11-26 04:41:55.408825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.428 [2024-11-26 04:41:55.408837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.428 [2024-11-26 04:41:55.408864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.428 qpair failed and we were unable to recover it. 00:30:16.428 [2024-11-26 04:41:55.418760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.428 [2024-11-26 04:41:55.418859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.428 [2024-11-26 04:41:55.418884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.428 [2024-11-26 04:41:55.418898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.428 [2024-11-26 04:41:55.418910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.428 [2024-11-26 04:41:55.418938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.428 qpair failed and we were unable to recover it. 00:30:16.428 [2024-11-26 04:41:55.428733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.428 [2024-11-26 04:41:55.428844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.428 [2024-11-26 04:41:55.428868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.428 [2024-11-26 04:41:55.428881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.428 [2024-11-26 04:41:55.428894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.428 [2024-11-26 04:41:55.428921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.428 qpair failed and we were unable to recover it. 00:30:16.428 [2024-11-26 04:41:55.438733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.428 [2024-11-26 04:41:55.438836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.428 [2024-11-26 04:41:55.438861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.428 [2024-11-26 04:41:55.438874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.428 [2024-11-26 04:41:55.438887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x73c390 00:30:16.428 [2024-11-26 04:41:55.438914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.428 qpair failed and we were unable to recover it. 00:30:16.428 [2024-11-26 04:41:55.448762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.428 [2024-11-26 04:41:55.448861] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.428 [2024-11-26 04:41:55.448893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.428 [2024-11-26 04:41:55.448908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.428 [2024-11-26 04:41:55.448921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:16.428 [2024-11-26 04:41:55.448952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.428 qpair failed and we were unable to recover it. 00:30:16.428 [2024-11-26 04:41:55.458792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.428 [2024-11-26 04:41:55.458897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.428 [2024-11-26 04:41:55.458924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.428 [2024-11-26 04:41:55.458939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.428 [2024-11-26 04:41:55.458951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb68000b90 00:30:16.428 [2024-11-26 04:41:55.458981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.428 qpair failed and we were unable to recover it. 00:30:16.428 [2024-11-26 04:41:55.459101] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:16.428 A controller has encountered a failure and is being reset. 00:30:16.428 [2024-11-26 04:41:55.468878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.428 [2024-11-26 04:41:55.469026] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.428 [2024-11-26 04:41:55.469067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.428 [2024-11-26 04:41:55.469082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.428 [2024-11-26 04:41:55.469095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb5c000b90 00:30:16.428 [2024-11-26 04:41:55.469127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:16.428 qpair failed and we were unable to recover it. 00:30:16.428 [2024-11-26 04:41:55.478904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.428 [2024-11-26 04:41:55.479006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.428 [2024-11-26 04:41:55.479032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.428 [2024-11-26 04:41:55.479047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.428 [2024-11-26 04:41:55.479060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb5c000b90 00:30:16.428 [2024-11-26 04:41:55.479089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:16.428 qpair failed and we were unable to recover it. 00:30:16.428 [2024-11-26 04:41:55.488900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.428 [2024-11-26 04:41:55.489005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.428 [2024-11-26 04:41:55.489037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.428 [2024-11-26 04:41:55.489053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.428 [2024-11-26 04:41:55.489066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb60000b90 00:30:16.428 [2024-11-26 04:41:55.489096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.428 qpair failed and we were unable to recover it. 00:30:16.428 [2024-11-26 04:41:55.498911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:16.428 [2024-11-26 04:41:55.499020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:16.428 [2024-11-26 04:41:55.499047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:16.428 [2024-11-26 04:41:55.499062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:16.428 [2024-11-26 04:41:55.499083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdb60000b90 00:30:16.428 [2024-11-26 04:41:55.499119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.428 qpair failed and we were unable to recover it. 00:30:16.428 Controller properly reset. 00:30:16.428 Initializing NVMe Controllers 00:30:16.428 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:16.428 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:16.428 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:16.428 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:16.428 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:16.428 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:16.428 Initialization complete. Launching workers. 00:30:16.428 Starting thread on core 1 00:30:16.428 Starting thread on core 2 00:30:16.428 Starting thread on core 3 00:30:16.428 Starting thread on core 0 00:30:16.428 04:41:55 -- host/target_disconnect.sh@59 -- # sync 00:30:16.428 00:30:16.428 real 0m11.553s 00:30:16.428 user 0m21.293s 00:30:16.428 sys 0m5.201s 00:30:16.428 04:41:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:16.428 04:41:55 -- common/autotest_common.sh@10 -- # set +x 00:30:16.428 ************************************ 00:30:16.428 END TEST nvmf_target_disconnect_tc2 00:30:16.428 ************************************ 00:30:16.428 04:41:55 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:16.428 04:41:55 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:16.428 04:41:55 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:16.428 04:41:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:16.428 04:41:55 -- nvmf/common.sh@116 -- # sync 00:30:16.428 04:41:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:16.428 04:41:55 -- nvmf/common.sh@119 -- # set +e 00:30:16.428 04:41:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:16.428 04:41:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:16.428 rmmod nvme_tcp 00:30:16.428 rmmod nvme_fabrics 00:30:16.428 rmmod nvme_keyring 00:30:16.428 04:41:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:16.428 04:41:55 -- nvmf/common.sh@123 -- # set -e 00:30:16.429 04:41:55 -- nvmf/common.sh@124 -- # return 0 00:30:16.429 04:41:55 -- nvmf/common.sh@477 -- # '[' -n 3045631 ']' 00:30:16.429 04:41:55 -- nvmf/common.sh@478 -- # killprocess 3045631 00:30:16.429 04:41:55 -- common/autotest_common.sh@936 -- # '[' -z 3045631 ']' 00:30:16.429 04:41:55 -- common/autotest_common.sh@940 -- # kill -0 3045631 00:30:16.429 04:41:55 -- common/autotest_common.sh@941 -- # uname 00:30:16.429 04:41:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:16.429 04:41:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3045631 00:30:16.429 04:41:55 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:16.429 04:41:55 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:16.429 04:41:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3045631' 00:30:16.429 killing process with pid 3045631 00:30:16.429 04:41:55 -- common/autotest_common.sh@955 -- # kill 3045631 00:30:16.429 04:41:55 -- common/autotest_common.sh@960 -- # wait 3045631 00:30:16.687 04:41:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:16.687 04:41:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:16.687 04:41:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:16.687 04:41:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:16.687 04:41:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:16.687 04:41:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:16.687 04:41:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:16.687 04:41:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:19.223 04:41:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:19.224 00:30:19.224 real 0m16.295s 00:30:19.224 user 0m47.823s 00:30:19.224 sys 0m7.131s 00:30:19.224 04:41:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:19.224 04:41:57 -- common/autotest_common.sh@10 -- # set +x 00:30:19.224 ************************************ 00:30:19.224 END TEST nvmf_target_disconnect 00:30:19.224 ************************************ 00:30:19.224 04:41:57 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:19.224 04:41:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:19.224 04:41:57 -- common/autotest_common.sh@10 -- # set +x 00:30:19.224 04:41:57 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:19.224 00:30:19.224 real 22m50.044s 00:30:19.224 user 66m5.637s 00:30:19.224 sys 5m32.764s 00:30:19.224 04:41:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:19.224 04:41:57 -- common/autotest_common.sh@10 -- # set +x 00:30:19.224 ************************************ 00:30:19.224 END TEST nvmf_tcp 00:30:19.224 ************************************ 00:30:19.224 04:41:57 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:19.224 04:41:57 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:19.224 04:41:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:19.224 04:41:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:19.224 04:41:57 -- common/autotest_common.sh@10 -- # set +x 00:30:19.224 ************************************ 00:30:19.224 START TEST spdkcli_nvmf_tcp 00:30:19.224 ************************************ 00:30:19.224 04:41:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:19.224 * Looking for test storage... 00:30:19.224 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:19.224 04:41:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:19.224 04:41:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:19.224 04:41:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:19.224 04:41:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:19.224 04:41:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:19.224 04:41:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:19.224 04:41:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:19.224 04:41:58 -- scripts/common.sh@335 -- # IFS=.-: 00:30:19.224 04:41:58 -- scripts/common.sh@335 -- # read -ra ver1 00:30:19.224 04:41:58 -- scripts/common.sh@336 -- # IFS=.-: 00:30:19.224 04:41:58 -- scripts/common.sh@336 -- # read -ra ver2 00:30:19.224 04:41:58 -- scripts/common.sh@337 -- # local 'op=<' 00:30:19.224 04:41:58 -- scripts/common.sh@339 -- # ver1_l=2 00:30:19.224 04:41:58 -- scripts/common.sh@340 -- # ver2_l=1 00:30:19.224 04:41:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:19.224 04:41:58 -- scripts/common.sh@343 -- # case "$op" in 00:30:19.224 04:41:58 -- scripts/common.sh@344 -- # : 1 00:30:19.224 04:41:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:19.224 04:41:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:19.224 04:41:58 -- scripts/common.sh@364 -- # decimal 1 00:30:19.224 04:41:58 -- scripts/common.sh@352 -- # local d=1 00:30:19.224 04:41:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:19.224 04:41:58 -- scripts/common.sh@354 -- # echo 1 00:30:19.224 04:41:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:19.224 04:41:58 -- scripts/common.sh@365 -- # decimal 2 00:30:19.224 04:41:58 -- scripts/common.sh@352 -- # local d=2 00:30:19.224 04:41:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:19.224 04:41:58 -- scripts/common.sh@354 -- # echo 2 00:30:19.224 04:41:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:19.224 04:41:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:19.224 04:41:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:19.224 04:41:58 -- scripts/common.sh@367 -- # return 0 00:30:19.224 04:41:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:19.224 04:41:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:19.224 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:19.224 --rc genhtml_branch_coverage=1 00:30:19.224 --rc genhtml_function_coverage=1 00:30:19.224 --rc genhtml_legend=1 00:30:19.224 --rc geninfo_all_blocks=1 00:30:19.224 --rc geninfo_unexecuted_blocks=1 00:30:19.224 00:30:19.224 ' 00:30:19.224 04:41:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:19.224 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:19.224 --rc genhtml_branch_coverage=1 00:30:19.224 --rc genhtml_function_coverage=1 00:30:19.224 --rc genhtml_legend=1 00:30:19.224 --rc geninfo_all_blocks=1 00:30:19.224 --rc geninfo_unexecuted_blocks=1 00:30:19.224 00:30:19.224 ' 00:30:19.224 04:41:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:19.224 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:19.224 --rc genhtml_branch_coverage=1 00:30:19.224 --rc genhtml_function_coverage=1 00:30:19.224 --rc genhtml_legend=1 00:30:19.224 --rc geninfo_all_blocks=1 00:30:19.224 --rc geninfo_unexecuted_blocks=1 00:30:19.224 00:30:19.224 ' 00:30:19.224 04:41:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:19.224 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:19.224 --rc genhtml_branch_coverage=1 00:30:19.224 --rc genhtml_function_coverage=1 00:30:19.224 --rc genhtml_legend=1 00:30:19.224 --rc geninfo_all_blocks=1 00:30:19.224 --rc geninfo_unexecuted_blocks=1 00:30:19.224 00:30:19.224 ' 00:30:19.224 04:41:58 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:19.224 04:41:58 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:19.224 04:41:58 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:19.224 04:41:58 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:19.224 04:41:58 -- nvmf/common.sh@7 -- # uname -s 00:30:19.224 04:41:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:19.224 04:41:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:19.224 04:41:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:19.224 04:41:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:19.224 04:41:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:19.224 04:41:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:19.224 04:41:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:19.224 04:41:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:19.224 04:41:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:19.224 04:41:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:19.224 04:41:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:19.224 04:41:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:19.224 04:41:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:19.224 04:41:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:19.224 04:41:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:19.224 04:41:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:19.224 04:41:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:19.224 04:41:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:19.224 04:41:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:19.224 04:41:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:19.224 04:41:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:19.224 04:41:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:19.224 04:41:58 -- paths/export.sh@5 -- # export PATH 00:30:19.224 04:41:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:19.224 04:41:58 -- nvmf/common.sh@46 -- # : 0 00:30:19.224 04:41:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:19.224 04:41:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:19.224 04:41:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:19.224 04:41:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:19.224 04:41:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:19.224 04:41:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:19.224 04:41:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:19.224 04:41:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:19.224 04:41:58 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:19.224 04:41:58 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:19.224 04:41:58 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:19.225 04:41:58 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:19.225 04:41:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:19.225 04:41:58 -- common/autotest_common.sh@10 -- # set +x 00:30:19.225 04:41:58 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:19.225 04:41:58 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3046849 00:30:19.225 04:41:58 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:19.225 04:41:58 -- spdkcli/common.sh@34 -- # waitforlisten 3046849 00:30:19.225 04:41:58 -- common/autotest_common.sh@829 -- # '[' -z 3046849 ']' 00:30:19.225 04:41:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:19.225 04:41:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:19.225 04:41:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:19.225 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:19.225 04:41:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:19.225 04:41:58 -- common/autotest_common.sh@10 -- # set +x 00:30:19.225 [2024-11-26 04:41:58.183436] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:19.225 [2024-11-26 04:41:58.183521] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3046849 ] 00:30:19.225 EAL: No free 2048 kB hugepages reported on node 1 00:30:19.225 [2024-11-26 04:41:58.262541] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:19.225 [2024-11-26 04:41:58.357944] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:19.225 [2024-11-26 04:41:58.358212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:19.225 [2024-11-26 04:41:58.358221] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:19.484 04:41:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:19.484 04:41:58 -- common/autotest_common.sh@862 -- # return 0 00:30:19.484 04:41:58 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:19.484 04:41:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:19.484 04:41:58 -- common/autotest_common.sh@10 -- # set +x 00:30:19.484 04:41:58 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:19.484 04:41:58 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:19.484 04:41:58 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:19.484 04:41:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:19.484 04:41:58 -- common/autotest_common.sh@10 -- # set +x 00:30:19.484 04:41:58 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:19.484 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:19.484 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:19.484 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:19.484 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:19.484 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:19.484 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:19.484 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:19.484 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:19.484 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:19.484 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:19.484 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:19.484 ' 00:30:20.054 [2024-11-26 04:41:58.976039] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:21.959 [2024-11-26 04:42:01.177941] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:23.334 [2024-11-26 04:42:02.418492] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:25.902 [2024-11-26 04:42:04.705779] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:27.806 [2024-11-26 04:42:06.704291] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:29.183 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:29.183 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:29.183 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:29.183 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:29.183 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:29.183 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:29.183 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:29.183 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:29.183 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:29.183 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:29.183 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:29.183 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:29.183 04:42:08 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:29.183 04:42:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:29.183 04:42:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.183 04:42:08 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:29.183 04:42:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:29.183 04:42:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.183 04:42:08 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:29.183 04:42:08 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:29.748 04:42:08 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:29.748 04:42:08 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:29.748 04:42:08 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:29.748 04:42:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:29.748 04:42:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.748 04:42:08 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:29.748 04:42:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:29.748 04:42:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.748 04:42:08 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:29.748 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:29.748 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:29.748 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:29.748 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:29.748 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:29.748 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:29.748 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:29.748 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:29.748 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:29.748 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:29.748 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:29.748 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:29.748 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:29.748 ' 00:30:35.042 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:30:35.042 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:30:35.042 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:35.042 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:30:35.042 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:30:35.042 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:30:35.042 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:30:35.042 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:35.042 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:30:35.042 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:30:35.042 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:30:35.042 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:30:35.042 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:30:35.042 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:30:35.042 04:42:14 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:30:35.042 04:42:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:35.042 04:42:14 -- common/autotest_common.sh@10 -- # set +x 00:30:35.042 04:42:14 -- spdkcli/nvmf.sh@90 -- # killprocess 3046849 00:30:35.042 04:42:14 -- common/autotest_common.sh@936 -- # '[' -z 3046849 ']' 00:30:35.042 04:42:14 -- common/autotest_common.sh@940 -- # kill -0 3046849 00:30:35.042 04:42:14 -- common/autotest_common.sh@941 -- # uname 00:30:35.042 04:42:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:35.042 04:42:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3046849 00:30:35.042 04:42:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:35.042 04:42:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:35.042 04:42:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3046849' 00:30:35.042 killing process with pid 3046849 00:30:35.042 04:42:14 -- common/autotest_common.sh@955 -- # kill 3046849 00:30:35.042 [2024-11-26 04:42:14.250317] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:35.042 04:42:14 -- common/autotest_common.sh@960 -- # wait 3046849 00:30:35.301 04:42:14 -- spdkcli/nvmf.sh@1 -- # cleanup 00:30:35.301 04:42:14 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:30:35.301 04:42:14 -- spdkcli/common.sh@13 -- # '[' -n 3046849 ']' 00:30:35.301 04:42:14 -- spdkcli/common.sh@14 -- # killprocess 3046849 00:30:35.301 04:42:14 -- common/autotest_common.sh@936 -- # '[' -z 3046849 ']' 00:30:35.301 04:42:14 -- common/autotest_common.sh@940 -- # kill -0 3046849 00:30:35.301 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3046849) - No such process 00:30:35.301 04:42:14 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3046849 is not found' 00:30:35.301 Process with pid 3046849 is not found 00:30:35.301 04:42:14 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:30:35.301 04:42:14 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:30:35.301 04:42:14 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:30:35.301 00:30:35.301 real 0m16.474s 00:30:35.301 user 0m35.126s 00:30:35.301 sys 0m0.836s 00:30:35.301 04:42:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:35.301 04:42:14 -- common/autotest_common.sh@10 -- # set +x 00:30:35.301 ************************************ 00:30:35.301 END TEST spdkcli_nvmf_tcp 00:30:35.301 ************************************ 00:30:35.301 04:42:14 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:35.301 04:42:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:35.301 04:42:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:35.301 04:42:14 -- common/autotest_common.sh@10 -- # set +x 00:30:35.301 ************************************ 00:30:35.301 START TEST nvmf_identify_passthru 00:30:35.301 ************************************ 00:30:35.301 04:42:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:35.560 * Looking for test storage... 00:30:35.560 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:35.560 04:42:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:35.560 04:42:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:35.560 04:42:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:35.560 04:42:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:35.560 04:42:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:35.560 04:42:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:35.560 04:42:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:35.560 04:42:14 -- scripts/common.sh@335 -- # IFS=.-: 00:30:35.560 04:42:14 -- scripts/common.sh@335 -- # read -ra ver1 00:30:35.560 04:42:14 -- scripts/common.sh@336 -- # IFS=.-: 00:30:35.560 04:42:14 -- scripts/common.sh@336 -- # read -ra ver2 00:30:35.560 04:42:14 -- scripts/common.sh@337 -- # local 'op=<' 00:30:35.560 04:42:14 -- scripts/common.sh@339 -- # ver1_l=2 00:30:35.560 04:42:14 -- scripts/common.sh@340 -- # ver2_l=1 00:30:35.560 04:42:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:35.560 04:42:14 -- scripts/common.sh@343 -- # case "$op" in 00:30:35.560 04:42:14 -- scripts/common.sh@344 -- # : 1 00:30:35.560 04:42:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:35.560 04:42:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:35.560 04:42:14 -- scripts/common.sh@364 -- # decimal 1 00:30:35.560 04:42:14 -- scripts/common.sh@352 -- # local d=1 00:30:35.560 04:42:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:35.560 04:42:14 -- scripts/common.sh@354 -- # echo 1 00:30:35.560 04:42:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:35.560 04:42:14 -- scripts/common.sh@365 -- # decimal 2 00:30:35.560 04:42:14 -- scripts/common.sh@352 -- # local d=2 00:30:35.560 04:42:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:35.560 04:42:14 -- scripts/common.sh@354 -- # echo 2 00:30:35.560 04:42:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:35.560 04:42:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:35.560 04:42:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:35.560 04:42:14 -- scripts/common.sh@367 -- # return 0 00:30:35.560 04:42:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:35.560 04:42:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:35.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:35.560 --rc genhtml_branch_coverage=1 00:30:35.560 --rc genhtml_function_coverage=1 00:30:35.560 --rc genhtml_legend=1 00:30:35.560 --rc geninfo_all_blocks=1 00:30:35.560 --rc geninfo_unexecuted_blocks=1 00:30:35.560 00:30:35.560 ' 00:30:35.560 04:42:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:35.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:35.560 --rc genhtml_branch_coverage=1 00:30:35.560 --rc genhtml_function_coverage=1 00:30:35.560 --rc genhtml_legend=1 00:30:35.560 --rc geninfo_all_blocks=1 00:30:35.560 --rc geninfo_unexecuted_blocks=1 00:30:35.560 00:30:35.560 ' 00:30:35.560 04:42:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:35.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:35.560 --rc genhtml_branch_coverage=1 00:30:35.560 --rc genhtml_function_coverage=1 00:30:35.560 --rc genhtml_legend=1 00:30:35.560 --rc geninfo_all_blocks=1 00:30:35.560 --rc geninfo_unexecuted_blocks=1 00:30:35.560 00:30:35.560 ' 00:30:35.560 04:42:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:35.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:35.560 --rc genhtml_branch_coverage=1 00:30:35.560 --rc genhtml_function_coverage=1 00:30:35.560 --rc genhtml_legend=1 00:30:35.560 --rc geninfo_all_blocks=1 00:30:35.560 --rc geninfo_unexecuted_blocks=1 00:30:35.560 00:30:35.560 ' 00:30:35.560 04:42:14 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:35.560 04:42:14 -- nvmf/common.sh@7 -- # uname -s 00:30:35.560 04:42:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:35.560 04:42:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:35.560 04:42:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:35.560 04:42:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:35.560 04:42:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:35.560 04:42:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:35.560 04:42:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:35.560 04:42:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:35.560 04:42:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:35.560 04:42:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:35.560 04:42:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:35.560 04:42:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:35.560 04:42:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:35.560 04:42:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:35.560 04:42:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:35.560 04:42:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:35.560 04:42:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:35.560 04:42:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:35.560 04:42:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:35.560 04:42:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.560 04:42:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.560 04:42:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.560 04:42:14 -- paths/export.sh@5 -- # export PATH 00:30:35.560 04:42:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.560 04:42:14 -- nvmf/common.sh@46 -- # : 0 00:30:35.560 04:42:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:35.560 04:42:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:35.560 04:42:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:35.560 04:42:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:35.560 04:42:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:35.560 04:42:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:35.560 04:42:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:35.560 04:42:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:35.560 04:42:14 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:35.560 04:42:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:35.560 04:42:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:35.560 04:42:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:35.560 04:42:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.560 04:42:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.560 04:42:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.560 04:42:14 -- paths/export.sh@5 -- # export PATH 00:30:35.560 04:42:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.561 04:42:14 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:30:35.561 04:42:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:35.561 04:42:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:35.561 04:42:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:35.561 04:42:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:35.561 04:42:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:35.561 04:42:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:35.561 04:42:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:35.561 04:42:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:35.561 04:42:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:35.561 04:42:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:35.561 04:42:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:35.561 04:42:14 -- common/autotest_common.sh@10 -- # set +x 00:30:37.467 04:42:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:37.467 04:42:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:37.467 04:42:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:37.467 04:42:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:37.468 04:42:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:37.468 04:42:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:37.468 04:42:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:37.468 04:42:16 -- nvmf/common.sh@294 -- # net_devs=() 00:30:37.468 04:42:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:37.468 04:42:16 -- nvmf/common.sh@295 -- # e810=() 00:30:37.468 04:42:16 -- nvmf/common.sh@295 -- # local -ga e810 00:30:37.468 04:42:16 -- nvmf/common.sh@296 -- # x722=() 00:30:37.468 04:42:16 -- nvmf/common.sh@296 -- # local -ga x722 00:30:37.468 04:42:16 -- nvmf/common.sh@297 -- # mlx=() 00:30:37.468 04:42:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:37.468 04:42:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:37.468 04:42:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:37.468 04:42:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:37.468 04:42:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:37.468 04:42:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:37.468 04:42:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:37.468 04:42:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:37.468 04:42:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:37.468 04:42:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:37.468 04:42:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:37.468 04:42:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:37.468 04:42:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:37.468 04:42:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:37.468 04:42:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:37.468 04:42:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:37.468 04:42:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:37.468 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:37.468 04:42:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:37.468 04:42:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:37.468 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:37.468 04:42:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:37.468 04:42:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:37.468 04:42:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:37.468 04:42:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:37.468 04:42:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:37.468 04:42:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:37.468 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:37.468 04:42:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:37.468 04:42:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:37.468 04:42:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:37.468 04:42:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:37.468 04:42:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:37.468 04:42:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:37.468 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:37.468 04:42:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:37.468 04:42:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:37.468 04:42:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:37.468 04:42:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:37.468 04:42:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:37.468 04:42:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:37.468 04:42:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:37.468 04:42:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:37.468 04:42:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:37.468 04:42:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:37.468 04:42:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:37.468 04:42:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:37.468 04:42:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:37.468 04:42:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:37.468 04:42:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:37.468 04:42:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:37.468 04:42:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:37.468 04:42:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:37.468 04:42:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:37.468 04:42:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:37.468 04:42:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:37.468 04:42:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:37.468 04:42:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:37.468 04:42:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:37.468 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:37.468 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.282 ms 00:30:37.468 00:30:37.468 --- 10.0.0.2 ping statistics --- 00:30:37.468 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:37.468 rtt min/avg/max/mdev = 0.282/0.282/0.282/0.000 ms 00:30:37.468 04:42:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:37.468 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:37.468 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.155 ms 00:30:37.468 00:30:37.468 --- 10.0.0.1 ping statistics --- 00:30:37.468 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:37.468 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:30:37.468 04:42:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:37.468 04:42:16 -- nvmf/common.sh@410 -- # return 0 00:30:37.468 04:42:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:37.468 04:42:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:37.468 04:42:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:37.468 04:42:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:37.468 04:42:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:37.468 04:42:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:37.468 04:42:16 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:30:37.468 04:42:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:37.468 04:42:16 -- common/autotest_common.sh@10 -- # set +x 00:30:37.468 04:42:16 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:30:37.468 04:42:16 -- common/autotest_common.sh@1519 -- # bdfs=() 00:30:37.468 04:42:16 -- common/autotest_common.sh@1519 -- # local bdfs 00:30:37.468 04:42:16 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:30:37.468 04:42:16 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:30:37.468 04:42:16 -- common/autotest_common.sh@1508 -- # bdfs=() 00:30:37.468 04:42:16 -- common/autotest_common.sh@1508 -- # local bdfs 00:30:37.468 04:42:16 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:30:37.468 04:42:16 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:30:37.468 04:42:16 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:30:37.468 04:42:16 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:30:37.468 04:42:16 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:30:37.468 04:42:16 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:30:37.468 04:42:16 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:30:37.468 04:42:16 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:30:37.468 04:42:16 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:37.468 04:42:16 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:30:37.468 04:42:16 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:30:37.728 EAL: No free 2048 kB hugepages reported on node 1 00:30:41.922 04:42:20 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:30:41.922 04:42:20 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:41.922 04:42:20 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:30:41.922 04:42:20 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:30:41.922 EAL: No free 2048 kB hugepages reported on node 1 00:30:46.112 04:42:25 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:30:46.112 04:42:25 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:30:46.112 04:42:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:46.112 04:42:25 -- common/autotest_common.sh@10 -- # set +x 00:30:46.112 04:42:25 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:30:46.112 04:42:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:46.112 04:42:25 -- common/autotest_common.sh@10 -- # set +x 00:30:46.112 04:42:25 -- target/identify_passthru.sh@31 -- # nvmfpid=3052197 00:30:46.112 04:42:25 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:30:46.112 04:42:25 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:30:46.112 04:42:25 -- target/identify_passthru.sh@35 -- # waitforlisten 3052197 00:30:46.112 04:42:25 -- common/autotest_common.sh@829 -- # '[' -z 3052197 ']' 00:30:46.112 04:42:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:46.112 04:42:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:46.112 04:42:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:46.112 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:46.112 04:42:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:46.112 04:42:25 -- common/autotest_common.sh@10 -- # set +x 00:30:46.112 [2024-11-26 04:42:25.157977] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:46.112 [2024-11-26 04:42:25.158065] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:46.112 EAL: No free 2048 kB hugepages reported on node 1 00:30:46.112 [2024-11-26 04:42:25.225499] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:46.112 [2024-11-26 04:42:25.314283] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:46.112 [2024-11-26 04:42:25.314458] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:46.112 [2024-11-26 04:42:25.314477] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:46.112 [2024-11-26 04:42:25.314492] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:46.112 [2024-11-26 04:42:25.314579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:46.112 [2024-11-26 04:42:25.314633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:46.112 [2024-11-26 04:42:25.314747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:46.112 [2024-11-26 04:42:25.314750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:46.370 04:42:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:46.370 04:42:25 -- common/autotest_common.sh@862 -- # return 0 00:30:46.370 04:42:25 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:30:46.370 04:42:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:46.370 04:42:25 -- common/autotest_common.sh@10 -- # set +x 00:30:46.370 INFO: Log level set to 20 00:30:46.370 INFO: Requests: 00:30:46.370 { 00:30:46.370 "jsonrpc": "2.0", 00:30:46.370 "method": "nvmf_set_config", 00:30:46.370 "id": 1, 00:30:46.370 "params": { 00:30:46.370 "admin_cmd_passthru": { 00:30:46.370 "identify_ctrlr": true 00:30:46.370 } 00:30:46.370 } 00:30:46.370 } 00:30:46.370 00:30:46.370 INFO: response: 00:30:46.370 { 00:30:46.370 "jsonrpc": "2.0", 00:30:46.370 "id": 1, 00:30:46.370 "result": true 00:30:46.370 } 00:30:46.370 00:30:46.370 04:42:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:46.370 04:42:25 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:30:46.370 04:42:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:46.370 04:42:25 -- common/autotest_common.sh@10 -- # set +x 00:30:46.370 INFO: Setting log level to 20 00:30:46.370 INFO: Setting log level to 20 00:30:46.370 INFO: Log level set to 20 00:30:46.370 INFO: Log level set to 20 00:30:46.370 INFO: Requests: 00:30:46.370 { 00:30:46.370 "jsonrpc": "2.0", 00:30:46.370 "method": "framework_start_init", 00:30:46.370 "id": 1 00:30:46.370 } 00:30:46.370 00:30:46.370 INFO: Requests: 00:30:46.370 { 00:30:46.370 "jsonrpc": "2.0", 00:30:46.370 "method": "framework_start_init", 00:30:46.370 "id": 1 00:30:46.370 } 00:30:46.370 00:30:46.370 [2024-11-26 04:42:25.482076] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:30:46.370 INFO: response: 00:30:46.370 { 00:30:46.370 "jsonrpc": "2.0", 00:30:46.370 "id": 1, 00:30:46.370 "result": true 00:30:46.370 } 00:30:46.370 00:30:46.370 INFO: response: 00:30:46.370 { 00:30:46.370 "jsonrpc": "2.0", 00:30:46.370 "id": 1, 00:30:46.370 "result": true 00:30:46.370 } 00:30:46.370 00:30:46.370 04:42:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:46.370 04:42:25 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:46.370 04:42:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:46.370 04:42:25 -- common/autotest_common.sh@10 -- # set +x 00:30:46.370 INFO: Setting log level to 40 00:30:46.370 INFO: Setting log level to 40 00:30:46.370 INFO: Setting log level to 40 00:30:46.370 [2024-11-26 04:42:25.492066] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:46.370 04:42:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:46.370 04:42:25 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:30:46.370 04:42:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:46.370 04:42:25 -- common/autotest_common.sh@10 -- # set +x 00:30:46.370 04:42:25 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:30:46.370 04:42:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:46.370 04:42:25 -- common/autotest_common.sh@10 -- # set +x 00:30:49.656 Nvme0n1 00:30:49.656 04:42:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:49.656 04:42:28 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:30:49.656 04:42:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:49.656 04:42:28 -- common/autotest_common.sh@10 -- # set +x 00:30:49.656 04:42:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:49.656 04:42:28 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:30:49.656 04:42:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:49.656 04:42:28 -- common/autotest_common.sh@10 -- # set +x 00:30:49.656 04:42:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:49.656 04:42:28 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:49.656 04:42:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:49.656 04:42:28 -- common/autotest_common.sh@10 -- # set +x 00:30:49.656 [2024-11-26 04:42:28.379610] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:49.656 04:42:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:49.656 04:42:28 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:30:49.656 04:42:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:49.656 04:42:28 -- common/autotest_common.sh@10 -- # set +x 00:30:49.656 [2024-11-26 04:42:28.387329] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:49.656 [ 00:30:49.656 { 00:30:49.656 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:30:49.656 "subtype": "Discovery", 00:30:49.656 "listen_addresses": [], 00:30:49.656 "allow_any_host": true, 00:30:49.656 "hosts": [] 00:30:49.656 }, 00:30:49.656 { 00:30:49.656 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:30:49.656 "subtype": "NVMe", 00:30:49.656 "listen_addresses": [ 00:30:49.656 { 00:30:49.656 "transport": "TCP", 00:30:49.656 "trtype": "TCP", 00:30:49.656 "adrfam": "IPv4", 00:30:49.656 "traddr": "10.0.0.2", 00:30:49.656 "trsvcid": "4420" 00:30:49.656 } 00:30:49.656 ], 00:30:49.656 "allow_any_host": true, 00:30:49.656 "hosts": [], 00:30:49.656 "serial_number": "SPDK00000000000001", 00:30:49.656 "model_number": "SPDK bdev Controller", 00:30:49.656 "max_namespaces": 1, 00:30:49.656 "min_cntlid": 1, 00:30:49.656 "max_cntlid": 65519, 00:30:49.656 "namespaces": [ 00:30:49.656 { 00:30:49.656 "nsid": 1, 00:30:49.656 "bdev_name": "Nvme0n1", 00:30:49.656 "name": "Nvme0n1", 00:30:49.656 "nguid": "A7B592038C91484CA78A72BC492C011C", 00:30:49.656 "uuid": "a7b59203-8c91-484c-a78a-72bc492c011c" 00:30:49.656 } 00:30:49.656 ] 00:30:49.656 } 00:30:49.656 ] 00:30:49.656 04:42:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:49.656 04:42:28 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:30:49.656 04:42:28 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:30:49.656 04:42:28 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:30:49.656 EAL: No free 2048 kB hugepages reported on node 1 00:30:49.656 04:42:28 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:30:49.656 04:42:28 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:30:49.656 04:42:28 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:30:49.657 04:42:28 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:30:49.657 EAL: No free 2048 kB hugepages reported on node 1 00:30:49.657 04:42:28 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:30:49.657 04:42:28 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:30:49.657 04:42:28 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:30:49.657 04:42:28 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:49.657 04:42:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:49.657 04:42:28 -- common/autotest_common.sh@10 -- # set +x 00:30:49.657 04:42:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:49.657 04:42:28 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:30:49.657 04:42:28 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:30:49.657 04:42:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:49.657 04:42:28 -- nvmf/common.sh@116 -- # sync 00:30:49.657 04:42:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:49.657 04:42:28 -- nvmf/common.sh@119 -- # set +e 00:30:49.657 04:42:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:49.657 04:42:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:49.657 rmmod nvme_tcp 00:30:49.657 rmmod nvme_fabrics 00:30:49.657 rmmod nvme_keyring 00:30:49.657 04:42:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:49.657 04:42:28 -- nvmf/common.sh@123 -- # set -e 00:30:49.657 04:42:28 -- nvmf/common.sh@124 -- # return 0 00:30:49.657 04:42:28 -- nvmf/common.sh@477 -- # '[' -n 3052197 ']' 00:30:49.657 04:42:28 -- nvmf/common.sh@478 -- # killprocess 3052197 00:30:49.657 04:42:28 -- common/autotest_common.sh@936 -- # '[' -z 3052197 ']' 00:30:49.657 04:42:28 -- common/autotest_common.sh@940 -- # kill -0 3052197 00:30:49.657 04:42:28 -- common/autotest_common.sh@941 -- # uname 00:30:49.657 04:42:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:49.657 04:42:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3052197 00:30:49.916 04:42:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:49.916 04:42:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:49.916 04:42:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3052197' 00:30:49.916 killing process with pid 3052197 00:30:49.916 04:42:28 -- common/autotest_common.sh@955 -- # kill 3052197 00:30:49.916 [2024-11-26 04:42:28.879314] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:49.916 04:42:28 -- common/autotest_common.sh@960 -- # wait 3052197 00:30:51.292 04:42:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:51.292 04:42:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:51.292 04:42:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:51.292 04:42:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:51.292 04:42:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:51.292 04:42:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:51.292 04:42:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:51.292 04:42:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:53.830 04:42:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:53.830 00:30:53.830 real 0m17.974s 00:30:53.830 user 0m26.835s 00:30:53.830 sys 0m2.273s 00:30:53.830 04:42:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:53.830 04:42:32 -- common/autotest_common.sh@10 -- # set +x 00:30:53.830 ************************************ 00:30:53.830 END TEST nvmf_identify_passthru 00:30:53.830 ************************************ 00:30:53.830 04:42:32 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:30:53.830 04:42:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:53.830 04:42:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:53.830 04:42:32 -- common/autotest_common.sh@10 -- # set +x 00:30:53.830 ************************************ 00:30:53.830 START TEST nvmf_dif 00:30:53.830 ************************************ 00:30:53.830 04:42:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:30:53.830 * Looking for test storage... 00:30:53.830 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:53.830 04:42:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:53.830 04:42:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:53.830 04:42:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:53.830 04:42:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:53.830 04:42:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:53.830 04:42:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:53.831 04:42:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:53.831 04:42:32 -- scripts/common.sh@335 -- # IFS=.-: 00:30:53.831 04:42:32 -- scripts/common.sh@335 -- # read -ra ver1 00:30:53.831 04:42:32 -- scripts/common.sh@336 -- # IFS=.-: 00:30:53.831 04:42:32 -- scripts/common.sh@336 -- # read -ra ver2 00:30:53.831 04:42:32 -- scripts/common.sh@337 -- # local 'op=<' 00:30:53.831 04:42:32 -- scripts/common.sh@339 -- # ver1_l=2 00:30:53.831 04:42:32 -- scripts/common.sh@340 -- # ver2_l=1 00:30:53.831 04:42:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:53.831 04:42:32 -- scripts/common.sh@343 -- # case "$op" in 00:30:53.831 04:42:32 -- scripts/common.sh@344 -- # : 1 00:30:53.831 04:42:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:53.831 04:42:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:53.831 04:42:32 -- scripts/common.sh@364 -- # decimal 1 00:30:53.831 04:42:32 -- scripts/common.sh@352 -- # local d=1 00:30:53.831 04:42:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:53.831 04:42:32 -- scripts/common.sh@354 -- # echo 1 00:30:53.831 04:42:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:53.831 04:42:32 -- scripts/common.sh@365 -- # decimal 2 00:30:53.831 04:42:32 -- scripts/common.sh@352 -- # local d=2 00:30:53.831 04:42:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:53.831 04:42:32 -- scripts/common.sh@354 -- # echo 2 00:30:53.831 04:42:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:53.831 04:42:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:53.831 04:42:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:53.831 04:42:32 -- scripts/common.sh@367 -- # return 0 00:30:53.831 04:42:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:53.831 04:42:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:53.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:53.831 --rc genhtml_branch_coverage=1 00:30:53.831 --rc genhtml_function_coverage=1 00:30:53.831 --rc genhtml_legend=1 00:30:53.831 --rc geninfo_all_blocks=1 00:30:53.831 --rc geninfo_unexecuted_blocks=1 00:30:53.831 00:30:53.831 ' 00:30:53.831 04:42:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:53.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:53.831 --rc genhtml_branch_coverage=1 00:30:53.831 --rc genhtml_function_coverage=1 00:30:53.831 --rc genhtml_legend=1 00:30:53.831 --rc geninfo_all_blocks=1 00:30:53.831 --rc geninfo_unexecuted_blocks=1 00:30:53.831 00:30:53.831 ' 00:30:53.831 04:42:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:53.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:53.831 --rc genhtml_branch_coverage=1 00:30:53.831 --rc genhtml_function_coverage=1 00:30:53.831 --rc genhtml_legend=1 00:30:53.831 --rc geninfo_all_blocks=1 00:30:53.831 --rc geninfo_unexecuted_blocks=1 00:30:53.831 00:30:53.831 ' 00:30:53.831 04:42:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:53.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:53.831 --rc genhtml_branch_coverage=1 00:30:53.831 --rc genhtml_function_coverage=1 00:30:53.831 --rc genhtml_legend=1 00:30:53.831 --rc geninfo_all_blocks=1 00:30:53.831 --rc geninfo_unexecuted_blocks=1 00:30:53.831 00:30:53.831 ' 00:30:53.831 04:42:32 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:53.831 04:42:32 -- nvmf/common.sh@7 -- # uname -s 00:30:53.831 04:42:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:53.831 04:42:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:53.831 04:42:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:53.831 04:42:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:53.831 04:42:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:53.831 04:42:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:53.831 04:42:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:53.831 04:42:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:53.831 04:42:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:53.831 04:42:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:53.831 04:42:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:53.831 04:42:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:53.831 04:42:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:53.831 04:42:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:53.831 04:42:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:53.831 04:42:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:53.831 04:42:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:53.831 04:42:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:53.831 04:42:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:53.831 04:42:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:53.831 04:42:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:53.831 04:42:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:53.831 04:42:32 -- paths/export.sh@5 -- # export PATH 00:30:53.831 04:42:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:53.831 04:42:32 -- nvmf/common.sh@46 -- # : 0 00:30:53.831 04:42:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:53.831 04:42:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:53.831 04:42:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:53.831 04:42:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:53.831 04:42:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:53.831 04:42:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:53.831 04:42:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:53.831 04:42:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:53.831 04:42:32 -- target/dif.sh@15 -- # NULL_META=16 00:30:53.831 04:42:32 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:30:53.831 04:42:32 -- target/dif.sh@15 -- # NULL_SIZE=64 00:30:53.831 04:42:32 -- target/dif.sh@15 -- # NULL_DIF=1 00:30:53.831 04:42:32 -- target/dif.sh@135 -- # nvmftestinit 00:30:53.831 04:42:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:53.831 04:42:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:53.831 04:42:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:53.831 04:42:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:53.831 04:42:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:53.831 04:42:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:53.831 04:42:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:53.831 04:42:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:53.831 04:42:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:53.831 04:42:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:53.831 04:42:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:53.831 04:42:32 -- common/autotest_common.sh@10 -- # set +x 00:30:55.734 04:42:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:55.734 04:42:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:55.734 04:42:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:55.734 04:42:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:55.734 04:42:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:55.734 04:42:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:55.734 04:42:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:55.734 04:42:34 -- nvmf/common.sh@294 -- # net_devs=() 00:30:55.734 04:42:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:55.734 04:42:34 -- nvmf/common.sh@295 -- # e810=() 00:30:55.734 04:42:34 -- nvmf/common.sh@295 -- # local -ga e810 00:30:55.734 04:42:34 -- nvmf/common.sh@296 -- # x722=() 00:30:55.734 04:42:34 -- nvmf/common.sh@296 -- # local -ga x722 00:30:55.734 04:42:34 -- nvmf/common.sh@297 -- # mlx=() 00:30:55.734 04:42:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:55.734 04:42:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:55.734 04:42:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:55.734 04:42:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:55.734 04:42:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:55.734 04:42:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:55.734 04:42:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:55.734 04:42:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:55.734 04:42:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:55.734 04:42:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:55.734 04:42:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:55.734 04:42:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:55.734 04:42:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:55.734 04:42:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:55.734 04:42:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:55.734 04:42:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:55.734 04:42:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:55.734 04:42:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:55.734 04:42:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:55.734 04:42:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:55.734 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:55.735 04:42:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:55.735 04:42:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:55.735 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:55.735 04:42:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:55.735 04:42:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:55.735 04:42:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:55.735 04:42:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:55.735 04:42:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:55.735 04:42:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:55.735 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:55.735 04:42:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:55.735 04:42:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:55.735 04:42:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:55.735 04:42:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:55.735 04:42:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:55.735 04:42:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:55.735 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:55.735 04:42:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:55.735 04:42:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:55.735 04:42:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:55.735 04:42:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:55.735 04:42:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:55.735 04:42:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:55.735 04:42:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:55.735 04:42:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:55.735 04:42:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:55.735 04:42:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:55.735 04:42:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:55.735 04:42:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:55.735 04:42:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:55.735 04:42:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:55.735 04:42:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:55.735 04:42:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:55.735 04:42:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:55.735 04:42:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:55.735 04:42:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:55.735 04:42:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:55.735 04:42:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:55.735 04:42:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:55.994 04:42:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:55.994 04:42:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:55.994 04:42:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:55.994 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:55.994 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.339 ms 00:30:55.994 00:30:55.994 --- 10.0.0.2 ping statistics --- 00:30:55.994 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:55.994 rtt min/avg/max/mdev = 0.339/0.339/0.339/0.000 ms 00:30:55.994 04:42:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:55.994 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:55.994 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.172 ms 00:30:55.994 00:30:55.994 --- 10.0.0.1 ping statistics --- 00:30:55.994 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:55.994 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:30:55.994 04:42:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:55.994 04:42:35 -- nvmf/common.sh@410 -- # return 0 00:30:55.994 04:42:35 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:30:55.994 04:42:35 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:30:56.929 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:30:56.929 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:30:56.929 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:30:56.929 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:30:56.929 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:30:56.929 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:30:56.929 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:30:56.929 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:30:56.929 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:30:56.929 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:30:56.929 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:30:56.929 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:30:56.929 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:30:56.929 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:30:56.929 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:30:57.216 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:30:57.216 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:30:57.216 04:42:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:57.216 04:42:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:57.216 04:42:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:57.216 04:42:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:57.216 04:42:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:57.216 04:42:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:57.216 04:42:36 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:30:57.216 04:42:36 -- target/dif.sh@137 -- # nvmfappstart 00:30:57.216 04:42:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:57.216 04:42:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:57.216 04:42:36 -- common/autotest_common.sh@10 -- # set +x 00:30:57.216 04:42:36 -- nvmf/common.sh@469 -- # nvmfpid=3055522 00:30:57.216 04:42:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:30:57.216 04:42:36 -- nvmf/common.sh@470 -- # waitforlisten 3055522 00:30:57.216 04:42:36 -- common/autotest_common.sh@829 -- # '[' -z 3055522 ']' 00:30:57.216 04:42:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:57.216 04:42:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:57.216 04:42:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:57.216 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:57.216 04:42:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:57.216 04:42:36 -- common/autotest_common.sh@10 -- # set +x 00:30:57.216 [2024-11-26 04:42:36.377970] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:57.216 [2024-11-26 04:42:36.378070] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:57.216 EAL: No free 2048 kB hugepages reported on node 1 00:30:57.476 [2024-11-26 04:42:36.441478] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:57.476 [2024-11-26 04:42:36.527283] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:57.476 [2024-11-26 04:42:36.527421] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:57.476 [2024-11-26 04:42:36.527438] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:57.476 [2024-11-26 04:42:36.527450] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:57.476 [2024-11-26 04:42:36.527483] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:58.416 04:42:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:58.416 04:42:37 -- common/autotest_common.sh@862 -- # return 0 00:30:58.416 04:42:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:58.416 04:42:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:58.416 04:42:37 -- common/autotest_common.sh@10 -- # set +x 00:30:58.416 04:42:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:58.416 04:42:37 -- target/dif.sh@139 -- # create_transport 00:30:58.416 04:42:37 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:30:58.416 04:42:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:58.416 04:42:37 -- common/autotest_common.sh@10 -- # set +x 00:30:58.416 [2024-11-26 04:42:37.367485] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:58.416 04:42:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:58.416 04:42:37 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:30:58.416 04:42:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:58.416 04:42:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:58.416 04:42:37 -- common/autotest_common.sh@10 -- # set +x 00:30:58.416 ************************************ 00:30:58.416 START TEST fio_dif_1_default 00:30:58.416 ************************************ 00:30:58.416 04:42:37 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:30:58.416 04:42:37 -- target/dif.sh@86 -- # create_subsystems 0 00:30:58.416 04:42:37 -- target/dif.sh@28 -- # local sub 00:30:58.416 04:42:37 -- target/dif.sh@30 -- # for sub in "$@" 00:30:58.416 04:42:37 -- target/dif.sh@31 -- # create_subsystem 0 00:30:58.416 04:42:37 -- target/dif.sh@18 -- # local sub_id=0 00:30:58.416 04:42:37 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:30:58.416 04:42:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:58.416 04:42:37 -- common/autotest_common.sh@10 -- # set +x 00:30:58.416 bdev_null0 00:30:58.416 04:42:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:58.416 04:42:37 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:30:58.416 04:42:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:58.416 04:42:37 -- common/autotest_common.sh@10 -- # set +x 00:30:58.416 04:42:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:58.416 04:42:37 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:30:58.416 04:42:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:58.416 04:42:37 -- common/autotest_common.sh@10 -- # set +x 00:30:58.416 04:42:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:58.416 04:42:37 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:30:58.416 04:42:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:58.416 04:42:37 -- common/autotest_common.sh@10 -- # set +x 00:30:58.416 [2024-11-26 04:42:37.403780] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:58.416 04:42:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:58.416 04:42:37 -- target/dif.sh@87 -- # fio /dev/fd/62 00:30:58.416 04:42:37 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:30:58.416 04:42:37 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:30:58.416 04:42:37 -- nvmf/common.sh@520 -- # config=() 00:30:58.416 04:42:37 -- nvmf/common.sh@520 -- # local subsystem config 00:30:58.417 04:42:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:58.417 04:42:37 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:58.417 04:42:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:58.417 { 00:30:58.417 "params": { 00:30:58.417 "name": "Nvme$subsystem", 00:30:58.417 "trtype": "$TEST_TRANSPORT", 00:30:58.417 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:58.417 "adrfam": "ipv4", 00:30:58.417 "trsvcid": "$NVMF_PORT", 00:30:58.417 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:58.417 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:58.417 "hdgst": ${hdgst:-false}, 00:30:58.417 "ddgst": ${ddgst:-false} 00:30:58.417 }, 00:30:58.417 "method": "bdev_nvme_attach_controller" 00:30:58.417 } 00:30:58.417 EOF 00:30:58.417 )") 00:30:58.417 04:42:37 -- target/dif.sh@82 -- # gen_fio_conf 00:30:58.417 04:42:37 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:58.417 04:42:37 -- target/dif.sh@54 -- # local file 00:30:58.417 04:42:37 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:30:58.417 04:42:37 -- target/dif.sh@56 -- # cat 00:30:58.417 04:42:37 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:58.417 04:42:37 -- common/autotest_common.sh@1328 -- # local sanitizers 00:30:58.417 04:42:37 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:58.417 04:42:37 -- common/autotest_common.sh@1330 -- # shift 00:30:58.417 04:42:37 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:30:58.417 04:42:37 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:30:58.417 04:42:37 -- nvmf/common.sh@542 -- # cat 00:30:58.417 04:42:37 -- target/dif.sh@72 -- # (( file = 1 )) 00:30:58.417 04:42:37 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:58.417 04:42:37 -- target/dif.sh@72 -- # (( file <= files )) 00:30:58.417 04:42:37 -- common/autotest_common.sh@1334 -- # grep libasan 00:30:58.417 04:42:37 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:30:58.417 04:42:37 -- nvmf/common.sh@544 -- # jq . 00:30:58.417 04:42:37 -- nvmf/common.sh@545 -- # IFS=, 00:30:58.417 04:42:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:58.417 "params": { 00:30:58.417 "name": "Nvme0", 00:30:58.417 "trtype": "tcp", 00:30:58.417 "traddr": "10.0.0.2", 00:30:58.417 "adrfam": "ipv4", 00:30:58.417 "trsvcid": "4420", 00:30:58.417 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:30:58.417 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:30:58.417 "hdgst": false, 00:30:58.417 "ddgst": false 00:30:58.417 }, 00:30:58.417 "method": "bdev_nvme_attach_controller" 00:30:58.417 }' 00:30:58.417 04:42:37 -- common/autotest_common.sh@1334 -- # asan_lib= 00:30:58.417 04:42:37 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:30:58.417 04:42:37 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:30:58.417 04:42:37 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:58.417 04:42:37 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:30:58.417 04:42:37 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:30:58.417 04:42:37 -- common/autotest_common.sh@1334 -- # asan_lib= 00:30:58.417 04:42:37 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:30:58.417 04:42:37 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:30:58.417 04:42:37 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:58.675 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:30:58.675 fio-3.35 00:30:58.675 Starting 1 thread 00:30:58.675 EAL: No free 2048 kB hugepages reported on node 1 00:30:58.933 [2024-11-26 04:42:38.142332] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:30:58.933 [2024-11-26 04:42:38.142403] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:11.151 00:31:11.151 filename0: (groupid=0, jobs=1): err= 0: pid=3055888: Tue Nov 26 04:42:48 2024 00:31:11.151 read: IOPS=189, BW=758KiB/s (776kB/s)(7584KiB/10005msec) 00:31:11.151 slat (nsec): min=3941, max=45271, avg=9330.21, stdev=2607.42 00:31:11.151 clat (usec): min=593, max=48933, avg=21076.40, stdev=20303.86 00:31:11.151 lat (usec): min=601, max=48947, avg=21085.73, stdev=20303.94 00:31:11.151 clat percentiles (usec): 00:31:11.151 | 1.00th=[ 611], 5.00th=[ 627], 10.00th=[ 660], 20.00th=[ 676], 00:31:11.151 | 30.00th=[ 701], 40.00th=[ 734], 50.00th=[41157], 60.00th=[41157], 00:31:11.151 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:11.151 | 99.00th=[41157], 99.50th=[42206], 99.90th=[49021], 99.95th=[49021], 00:31:11.151 | 99.99th=[49021] 00:31:11.151 bw ( KiB/s): min= 672, max= 768, per=100.00%, avg=759.58, stdev=23.47, samples=19 00:31:11.151 iops : min= 168, max= 192, avg=189.89, stdev= 5.87, samples=19 00:31:11.151 lat (usec) : 750=43.67%, 1000=6.12% 00:31:11.151 lat (msec) : 50=50.21% 00:31:11.151 cpu : usr=92.17%, sys=7.53%, ctx=15, majf=0, minf=264 00:31:11.151 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:11.151 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:11.151 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:11.151 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:11.151 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:11.151 00:31:11.151 Run status group 0 (all jobs): 00:31:11.151 READ: bw=758KiB/s (776kB/s), 758KiB/s-758KiB/s (776kB/s-776kB/s), io=7584KiB (7766kB), run=10005-10005msec 00:31:11.151 04:42:48 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:11.151 04:42:48 -- target/dif.sh@43 -- # local sub 00:31:11.151 04:42:48 -- target/dif.sh@45 -- # for sub in "$@" 00:31:11.151 04:42:48 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:11.151 04:42:48 -- target/dif.sh@36 -- # local sub_id=0 00:31:11.152 04:42:48 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:11.152 04:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.152 04:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:11.152 04:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.152 04:42:48 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:11.152 04:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.152 04:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:11.152 04:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.152 00:31:11.152 real 0m11.136s 00:31:11.152 user 0m10.342s 00:31:11.152 sys 0m1.021s 00:31:11.152 04:42:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:11.152 04:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:11.152 ************************************ 00:31:11.152 END TEST fio_dif_1_default 00:31:11.152 ************************************ 00:31:11.152 04:42:48 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:11.152 04:42:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:11.152 04:42:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:11.152 04:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:11.152 ************************************ 00:31:11.152 START TEST fio_dif_1_multi_subsystems 00:31:11.152 ************************************ 00:31:11.152 04:42:48 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:11.152 04:42:48 -- target/dif.sh@92 -- # local files=1 00:31:11.152 04:42:48 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:11.152 04:42:48 -- target/dif.sh@28 -- # local sub 00:31:11.152 04:42:48 -- target/dif.sh@30 -- # for sub in "$@" 00:31:11.152 04:42:48 -- target/dif.sh@31 -- # create_subsystem 0 00:31:11.152 04:42:48 -- target/dif.sh@18 -- # local sub_id=0 00:31:11.152 04:42:48 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:11.152 04:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.152 04:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:11.152 bdev_null0 00:31:11.152 04:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.152 04:42:48 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:11.152 04:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.152 04:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:11.152 04:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.152 04:42:48 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:11.152 04:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.152 04:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:11.152 04:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.152 04:42:48 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:11.152 04:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.152 04:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:11.152 [2024-11-26 04:42:48.571367] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:11.152 04:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.152 04:42:48 -- target/dif.sh@30 -- # for sub in "$@" 00:31:11.152 04:42:48 -- target/dif.sh@31 -- # create_subsystem 1 00:31:11.152 04:42:48 -- target/dif.sh@18 -- # local sub_id=1 00:31:11.152 04:42:48 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:11.152 04:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.152 04:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:11.152 bdev_null1 00:31:11.152 04:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.152 04:42:48 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:11.152 04:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.152 04:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:11.152 04:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.152 04:42:48 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:11.152 04:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.152 04:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:11.152 04:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.152 04:42:48 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:11.152 04:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:11.152 04:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:11.152 04:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:11.152 04:42:48 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:11.152 04:42:48 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:11.152 04:42:48 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:11.152 04:42:48 -- nvmf/common.sh@520 -- # config=() 00:31:11.152 04:42:48 -- nvmf/common.sh@520 -- # local subsystem config 00:31:11.152 04:42:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:11.152 04:42:48 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:11.152 04:42:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:11.152 { 00:31:11.152 "params": { 00:31:11.152 "name": "Nvme$subsystem", 00:31:11.152 "trtype": "$TEST_TRANSPORT", 00:31:11.152 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:11.152 "adrfam": "ipv4", 00:31:11.152 "trsvcid": "$NVMF_PORT", 00:31:11.152 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:11.152 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:11.152 "hdgst": ${hdgst:-false}, 00:31:11.152 "ddgst": ${ddgst:-false} 00:31:11.152 }, 00:31:11.152 "method": "bdev_nvme_attach_controller" 00:31:11.152 } 00:31:11.152 EOF 00:31:11.152 )") 00:31:11.152 04:42:48 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:11.152 04:42:48 -- target/dif.sh@82 -- # gen_fio_conf 00:31:11.152 04:42:48 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:11.152 04:42:48 -- target/dif.sh@54 -- # local file 00:31:11.152 04:42:48 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:11.152 04:42:48 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:11.152 04:42:48 -- target/dif.sh@56 -- # cat 00:31:11.152 04:42:48 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:11.152 04:42:48 -- common/autotest_common.sh@1330 -- # shift 00:31:11.152 04:42:48 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:11.152 04:42:48 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:11.152 04:42:48 -- nvmf/common.sh@542 -- # cat 00:31:11.152 04:42:48 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:11.152 04:42:48 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:11.152 04:42:48 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:11.152 04:42:48 -- target/dif.sh@72 -- # (( file <= files )) 00:31:11.152 04:42:48 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:11.152 04:42:48 -- target/dif.sh@73 -- # cat 00:31:11.152 04:42:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:11.152 04:42:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:11.152 { 00:31:11.152 "params": { 00:31:11.152 "name": "Nvme$subsystem", 00:31:11.152 "trtype": "$TEST_TRANSPORT", 00:31:11.152 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:11.152 "adrfam": "ipv4", 00:31:11.152 "trsvcid": "$NVMF_PORT", 00:31:11.152 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:11.152 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:11.152 "hdgst": ${hdgst:-false}, 00:31:11.152 "ddgst": ${ddgst:-false} 00:31:11.152 }, 00:31:11.152 "method": "bdev_nvme_attach_controller" 00:31:11.152 } 00:31:11.152 EOF 00:31:11.152 )") 00:31:11.152 04:42:48 -- nvmf/common.sh@542 -- # cat 00:31:11.152 04:42:48 -- target/dif.sh@72 -- # (( file++ )) 00:31:11.152 04:42:48 -- target/dif.sh@72 -- # (( file <= files )) 00:31:11.152 04:42:48 -- nvmf/common.sh@544 -- # jq . 00:31:11.152 04:42:48 -- nvmf/common.sh@545 -- # IFS=, 00:31:11.152 04:42:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:11.152 "params": { 00:31:11.152 "name": "Nvme0", 00:31:11.152 "trtype": "tcp", 00:31:11.152 "traddr": "10.0.0.2", 00:31:11.152 "adrfam": "ipv4", 00:31:11.152 "trsvcid": "4420", 00:31:11.152 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:11.152 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:11.152 "hdgst": false, 00:31:11.152 "ddgst": false 00:31:11.152 }, 00:31:11.152 "method": "bdev_nvme_attach_controller" 00:31:11.152 },{ 00:31:11.152 "params": { 00:31:11.152 "name": "Nvme1", 00:31:11.152 "trtype": "tcp", 00:31:11.152 "traddr": "10.0.0.2", 00:31:11.152 "adrfam": "ipv4", 00:31:11.152 "trsvcid": "4420", 00:31:11.152 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:11.152 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:11.152 "hdgst": false, 00:31:11.152 "ddgst": false 00:31:11.152 }, 00:31:11.152 "method": "bdev_nvme_attach_controller" 00:31:11.152 }' 00:31:11.152 04:42:48 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:11.152 04:42:48 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:11.152 04:42:48 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:11.152 04:42:48 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:11.152 04:42:48 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:11.152 04:42:48 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:11.152 04:42:48 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:11.152 04:42:48 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:11.152 04:42:48 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:11.152 04:42:48 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:11.152 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:11.152 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:11.152 fio-3.35 00:31:11.152 Starting 2 threads 00:31:11.152 EAL: No free 2048 kB hugepages reported on node 1 00:31:11.153 [2024-11-26 04:42:49.611615] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:11.153 [2024-11-26 04:42:49.611665] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:21.121 00:31:21.121 filename0: (groupid=0, jobs=1): err= 0: pid=3057329: Tue Nov 26 04:42:59 2024 00:31:21.121 read: IOPS=189, BW=759KiB/s (778kB/s)(7600KiB/10007msec) 00:31:21.121 slat (nsec): min=5725, max=39463, avg=9497.62, stdev=4095.93 00:31:21.121 clat (usec): min=531, max=46124, avg=21036.10, stdev=20287.43 00:31:21.121 lat (usec): min=538, max=46139, avg=21045.60, stdev=20288.00 00:31:21.121 clat percentiles (usec): 00:31:21.121 | 1.00th=[ 603], 5.00th=[ 619], 10.00th=[ 635], 20.00th=[ 676], 00:31:21.121 | 30.00th=[ 750], 40.00th=[ 775], 50.00th=[41157], 60.00th=[41157], 00:31:21.121 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:21.121 | 99.00th=[42206], 99.50th=[42206], 99.90th=[45876], 99.95th=[45876], 00:31:21.121 | 99.99th=[45876] 00:31:21.121 bw ( KiB/s): min= 704, max= 768, per=49.96%, avg=758.40, stdev=21.02, samples=20 00:31:21.121 iops : min= 176, max= 192, avg=189.60, stdev= 5.26, samples=20 00:31:21.121 lat (usec) : 750=29.11%, 1000=20.37% 00:31:21.121 lat (msec) : 2=0.42%, 50=50.11% 00:31:21.121 cpu : usr=95.28%, sys=4.40%, ctx=10, majf=0, minf=138 00:31:21.121 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:21.121 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:21.121 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:21.121 issued rwts: total=1900,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:21.121 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:21.121 filename1: (groupid=0, jobs=1): err= 0: pid=3057330: Tue Nov 26 04:42:59 2024 00:31:21.121 read: IOPS=189, BW=758KiB/s (777kB/s)(7584KiB/10001msec) 00:31:21.121 slat (nsec): min=5891, max=35426, avg=8553.10, stdev=2534.21 00:31:21.121 clat (usec): min=598, max=46074, avg=21070.57, stdev=20324.88 00:31:21.121 lat (usec): min=605, max=46088, avg=21079.13, stdev=20324.67 00:31:21.121 clat percentiles (usec): 00:31:21.121 | 1.00th=[ 619], 5.00th=[ 635], 10.00th=[ 644], 20.00th=[ 652], 00:31:21.121 | 30.00th=[ 668], 40.00th=[ 693], 50.00th=[41157], 60.00th=[41157], 00:31:21.121 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:21.121 | 99.00th=[41157], 99.50th=[41157], 99.90th=[45876], 99.95th=[45876], 00:31:21.121 | 99.99th=[45876] 00:31:21.121 bw ( KiB/s): min= 672, max= 768, per=50.02%, avg=759.58, stdev=25.78, samples=19 00:31:21.121 iops : min= 168, max= 192, avg=189.89, stdev= 6.45, samples=19 00:31:21.121 lat (usec) : 750=49.53%, 1000=0.26% 00:31:21.121 lat (msec) : 50=50.21% 00:31:21.121 cpu : usr=95.23%, sys=4.46%, ctx=22, majf=0, minf=205 00:31:21.121 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:21.121 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:21.121 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:21.121 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:21.121 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:21.121 00:31:21.121 Run status group 0 (all jobs): 00:31:21.121 READ: bw=1517KiB/s (1554kB/s), 758KiB/s-759KiB/s (777kB/s-778kB/s), io=14.8MiB (15.5MB), run=10001-10007msec 00:31:21.121 04:42:59 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:21.121 04:42:59 -- target/dif.sh@43 -- # local sub 00:31:21.121 04:42:59 -- target/dif.sh@45 -- # for sub in "$@" 00:31:21.121 04:42:59 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:21.121 04:42:59 -- target/dif.sh@36 -- # local sub_id=0 00:31:21.121 04:42:59 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:21.121 04:42:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.121 04:42:59 -- common/autotest_common.sh@10 -- # set +x 00:31:21.121 04:42:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.121 04:42:59 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:21.121 04:42:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.121 04:42:59 -- common/autotest_common.sh@10 -- # set +x 00:31:21.121 04:42:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.121 04:42:59 -- target/dif.sh@45 -- # for sub in "$@" 00:31:21.121 04:42:59 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:21.121 04:42:59 -- target/dif.sh@36 -- # local sub_id=1 00:31:21.121 04:42:59 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:21.121 04:42:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.121 04:42:59 -- common/autotest_common.sh@10 -- # set +x 00:31:21.121 04:42:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.121 04:42:59 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:21.121 04:42:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.121 04:42:59 -- common/autotest_common.sh@10 -- # set +x 00:31:21.121 04:42:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.121 00:31:21.121 real 0m11.457s 00:31:21.121 user 0m20.509s 00:31:21.121 sys 0m1.227s 00:31:21.121 04:42:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:21.121 04:42:59 -- common/autotest_common.sh@10 -- # set +x 00:31:21.121 ************************************ 00:31:21.121 END TEST fio_dif_1_multi_subsystems 00:31:21.121 ************************************ 00:31:21.121 04:43:00 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:21.121 04:43:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:21.121 04:43:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:21.121 04:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:21.121 ************************************ 00:31:21.121 START TEST fio_dif_rand_params 00:31:21.121 ************************************ 00:31:21.121 04:43:00 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:31:21.121 04:43:00 -- target/dif.sh@100 -- # local NULL_DIF 00:31:21.121 04:43:00 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:21.121 04:43:00 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:21.121 04:43:00 -- target/dif.sh@103 -- # bs=128k 00:31:21.121 04:43:00 -- target/dif.sh@103 -- # numjobs=3 00:31:21.121 04:43:00 -- target/dif.sh@103 -- # iodepth=3 00:31:21.121 04:43:00 -- target/dif.sh@103 -- # runtime=5 00:31:21.121 04:43:00 -- target/dif.sh@105 -- # create_subsystems 0 00:31:21.121 04:43:00 -- target/dif.sh@28 -- # local sub 00:31:21.121 04:43:00 -- target/dif.sh@30 -- # for sub in "$@" 00:31:21.121 04:43:00 -- target/dif.sh@31 -- # create_subsystem 0 00:31:21.121 04:43:00 -- target/dif.sh@18 -- # local sub_id=0 00:31:21.121 04:43:00 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:21.121 04:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.121 04:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:21.121 bdev_null0 00:31:21.121 04:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.121 04:43:00 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:21.121 04:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.121 04:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:21.121 04:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.122 04:43:00 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:21.122 04:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.122 04:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:21.122 04:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.122 04:43:00 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:21.122 04:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.122 04:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:21.122 [2024-11-26 04:43:00.058680] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:21.122 04:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.122 04:43:00 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:21.122 04:43:00 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:21.122 04:43:00 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:21.122 04:43:00 -- nvmf/common.sh@520 -- # config=() 00:31:21.122 04:43:00 -- nvmf/common.sh@520 -- # local subsystem config 00:31:21.122 04:43:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:21.122 04:43:00 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:21.122 04:43:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:21.122 { 00:31:21.122 "params": { 00:31:21.122 "name": "Nvme$subsystem", 00:31:21.122 "trtype": "$TEST_TRANSPORT", 00:31:21.122 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:21.122 "adrfam": "ipv4", 00:31:21.122 "trsvcid": "$NVMF_PORT", 00:31:21.122 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:21.122 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:21.122 "hdgst": ${hdgst:-false}, 00:31:21.122 "ddgst": ${ddgst:-false} 00:31:21.122 }, 00:31:21.122 "method": "bdev_nvme_attach_controller" 00:31:21.122 } 00:31:21.122 EOF 00:31:21.122 )") 00:31:21.122 04:43:00 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:21.122 04:43:00 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:21.122 04:43:00 -- target/dif.sh@82 -- # gen_fio_conf 00:31:21.122 04:43:00 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:21.122 04:43:00 -- target/dif.sh@54 -- # local file 00:31:21.122 04:43:00 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:21.122 04:43:00 -- target/dif.sh@56 -- # cat 00:31:21.122 04:43:00 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:21.122 04:43:00 -- common/autotest_common.sh@1330 -- # shift 00:31:21.122 04:43:00 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:21.122 04:43:00 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:21.122 04:43:00 -- nvmf/common.sh@542 -- # cat 00:31:21.122 04:43:00 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:21.122 04:43:00 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:21.122 04:43:00 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:21.122 04:43:00 -- target/dif.sh@72 -- # (( file <= files )) 00:31:21.122 04:43:00 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:21.122 04:43:00 -- nvmf/common.sh@544 -- # jq . 00:31:21.122 04:43:00 -- nvmf/common.sh@545 -- # IFS=, 00:31:21.122 04:43:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:21.122 "params": { 00:31:21.122 "name": "Nvme0", 00:31:21.122 "trtype": "tcp", 00:31:21.122 "traddr": "10.0.0.2", 00:31:21.122 "adrfam": "ipv4", 00:31:21.122 "trsvcid": "4420", 00:31:21.122 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:21.122 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:21.122 "hdgst": false, 00:31:21.122 "ddgst": false 00:31:21.122 }, 00:31:21.122 "method": "bdev_nvme_attach_controller" 00:31:21.122 }' 00:31:21.122 04:43:00 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:21.122 04:43:00 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:21.122 04:43:00 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:21.122 04:43:00 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:21.122 04:43:00 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:21.122 04:43:00 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:21.122 04:43:00 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:21.122 04:43:00 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:21.122 04:43:00 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:21.122 04:43:00 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:21.122 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:21.122 ... 00:31:21.122 fio-3.35 00:31:21.122 Starting 3 threads 00:31:21.381 EAL: No free 2048 kB hugepages reported on node 1 00:31:21.639 [2024-11-26 04:43:00.744827] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:21.639 [2024-11-26 04:43:00.744884] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:26.899 00:31:26.899 filename0: (groupid=0, jobs=1): err= 0: pid=3058762: Tue Nov 26 04:43:05 2024 00:31:26.899 read: IOPS=245, BW=30.7MiB/s (32.2MB/s)(154MiB/5004msec) 00:31:26.899 slat (nsec): min=4384, max=54041, avg=18798.64, stdev=5554.56 00:31:26.899 clat (usec): min=4290, max=54762, avg=12189.21, stdev=7018.06 00:31:26.899 lat (usec): min=4304, max=54776, avg=12208.01, stdev=7018.01 00:31:26.899 clat percentiles (usec): 00:31:26.899 | 1.00th=[ 4621], 5.00th=[ 5604], 10.00th=[ 7570], 20.00th=[ 8455], 00:31:26.899 | 30.00th=[ 9241], 40.00th=[10552], 50.00th=[11600], 60.00th=[12387], 00:31:26.899 | 70.00th=[13042], 80.00th=[14091], 90.00th=[15008], 95.00th=[16581], 00:31:26.899 | 99.00th=[51643], 99.50th=[53216], 99.90th=[54264], 99.95th=[54789], 00:31:26.899 | 99.99th=[54789] 00:31:26.899 bw ( KiB/s): min=25344, max=37120, per=36.63%, avg=31416.60, stdev=3749.91, samples=10 00:31:26.899 iops : min= 198, max= 290, avg=245.40, stdev=29.35, samples=10 00:31:26.899 lat (msec) : 10=35.31%, 20=62.00%, 50=0.98%, 100=1.71% 00:31:26.899 cpu : usr=93.98%, sys=5.48%, ctx=21, majf=0, minf=120 00:31:26.899 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:26.899 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:26.899 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:26.899 issued rwts: total=1229,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:26.899 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:26.899 filename0: (groupid=0, jobs=1): err= 0: pid=3058763: Tue Nov 26 04:43:05 2024 00:31:26.900 read: IOPS=208, BW=26.0MiB/s (27.3MB/s)(130MiB/5004msec) 00:31:26.900 slat (nsec): min=4393, max=49574, avg=15095.35, stdev=5342.35 00:31:26.900 clat (usec): min=4920, max=56659, avg=14399.39, stdev=10854.61 00:31:26.900 lat (usec): min=4932, max=56678, avg=14414.49, stdev=10854.65 00:31:26.900 clat percentiles (usec): 00:31:26.900 | 1.00th=[ 5866], 5.00th=[ 7898], 10.00th=[ 8455], 20.00th=[ 9503], 00:31:26.900 | 30.00th=[10683], 40.00th=[11338], 50.00th=[11863], 60.00th=[12387], 00:31:26.900 | 70.00th=[12780], 80.00th=[13435], 90.00th=[15270], 95.00th=[50594], 00:31:26.900 | 99.00th=[54789], 99.50th=[55313], 99.90th=[55313], 99.95th=[56886], 00:31:26.900 | 99.99th=[56886] 00:31:26.900 bw ( KiB/s): min=12800, max=33024, per=30.98%, avg=26572.80, stdev=5834.95, samples=10 00:31:26.900 iops : min= 100, max= 258, avg=207.60, stdev=45.59, samples=10 00:31:26.900 lat (msec) : 10=23.54%, 20=68.97%, 50=2.31%, 100=5.19% 00:31:26.900 cpu : usr=93.44%, sys=6.08%, ctx=10, majf=0, minf=132 00:31:26.900 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:26.900 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:26.900 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:26.900 issued rwts: total=1041,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:26.900 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:26.900 filename0: (groupid=0, jobs=1): err= 0: pid=3058764: Tue Nov 26 04:43:05 2024 00:31:26.900 read: IOPS=216, BW=27.1MiB/s (28.4MB/s)(135MiB/5003msec) 00:31:26.900 slat (nsec): min=4697, max=63725, avg=15869.13, stdev=5382.24 00:31:26.900 clat (usec): min=4755, max=88498, avg=13838.02, stdev=10108.62 00:31:26.900 lat (usec): min=4767, max=88515, avg=13853.89, stdev=10108.04 00:31:26.900 clat percentiles (usec): 00:31:26.900 | 1.00th=[ 5473], 5.00th=[ 7963], 10.00th=[ 8586], 20.00th=[ 9372], 00:31:26.900 | 30.00th=[10290], 40.00th=[11207], 50.00th=[11863], 60.00th=[12387], 00:31:26.900 | 70.00th=[13173], 80.00th=[13960], 90.00th=[15533], 95.00th=[46924], 00:31:26.900 | 99.00th=[55837], 99.50th=[58983], 99.90th=[88605], 99.95th=[88605], 00:31:26.900 | 99.99th=[88605] 00:31:26.900 bw ( KiB/s): min=15872, max=37120, per=32.26%, avg=27673.60, stdev=6658.68, samples=10 00:31:26.900 iops : min= 124, max= 290, avg=216.20, stdev=52.02, samples=10 00:31:26.900 lat (msec) : 10=27.24%, 20=67.50%, 50=0.65%, 100=4.62% 00:31:26.900 cpu : usr=93.26%, sys=6.28%, ctx=13, majf=0, minf=170 00:31:26.900 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:26.900 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:26.900 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:26.900 issued rwts: total=1083,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:26.900 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:26.900 00:31:26.900 Run status group 0 (all jobs): 00:31:26.900 READ: bw=83.8MiB/s (87.8MB/s), 26.0MiB/s-30.7MiB/s (27.3MB/s-32.2MB/s), io=419MiB (439MB), run=5003-5004msec 00:31:27.158 04:43:06 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:27.158 04:43:06 -- target/dif.sh@43 -- # local sub 00:31:27.158 04:43:06 -- target/dif.sh@45 -- # for sub in "$@" 00:31:27.158 04:43:06 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:27.158 04:43:06 -- target/dif.sh@36 -- # local sub_id=0 00:31:27.158 04:43:06 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:27.158 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.158 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.158 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.158 04:43:06 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:27.159 04:43:06 -- target/dif.sh@109 -- # bs=4k 00:31:27.159 04:43:06 -- target/dif.sh@109 -- # numjobs=8 00:31:27.159 04:43:06 -- target/dif.sh@109 -- # iodepth=16 00:31:27.159 04:43:06 -- target/dif.sh@109 -- # runtime= 00:31:27.159 04:43:06 -- target/dif.sh@109 -- # files=2 00:31:27.159 04:43:06 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:27.159 04:43:06 -- target/dif.sh@28 -- # local sub 00:31:27.159 04:43:06 -- target/dif.sh@30 -- # for sub in "$@" 00:31:27.159 04:43:06 -- target/dif.sh@31 -- # create_subsystem 0 00:31:27.159 04:43:06 -- target/dif.sh@18 -- # local sub_id=0 00:31:27.159 04:43:06 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 bdev_null0 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 [2024-11-26 04:43:06.207339] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@30 -- # for sub in "$@" 00:31:27.159 04:43:06 -- target/dif.sh@31 -- # create_subsystem 1 00:31:27.159 04:43:06 -- target/dif.sh@18 -- # local sub_id=1 00:31:27.159 04:43:06 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 bdev_null1 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@30 -- # for sub in "$@" 00:31:27.159 04:43:06 -- target/dif.sh@31 -- # create_subsystem 2 00:31:27.159 04:43:06 -- target/dif.sh@18 -- # local sub_id=2 00:31:27.159 04:43:06 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 bdev_null2 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:27.159 04:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.159 04:43:06 -- common/autotest_common.sh@10 -- # set +x 00:31:27.159 04:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.159 04:43:06 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:27.159 04:43:06 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:27.159 04:43:06 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:27.159 04:43:06 -- nvmf/common.sh@520 -- # config=() 00:31:27.159 04:43:06 -- nvmf/common.sh@520 -- # local subsystem config 00:31:27.159 04:43:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:27.159 04:43:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:27.159 { 00:31:27.159 "params": { 00:31:27.159 "name": "Nvme$subsystem", 00:31:27.159 "trtype": "$TEST_TRANSPORT", 00:31:27.159 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:27.159 "adrfam": "ipv4", 00:31:27.159 "trsvcid": "$NVMF_PORT", 00:31:27.159 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:27.159 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:27.159 "hdgst": ${hdgst:-false}, 00:31:27.159 "ddgst": ${ddgst:-false} 00:31:27.159 }, 00:31:27.159 "method": "bdev_nvme_attach_controller" 00:31:27.159 } 00:31:27.159 EOF 00:31:27.159 )") 00:31:27.159 04:43:06 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:27.159 04:43:06 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:27.159 04:43:06 -- target/dif.sh@82 -- # gen_fio_conf 00:31:27.159 04:43:06 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:27.159 04:43:06 -- target/dif.sh@54 -- # local file 00:31:27.159 04:43:06 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:27.159 04:43:06 -- target/dif.sh@56 -- # cat 00:31:27.159 04:43:06 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:27.159 04:43:06 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:27.159 04:43:06 -- common/autotest_common.sh@1330 -- # shift 00:31:27.159 04:43:06 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:27.159 04:43:06 -- nvmf/common.sh@542 -- # cat 00:31:27.159 04:43:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:27.159 04:43:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:27.159 04:43:06 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:27.159 04:43:06 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:27.159 04:43:06 -- target/dif.sh@72 -- # (( file <= files )) 00:31:27.159 04:43:06 -- target/dif.sh@73 -- # cat 00:31:27.159 04:43:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:27.159 04:43:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:27.159 04:43:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:27.159 { 00:31:27.159 "params": { 00:31:27.159 "name": "Nvme$subsystem", 00:31:27.159 "trtype": "$TEST_TRANSPORT", 00:31:27.159 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:27.159 "adrfam": "ipv4", 00:31:27.159 "trsvcid": "$NVMF_PORT", 00:31:27.159 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:27.159 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:27.159 "hdgst": ${hdgst:-false}, 00:31:27.159 "ddgst": ${ddgst:-false} 00:31:27.159 }, 00:31:27.159 "method": "bdev_nvme_attach_controller" 00:31:27.159 } 00:31:27.159 EOF 00:31:27.159 )") 00:31:27.159 04:43:06 -- nvmf/common.sh@542 -- # cat 00:31:27.159 04:43:06 -- target/dif.sh@72 -- # (( file++ )) 00:31:27.159 04:43:06 -- target/dif.sh@72 -- # (( file <= files )) 00:31:27.159 04:43:06 -- target/dif.sh@73 -- # cat 00:31:27.159 04:43:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:27.159 04:43:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:27.159 { 00:31:27.159 "params": { 00:31:27.159 "name": "Nvme$subsystem", 00:31:27.159 "trtype": "$TEST_TRANSPORT", 00:31:27.159 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:27.159 "adrfam": "ipv4", 00:31:27.159 "trsvcid": "$NVMF_PORT", 00:31:27.159 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:27.159 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:27.159 "hdgst": ${hdgst:-false}, 00:31:27.159 "ddgst": ${ddgst:-false} 00:31:27.159 }, 00:31:27.159 "method": "bdev_nvme_attach_controller" 00:31:27.159 } 00:31:27.159 EOF 00:31:27.159 )") 00:31:27.159 04:43:06 -- target/dif.sh@72 -- # (( file++ )) 00:31:27.159 04:43:06 -- target/dif.sh@72 -- # (( file <= files )) 00:31:27.159 04:43:06 -- nvmf/common.sh@542 -- # cat 00:31:27.159 04:43:06 -- nvmf/common.sh@544 -- # jq . 00:31:27.159 04:43:06 -- nvmf/common.sh@545 -- # IFS=, 00:31:27.159 04:43:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:27.159 "params": { 00:31:27.159 "name": "Nvme0", 00:31:27.159 "trtype": "tcp", 00:31:27.159 "traddr": "10.0.0.2", 00:31:27.159 "adrfam": "ipv4", 00:31:27.159 "trsvcid": "4420", 00:31:27.159 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:27.159 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:27.159 "hdgst": false, 00:31:27.159 "ddgst": false 00:31:27.159 }, 00:31:27.159 "method": "bdev_nvme_attach_controller" 00:31:27.159 },{ 00:31:27.159 "params": { 00:31:27.159 "name": "Nvme1", 00:31:27.159 "trtype": "tcp", 00:31:27.159 "traddr": "10.0.0.2", 00:31:27.160 "adrfam": "ipv4", 00:31:27.160 "trsvcid": "4420", 00:31:27.160 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:27.160 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:27.160 "hdgst": false, 00:31:27.160 "ddgst": false 00:31:27.160 }, 00:31:27.160 "method": "bdev_nvme_attach_controller" 00:31:27.160 },{ 00:31:27.160 "params": { 00:31:27.160 "name": "Nvme2", 00:31:27.160 "trtype": "tcp", 00:31:27.160 "traddr": "10.0.0.2", 00:31:27.160 "adrfam": "ipv4", 00:31:27.160 "trsvcid": "4420", 00:31:27.160 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:27.160 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:27.160 "hdgst": false, 00:31:27.160 "ddgst": false 00:31:27.160 }, 00:31:27.160 "method": "bdev_nvme_attach_controller" 00:31:27.160 }' 00:31:27.160 04:43:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:27.160 04:43:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:27.160 04:43:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:27.160 04:43:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:27.160 04:43:06 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:27.160 04:43:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:27.160 04:43:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:27.160 04:43:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:27.160 04:43:06 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:27.160 04:43:06 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:27.419 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:27.419 ... 00:31:27.419 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:27.419 ... 00:31:27.419 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:27.419 ... 00:31:27.419 fio-3.35 00:31:27.419 Starting 24 threads 00:31:27.419 EAL: No free 2048 kB hugepages reported on node 1 00:31:28.354 [2024-11-26 04:43:07.316146] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:28.354 [2024-11-26 04:43:07.316193] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:38.392 00:31:38.392 filename0: (groupid=0, jobs=1): err= 0: pid=3059542: Tue Nov 26 04:43:17 2024 00:31:38.392 read: IOPS=271, BW=1086KiB/s (1112kB/s)(10.6MiB/10026msec) 00:31:38.392 slat (usec): min=7, max=133, avg=26.58, stdev=24.73 00:31:38.392 clat (msec): min=18, max=471, avg=58.74, stdev=65.70 00:31:38.392 lat (msec): min=18, max=471, avg=58.77, stdev=65.70 00:31:38.392 clat percentiles (msec): 00:31:38.392 | 1.00th=[ 28], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:31:38.392 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.392 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 176], 95.00th=[ 213], 00:31:38.392 | 99.00th=[ 292], 99.50th=[ 359], 99.90th=[ 472], 99.95th=[ 472], 00:31:38.392 | 99.99th=[ 472] 00:31:38.392 bw ( KiB/s): min= 176, max= 2048, per=4.36%, avg=1082.40, stdev=864.44, samples=20 00:31:38.392 iops : min= 44, max= 512, avg=270.60, stdev=216.11, samples=20 00:31:38.392 lat (msec) : 20=0.44%, 50=82.66%, 250=14.99%, 500=1.91% 00:31:38.392 cpu : usr=97.86%, sys=1.74%, ctx=30, majf=0, minf=41 00:31:38.392 IO depths : 1=2.3%, 2=8.0%, 4=23.3%, 8=56.1%, 16=10.2%, 32=0.0%, >=64=0.0% 00:31:38.392 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.392 complete : 0=0.0%, 4=93.8%, 8=0.6%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.392 issued rwts: total=2722,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.392 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.392 filename0: (groupid=0, jobs=1): err= 0: pid=3059543: Tue Nov 26 04:43:17 2024 00:31:38.392 read: IOPS=269, BW=1077KiB/s (1103kB/s)(10.5MiB/10026msec) 00:31:38.392 slat (usec): min=7, max=104, avg=32.29, stdev=22.11 00:31:38.392 clat (msec): min=3, max=358, avg=59.14, stdev=68.52 00:31:38.392 lat (msec): min=3, max=358, avg=59.17, stdev=68.52 00:31:38.392 clat percentiles (msec): 00:31:38.392 | 1.00th=[ 20], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.392 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.392 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 197], 95.00th=[ 226], 00:31:38.392 | 99.00th=[ 300], 99.50th=[ 334], 99.90th=[ 359], 99.95th=[ 359], 00:31:38.392 | 99.99th=[ 359] 00:31:38.392 bw ( KiB/s): min= 208, max= 2048, per=4.32%, avg=1073.60, stdev=885.14, samples=20 00:31:38.392 iops : min= 52, max= 512, avg=268.40, stdev=221.28, samples=20 00:31:38.392 lat (msec) : 4=0.22%, 10=0.37%, 20=0.44%, 50=83.33%, 250=12.89% 00:31:38.392 lat (msec) : 500=2.74% 00:31:38.392 cpu : usr=98.39%, sys=1.07%, ctx=81, majf=0, minf=25 00:31:38.392 IO depths : 1=4.9%, 2=10.6%, 4=23.0%, 8=53.9%, 16=7.6%, 32=0.0%, >=64=0.0% 00:31:38.392 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.392 complete : 0=0.0%, 4=93.6%, 8=0.6%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.392 issued rwts: total=2700,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.392 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.392 filename0: (groupid=0, jobs=1): err= 0: pid=3059544: Tue Nov 26 04:43:17 2024 00:31:38.392 read: IOPS=260, BW=1042KiB/s (1067kB/s)(10.2MiB/10013msec) 00:31:38.392 slat (usec): min=5, max=170, avg=46.51, stdev=21.77 00:31:38.392 clat (msec): min=2, max=450, avg=61.03, stdev=81.44 00:31:38.392 lat (msec): min=3, max=450, avg=61.07, stdev=81.45 00:31:38.392 clat percentiles (msec): 00:31:38.392 | 1.00th=[ 11], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.392 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.392 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 224], 95.00th=[ 284], 00:31:38.392 | 99.00th=[ 305], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], 00:31:38.392 | 99.99th=[ 451] 00:31:38.392 bw ( KiB/s): min= 128, max= 2048, per=4.17%, avg=1036.80, stdev=893.87, samples=20 00:31:38.392 iops : min= 32, max= 512, avg=259.20, stdev=223.47, samples=20 00:31:38.392 lat (msec) : 4=0.61%, 10=0.08%, 20=0.61%, 50=85.74%, 100=0.15% 00:31:38.392 lat (msec) : 250=4.22%, 500=8.59% 00:31:38.392 cpu : usr=97.06%, sys=1.72%, ctx=141, majf=0, minf=19 00:31:38.392 IO depths : 1=6.1%, 2=12.3%, 4=24.8%, 8=50.4%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:38.392 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.392 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.392 issued rwts: total=2608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.392 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.392 filename0: (groupid=0, jobs=1): err= 0: pid=3059545: Tue Nov 26 04:43:17 2024 00:31:38.392 read: IOPS=256, BW=1026KiB/s (1050kB/s)(10.0MiB/10027msec) 00:31:38.392 slat (usec): min=8, max=292, avg=40.61, stdev=31.43 00:31:38.392 clat (msec): min=12, max=506, avg=61.99, stdev=85.87 00:31:38.392 lat (msec): min=12, max=506, avg=62.03, stdev=85.88 00:31:38.392 clat percentiles (msec): 00:31:38.392 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:31:38.392 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.392 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 228], 95.00th=[ 284], 00:31:38.392 | 99.00th=[ 451], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], 00:31:38.392 | 99.99th=[ 506] 00:31:38.392 bw ( KiB/s): min= 128, max= 2064, per=4.12%, avg=1024.00, stdev=913.76, samples=20 00:31:38.392 iops : min= 32, max= 516, avg=256.00, stdev=228.44, samples=20 00:31:38.392 lat (msec) : 20=0.08%, 50=87.40%, 100=0.08%, 250=3.73%, 500=8.09% 00:31:38.392 lat (msec) : 750=0.62% 00:31:38.392 cpu : usr=96.11%, sys=2.04%, ctx=157, majf=0, minf=23 00:31:38.392 IO depths : 1=3.3%, 2=9.6%, 4=25.0%, 8=52.9%, 16=9.2%, 32=0.0%, >=64=0.0% 00:31:38.392 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.392 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.392 issued rwts: total=2571,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.392 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.392 filename0: (groupid=0, jobs=1): err= 0: pid=3059546: Tue Nov 26 04:43:17 2024 00:31:38.392 read: IOPS=257, BW=1028KiB/s (1053kB/s)(10.1MiB/10022msec) 00:31:38.392 slat (usec): min=7, max=118, avg=41.84, stdev=21.52 00:31:38.392 clat (msec): min=13, max=562, avg=61.86, stdev=86.56 00:31:38.392 lat (msec): min=13, max=563, avg=61.90, stdev=86.55 00:31:38.392 clat percentiles (msec): 00:31:38.392 | 1.00th=[ 28], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.392 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.392 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 230], 95.00th=[ 284], 00:31:38.392 | 99.00th=[ 397], 99.50th=[ 451], 99.90th=[ 506], 99.95th=[ 567], 00:31:38.392 | 99.99th=[ 567] 00:31:38.392 bw ( KiB/s): min= 128, max= 2048, per=3.91%, avg=970.11, stdev=913.31, samples=19 00:31:38.392 iops : min= 32, max= 512, avg=242.53, stdev=228.33, samples=19 00:31:38.392 lat (msec) : 20=0.39%, 50=87.58%, 250=2.95%, 500=8.70%, 750=0.39% 00:31:38.392 cpu : usr=98.51%, sys=1.07%, ctx=20, majf=0, minf=28 00:31:38.392 IO depths : 1=6.0%, 2=12.2%, 4=24.9%, 8=50.4%, 16=6.5%, 32=0.0%, >=64=0.0% 00:31:38.392 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.392 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.392 issued rwts: total=2576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.392 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.392 filename0: (groupid=0, jobs=1): err= 0: pid=3059547: Tue Nov 26 04:43:17 2024 00:31:38.392 read: IOPS=258, BW=1034KiB/s (1059kB/s)(10.1MiB/10026msec) 00:31:38.392 slat (usec): min=6, max=113, avg=53.97, stdev=21.17 00:31:38.392 clat (msec): min=27, max=424, avg=61.43, stdev=83.35 00:31:38.392 lat (msec): min=27, max=424, avg=61.48, stdev=83.36 00:31:38.392 clat percentiles (msec): 00:31:38.392 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.392 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.392 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 230], 95.00th=[ 284], 00:31:38.392 | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 418], 99.95th=[ 426], 00:31:38.392 | 99.99th=[ 426] 00:31:38.392 bw ( KiB/s): min= 128, max= 2048, per=4.15%, avg=1030.40, stdev=908.30, samples=20 00:31:38.392 iops : min= 32, max= 512, avg=257.60, stdev=227.07, samples=20 00:31:38.392 lat (msec) : 50=87.04%, 100=0.62%, 250=3.51%, 500=8.83% 00:31:38.392 cpu : usr=98.35%, sys=1.06%, ctx=24, majf=0, minf=21 00:31:38.392 IO depths : 1=5.3%, 2=11.5%, 4=24.8%, 8=51.2%, 16=7.2%, 32=0.0%, >=64=0.0% 00:31:38.392 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.392 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.392 issued rwts: total=2592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.392 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.392 filename0: (groupid=0, jobs=1): err= 0: pid=3059548: Tue Nov 26 04:43:17 2024 00:31:38.392 read: IOPS=255, BW=1022KiB/s (1046kB/s)(10.0MiB/10024msec) 00:31:38.392 slat (usec): min=3, max=187, avg=50.99, stdev=21.27 00:31:38.392 clat (msec): min=26, max=575, avg=62.21, stdev=88.29 00:31:38.392 lat (msec): min=27, max=575, avg=62.26, stdev=88.30 00:31:38.392 clat percentiles (msec): 00:31:38.392 | 1.00th=[ 29], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.393 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.393 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 228], 95.00th=[ 284], 00:31:38.393 | 99.00th=[ 451], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 575], 00:31:38.393 | 99.99th=[ 575] 00:31:38.393 bw ( KiB/s): min= 128, max= 2048, per=3.88%, avg=963.37, stdev=911.48, samples=19 00:31:38.393 iops : min= 32, max= 512, avg=240.84, stdev=227.87, samples=19 00:31:38.393 lat (msec) : 50=88.13%, 250=2.89%, 500=8.36%, 750=0.62% 00:31:38.393 cpu : usr=98.01%, sys=1.27%, ctx=23, majf=0, minf=22 00:31:38.393 IO depths : 1=5.6%, 2=11.8%, 4=24.7%, 8=51.0%, 16=6.9%, 32=0.0%, >=64=0.0% 00:31:38.393 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 issued rwts: total=2560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.393 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.393 filename0: (groupid=0, jobs=1): err= 0: pid=3059549: Tue Nov 26 04:43:17 2024 00:31:38.393 read: IOPS=255, BW=1022KiB/s (1046kB/s)(10.0MiB/10020msec) 00:31:38.393 slat (usec): min=11, max=205, avg=42.50, stdev=28.95 00:31:38.393 clat (msec): min=26, max=490, avg=62.18, stdev=88.00 00:31:38.393 lat (msec): min=26, max=490, avg=62.23, stdev=87.99 00:31:38.393 clat percentiles (msec): 00:31:38.393 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.393 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.393 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 243], 95.00th=[ 284], 00:31:38.393 | 99.00th=[ 388], 99.50th=[ 489], 99.90th=[ 493], 99.95th=[ 493], 00:31:38.393 | 99.99th=[ 493] 00:31:38.393 bw ( KiB/s): min= 128, max= 2048, per=3.88%, avg=963.37, stdev=911.37, samples=19 00:31:38.393 iops : min= 32, max= 512, avg=240.84, stdev=227.84, samples=19 00:31:38.393 lat (msec) : 50=88.13%, 250=2.81%, 500=9.06% 00:31:38.393 cpu : usr=97.75%, sys=1.37%, ctx=97, majf=0, minf=27 00:31:38.393 IO depths : 1=5.9%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:31:38.393 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 issued rwts: total=2560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.393 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.393 filename1: (groupid=0, jobs=1): err= 0: pid=3059550: Tue Nov 26 04:43:17 2024 00:31:38.393 read: IOPS=259, BW=1037KiB/s (1062kB/s)(10.1MiB/10013msec) 00:31:38.393 slat (usec): min=7, max=246, avg=38.03, stdev=18.43 00:31:38.393 clat (msec): min=17, max=490, avg=61.38, stdev=87.24 00:31:38.393 lat (msec): min=17, max=490, avg=61.41, stdev=87.24 00:31:38.393 clat percentiles (msec): 00:31:38.393 | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 29], 20.00th=[ 31], 00:31:38.393 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.393 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 243], 95.00th=[ 284], 00:31:38.393 | 99.00th=[ 388], 99.50th=[ 489], 99.90th=[ 493], 99.95th=[ 493], 00:31:38.393 | 99.99th=[ 493] 00:31:38.393 bw ( KiB/s): min= 128, max= 2192, per=3.94%, avg=978.53, stdev=931.89, samples=19 00:31:38.393 iops : min= 32, max= 548, avg=244.63, stdev=232.97, samples=19 00:31:38.393 lat (msec) : 20=3.66%, 50=84.17%, 100=0.46%, 250=2.62%, 500=9.09% 00:31:38.393 cpu : usr=95.51%, sys=2.50%, ctx=131, majf=0, minf=23 00:31:38.393 IO depths : 1=4.5%, 2=9.7%, 4=21.4%, 8=56.1%, 16=8.2%, 32=0.0%, >=64=0.0% 00:31:38.393 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 complete : 0=0.0%, 4=93.2%, 8=1.4%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 issued rwts: total=2596,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.393 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.393 filename1: (groupid=0, jobs=1): err= 0: pid=3059551: Tue Nov 26 04:43:17 2024 00:31:38.393 read: IOPS=257, BW=1028KiB/s (1053kB/s)(10.1MiB/10027msec) 00:31:38.393 slat (usec): min=8, max=249, avg=43.57, stdev=26.03 00:31:38.393 clat (msec): min=12, max=490, avg=61.85, stdev=84.83 00:31:38.393 lat (msec): min=13, max=490, avg=61.90, stdev=84.84 00:31:38.393 clat percentiles (msec): 00:31:38.393 | 1.00th=[ 27], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.393 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.393 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 243], 95.00th=[ 284], 00:31:38.393 | 99.00th=[ 388], 99.50th=[ 489], 99.90th=[ 493], 99.95th=[ 493], 00:31:38.393 | 99.99th=[ 493] 00:31:38.393 bw ( KiB/s): min= 128, max= 2096, per=4.13%, avg=1026.40, stdev=916.52, samples=20 00:31:38.393 iops : min= 32, max= 524, avg=256.60, stdev=229.13, samples=20 00:31:38.393 lat (msec) : 20=0.23%, 50=87.35%, 250=3.65%, 500=8.77% 00:31:38.393 cpu : usr=94.72%, sys=2.80%, ctx=393, majf=0, minf=19 00:31:38.393 IO depths : 1=3.4%, 2=9.6%, 4=24.7%, 8=53.2%, 16=9.1%, 32=0.0%, >=64=0.0% 00:31:38.393 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 issued rwts: total=2577,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.393 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.393 filename1: (groupid=0, jobs=1): err= 0: pid=3059552: Tue Nov 26 04:43:17 2024 00:31:38.393 read: IOPS=260, BW=1040KiB/s (1065kB/s)(10.2MiB/10026msec) 00:31:38.393 slat (usec): min=8, max=109, avg=30.30, stdev=20.31 00:31:38.393 clat (msec): min=3, max=450, avg=61.27, stdev=80.99 00:31:38.393 lat (msec): min=3, max=450, avg=61.30, stdev=81.00 00:31:38.393 clat percentiles (msec): 00:31:38.393 | 1.00th=[ 28], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:31:38.393 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.393 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 224], 95.00th=[ 284], 00:31:38.393 | 99.00th=[ 305], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], 00:31:38.393 | 99.99th=[ 451] 00:31:38.393 bw ( KiB/s): min= 128, max= 2048, per=4.17%, avg=1036.80, stdev=914.48, samples=20 00:31:38.393 iops : min= 32, max= 512, avg=259.20, stdev=228.62, samples=20 00:31:38.393 lat (msec) : 4=0.31%, 10=0.31%, 50=86.50%, 250=4.91%, 500=7.98% 00:31:38.393 cpu : usr=98.29%, sys=1.15%, ctx=67, majf=0, minf=33 00:31:38.393 IO depths : 1=5.0%, 2=11.2%, 4=24.8%, 8=51.4%, 16=7.5%, 32=0.0%, >=64=0.0% 00:31:38.393 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 issued rwts: total=2608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.393 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.393 filename1: (groupid=0, jobs=1): err= 0: pid=3059553: Tue Nov 26 04:43:17 2024 00:31:38.393 read: IOPS=257, BW=1031KiB/s (1056kB/s)(10.1MiB/10017msec) 00:31:38.393 slat (usec): min=7, max=107, avg=49.84, stdev=21.49 00:31:38.393 clat (msec): min=18, max=555, avg=61.60, stdev=84.92 00:31:38.393 lat (msec): min=18, max=555, avg=61.65, stdev=84.91 00:31:38.393 clat percentiles (msec): 00:31:38.393 | 1.00th=[ 28], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.393 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.393 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 230], 95.00th=[ 284], 00:31:38.393 | 99.00th=[ 347], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 558], 00:31:38.393 | 99.99th=[ 558] 00:31:38.393 bw ( KiB/s): min= 127, max= 2048, per=3.91%, avg=972.58, stdev=907.95, samples=19 00:31:38.393 iops : min= 31, max= 512, avg=243.11, stdev=227.03, samples=19 00:31:38.393 lat (msec) : 20=0.46%, 50=87.14%, 100=0.39%, 250=3.10%, 500=8.83% 00:31:38.393 lat (msec) : 750=0.08% 00:31:38.393 cpu : usr=98.41%, sys=1.18%, ctx=23, majf=0, minf=32 00:31:38.393 IO depths : 1=5.8%, 2=11.9%, 4=24.6%, 8=51.0%, 16=6.7%, 32=0.0%, >=64=0.0% 00:31:38.393 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 complete : 0=0.0%, 4=94.0%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 issued rwts: total=2582,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.393 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.393 filename1: (groupid=0, jobs=1): err= 0: pid=3059554: Tue Nov 26 04:43:17 2024 00:31:38.393 read: IOPS=256, BW=1026KiB/s (1050kB/s)(10.0MiB/10027msec) 00:31:38.393 slat (usec): min=8, max=135, avg=55.88, stdev=22.11 00:31:38.393 clat (msec): min=26, max=489, avg=61.87, stdev=84.72 00:31:38.393 lat (msec): min=26, max=489, avg=61.93, stdev=84.73 00:31:38.393 clat percentiles (msec): 00:31:38.393 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.393 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.393 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 230], 95.00th=[ 284], 00:31:38.393 | 99.00th=[ 388], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], 00:31:38.393 | 99.99th=[ 489] 00:31:38.393 bw ( KiB/s): min= 128, max= 2048, per=4.12%, avg=1024.00, stdev=913.53, samples=20 00:31:38.393 iops : min= 32, max= 512, avg=256.00, stdev=228.38, samples=20 00:31:38.393 lat (msec) : 50=87.55%, 250=3.66%, 500=8.79% 00:31:38.393 cpu : usr=98.27%, sys=1.13%, ctx=26, majf=0, minf=20 00:31:38.393 IO depths : 1=5.5%, 2=11.7%, 4=25.0%, 8=50.7%, 16=7.0%, 32=0.0%, >=64=0.0% 00:31:38.393 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 issued rwts: total=2571,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.393 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.393 filename1: (groupid=0, jobs=1): err= 0: pid=3059555: Tue Nov 26 04:43:17 2024 00:31:38.393 read: IOPS=255, BW=1022KiB/s (1046kB/s)(9.99MiB/10013msec) 00:31:38.393 slat (usec): min=8, max=201, avg=43.62, stdev=35.57 00:31:38.393 clat (msec): min=16, max=490, avg=62.31, stdev=87.06 00:31:38.393 lat (msec): min=16, max=490, avg=62.35, stdev=87.07 00:31:38.393 clat percentiles (msec): 00:31:38.393 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:31:38.393 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.393 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 245], 95.00th=[ 284], 00:31:38.393 | 99.00th=[ 388], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], 00:31:38.393 | 99.99th=[ 489] 00:31:38.393 bw ( KiB/s): min= 128, max= 2048, per=3.87%, avg=962.53, stdev=910.46, samples=19 00:31:38.393 iops : min= 32, max= 512, avg=240.63, stdev=227.61, samples=19 00:31:38.393 lat (msec) : 20=0.08%, 50=87.88%, 100=0.16%, 250=2.35%, 500=9.54% 00:31:38.393 cpu : usr=97.93%, sys=1.39%, ctx=34, majf=0, minf=30 00:31:38.393 IO depths : 1=0.6%, 2=6.8%, 4=24.9%, 8=55.9%, 16=11.9%, 32=0.0%, >=64=0.0% 00:31:38.393 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 complete : 0=0.0%, 4=94.4%, 8=0.1%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.393 issued rwts: total=2558,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.393 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.394 filename1: (groupid=0, jobs=1): err= 0: pid=3059556: Tue Nov 26 04:43:17 2024 00:31:38.394 read: IOPS=266, BW=1066KiB/s (1092kB/s)(10.4MiB/10018msec) 00:31:38.394 slat (usec): min=7, max=123, avg=25.20, stdev=23.43 00:31:38.394 clat (msec): min=22, max=358, avg=59.82, stdev=70.03 00:31:38.394 lat (msec): min=22, max=358, avg=59.85, stdev=70.02 00:31:38.394 clat percentiles (msec): 00:31:38.394 | 1.00th=[ 27], 5.00th=[ 30], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.394 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.394 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 192], 95.00th=[ 239], 00:31:38.394 | 99.00th=[ 317], 99.50th=[ 338], 99.90th=[ 359], 99.95th=[ 359], 00:31:38.394 | 99.99th=[ 359] 00:31:38.394 bw ( KiB/s): min= 176, max= 2048, per=4.27%, avg=1061.60, stdev=878.77, samples=20 00:31:38.394 iops : min= 44, max= 512, avg=265.40, stdev=219.69, samples=20 00:31:38.394 lat (msec) : 50=84.49%, 250=12.58%, 500=2.92% 00:31:38.394 cpu : usr=98.27%, sys=1.35%, ctx=13, majf=0, minf=33 00:31:38.394 IO depths : 1=4.6%, 2=9.9%, 4=21.6%, 8=56.0%, 16=7.9%, 32=0.0%, >=64=0.0% 00:31:38.394 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 complete : 0=0.0%, 4=93.2%, 8=1.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 issued rwts: total=2670,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.394 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.394 filename1: (groupid=0, jobs=1): err= 0: pid=3059557: Tue Nov 26 04:43:17 2024 00:31:38.394 read: IOPS=256, BW=1026KiB/s (1050kB/s)(10.0MiB/10013msec) 00:31:38.394 slat (usec): min=7, max=112, avg=43.18, stdev=20.78 00:31:38.394 clat (msec): min=9, max=490, avg=62.02, stdev=87.31 00:31:38.394 lat (msec): min=9, max=490, avg=62.07, stdev=87.31 00:31:38.394 clat percentiles (msec): 00:31:38.394 | 1.00th=[ 20], 5.00th=[ 30], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.394 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.394 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 243], 95.00th=[ 284], 00:31:38.394 | 99.00th=[ 388], 99.50th=[ 489], 99.90th=[ 493], 99.95th=[ 493], 00:31:38.394 | 99.99th=[ 493] 00:31:38.394 bw ( KiB/s): min= 128, max= 2064, per=3.88%, avg=964.21, stdev=912.43, samples=19 00:31:38.394 iops : min= 32, max= 516, avg=241.05, stdev=228.11, samples=19 00:31:38.394 lat (msec) : 10=0.16%, 20=1.56%, 50=86.14%, 100=0.31%, 250=2.49% 00:31:38.394 lat (msec) : 500=9.35% 00:31:38.394 cpu : usr=98.21%, sys=1.23%, ctx=32, majf=0, minf=27 00:31:38.394 IO depths : 1=1.9%, 2=7.7%, 4=23.4%, 8=56.3%, 16=10.7%, 32=0.0%, >=64=0.0% 00:31:38.394 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 complete : 0=0.0%, 4=93.9%, 8=0.6%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 issued rwts: total=2568,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.394 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.394 filename2: (groupid=0, jobs=1): err= 0: pid=3059558: Tue Nov 26 04:43:17 2024 00:31:38.394 read: IOPS=255, BW=1023KiB/s (1047kB/s)(10.0MiB/10012msec) 00:31:38.394 slat (usec): min=8, max=138, avg=47.38, stdev=18.21 00:31:38.394 clat (msec): min=18, max=490, avg=62.14, stdev=87.18 00:31:38.394 lat (msec): min=18, max=490, avg=62.19, stdev=87.19 00:31:38.394 clat percentiles (msec): 00:31:38.394 | 1.00th=[ 28], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.394 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.394 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 243], 95.00th=[ 284], 00:31:38.394 | 99.00th=[ 388], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], 00:31:38.394 | 99.99th=[ 493] 00:31:38.394 bw ( KiB/s): min= 128, max= 2048, per=3.88%, avg=963.37, stdev=911.48, samples=19 00:31:38.394 iops : min= 32, max= 512, avg=240.84, stdev=227.87, samples=19 00:31:38.394 lat (msec) : 20=0.16%, 50=87.97%, 250=2.50%, 500=9.38% 00:31:38.394 cpu : usr=97.39%, sys=1.54%, ctx=101, majf=0, minf=24 00:31:38.394 IO depths : 1=4.7%, 2=10.8%, 4=24.5%, 8=52.0%, 16=7.9%, 32=0.0%, >=64=0.0% 00:31:38.394 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 complete : 0=0.0%, 4=94.1%, 8=0.2%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 issued rwts: total=2560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.394 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.394 filename2: (groupid=0, jobs=1): err= 0: pid=3059559: Tue Nov 26 04:43:17 2024 00:31:38.394 read: IOPS=255, BW=1020KiB/s (1045kB/s)(9.98MiB/10011msec) 00:31:38.394 slat (usec): min=8, max=148, avg=45.36, stdev=21.66 00:31:38.394 clat (msec): min=19, max=574, avg=62.32, stdev=87.35 00:31:38.394 lat (msec): min=19, max=574, avg=62.37, stdev=87.36 00:31:38.394 clat percentiles (msec): 00:31:38.394 | 1.00th=[ 24], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.394 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.394 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 245], 95.00th=[ 284], 00:31:38.394 | 99.00th=[ 388], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 575], 00:31:38.394 | 99.99th=[ 575] 00:31:38.394 bw ( KiB/s): min= 128, max= 2072, per=3.87%, avg=960.84, stdev=908.42, samples=19 00:31:38.394 iops : min= 32, max= 518, avg=240.21, stdev=227.10, samples=19 00:31:38.394 lat (msec) : 20=0.12%, 50=87.98%, 250=2.51%, 500=9.32%, 750=0.08% 00:31:38.394 cpu : usr=98.13%, sys=1.19%, ctx=99, majf=0, minf=27 00:31:38.394 IO depths : 1=3.8%, 2=8.8%, 4=22.3%, 8=56.1%, 16=9.0%, 32=0.0%, >=64=0.0% 00:31:38.394 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 complete : 0=0.0%, 4=93.5%, 8=1.1%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 issued rwts: total=2554,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.394 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.394 filename2: (groupid=0, jobs=1): err= 0: pid=3059560: Tue Nov 26 04:43:17 2024 00:31:38.394 read: IOPS=255, BW=1023KiB/s (1047kB/s)(10.0MiB/10014msec) 00:31:38.394 slat (usec): min=12, max=218, avg=43.49, stdev=30.49 00:31:38.394 clat (msec): min=7, max=490, avg=62.16, stdev=87.38 00:31:38.394 lat (msec): min=8, max=490, avg=62.21, stdev=87.37 00:31:38.394 clat percentiles (msec): 00:31:38.394 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.394 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.394 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 243], 95.00th=[ 284], 00:31:38.394 | 99.00th=[ 388], 99.50th=[ 489], 99.90th=[ 493], 99.95th=[ 493], 00:31:38.394 | 99.99th=[ 493] 00:31:38.394 bw ( KiB/s): min= 128, max= 2064, per=3.88%, avg=963.37, stdev=911.74, samples=19 00:31:38.394 iops : min= 32, max= 516, avg=240.84, stdev=227.94, samples=19 00:31:38.394 lat (msec) : 10=0.08%, 50=87.97%, 100=0.08%, 250=2.50%, 500=9.38% 00:31:38.394 cpu : usr=98.25%, sys=1.07%, ctx=49, majf=0, minf=19 00:31:38.394 IO depths : 1=4.6%, 2=10.8%, 4=25.0%, 8=51.7%, 16=7.9%, 32=0.0%, >=64=0.0% 00:31:38.394 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 issued rwts: total=2560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.394 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.394 filename2: (groupid=0, jobs=1): err= 0: pid=3059561: Tue Nov 26 04:43:17 2024 00:31:38.394 read: IOPS=258, BW=1034KiB/s (1059kB/s)(10.1MiB/10026msec) 00:31:38.394 slat (usec): min=8, max=108, avg=41.10, stdev=17.96 00:31:38.394 clat (msec): min=26, max=389, avg=61.58, stdev=82.09 00:31:38.394 lat (msec): min=26, max=389, avg=61.62, stdev=82.08 00:31:38.394 clat percentiles (msec): 00:31:38.394 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.394 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.394 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 230], 95.00th=[ 284], 00:31:38.394 | 99.00th=[ 372], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:31:38.394 | 99.99th=[ 388] 00:31:38.394 bw ( KiB/s): min= 128, max= 2048, per=4.15%, avg=1030.40, stdev=908.40, samples=20 00:31:38.394 iops : min= 32, max= 512, avg=257.60, stdev=227.10, samples=20 00:31:38.394 lat (msec) : 50=87.04%, 250=3.70%, 500=9.26% 00:31:38.394 cpu : usr=96.94%, sys=1.90%, ctx=127, majf=0, minf=22 00:31:38.394 IO depths : 1=1.5%, 2=7.8%, 4=25.0%, 8=54.7%, 16=11.0%, 32=0.0%, >=64=0.0% 00:31:38.394 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 issued rwts: total=2592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.394 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.394 filename2: (groupid=0, jobs=1): err= 0: pid=3059562: Tue Nov 26 04:43:17 2024 00:31:38.394 read: IOPS=257, BW=1028KiB/s (1053kB/s)(10.1MiB/10023msec) 00:31:38.394 slat (nsec): min=7622, max=95625, avg=44566.93, stdev=16818.10 00:31:38.394 clat (msec): min=27, max=591, avg=61.85, stdev=85.37 00:31:38.394 lat (msec): min=27, max=591, avg=61.89, stdev=85.36 00:31:38.394 clat percentiles (msec): 00:31:38.394 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.394 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.394 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 230], 95.00th=[ 284], 00:31:38.394 | 99.00th=[ 372], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 592], 00:31:38.394 | 99.99th=[ 592] 00:31:38.394 bw ( KiB/s): min= 112, max= 2048, per=3.91%, avg=970.11, stdev=906.23, samples=19 00:31:38.394 iops : min= 28, max= 512, avg=242.53, stdev=226.56, samples=19 00:31:38.394 lat (msec) : 50=87.58%, 250=2.87%, 500=9.47%, 750=0.08% 00:31:38.394 cpu : usr=98.49%, sys=1.10%, ctx=33, majf=0, minf=31 00:31:38.394 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:31:38.394 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.394 issued rwts: total=2576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.394 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.394 filename2: (groupid=0, jobs=1): err= 0: pid=3059563: Tue Nov 26 04:43:17 2024 00:31:38.394 read: IOPS=262, BW=1050KiB/s (1075kB/s)(10.3MiB/10017msec) 00:31:38.394 slat (usec): min=3, max=131, avg=28.52, stdev=23.38 00:31:38.394 clat (msec): min=2, max=408, avg=60.71, stdev=81.65 00:31:38.394 lat (msec): min=2, max=408, avg=60.74, stdev=81.66 00:31:38.394 clat percentiles (msec): 00:31:38.394 | 1.00th=[ 8], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:31:38.394 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.394 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 230], 95.00th=[ 279], 00:31:38.395 | 99.00th=[ 372], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 409], 00:31:38.395 | 99.99th=[ 409] 00:31:38.395 bw ( KiB/s): min= 128, max= 2176, per=4.21%, avg=1045.60, stdev=905.25, samples=20 00:31:38.395 iops : min= 32, max= 544, avg=261.40, stdev=226.31, samples=20 00:31:38.395 lat (msec) : 4=0.61%, 10=1.06%, 20=1.14%, 50=83.65%, 100=1.37% 00:31:38.395 lat (msec) : 250=3.04%, 500=9.13% 00:31:38.395 cpu : usr=97.93%, sys=1.31%, ctx=22, majf=0, minf=30 00:31:38.395 IO depths : 1=4.9%, 2=10.9%, 4=24.3%, 8=52.3%, 16=7.6%, 32=0.0%, >=64=0.0% 00:31:38.395 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.395 complete : 0=0.0%, 4=94.0%, 8=0.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.395 issued rwts: total=2630,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.395 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.395 filename2: (groupid=0, jobs=1): err= 0: pid=3059564: Tue Nov 26 04:43:17 2024 00:31:38.395 read: IOPS=258, BW=1034KiB/s (1059kB/s)(10.1MiB/10026msec) 00:31:38.395 slat (usec): min=8, max=109, avg=46.73, stdev=17.00 00:31:38.395 clat (msec): min=27, max=444, avg=61.50, stdev=80.75 00:31:38.395 lat (msec): min=27, max=444, avg=61.55, stdev=80.75 00:31:38.395 clat percentiles (msec): 00:31:38.395 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.395 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.395 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 226], 95.00th=[ 284], 00:31:38.395 | 99.00th=[ 359], 99.50th=[ 363], 99.90th=[ 368], 99.95th=[ 443], 00:31:38.395 | 99.99th=[ 443] 00:31:38.395 bw ( KiB/s): min= 128, max= 2048, per=4.15%, avg=1030.40, stdev=907.45, samples=20 00:31:38.395 iops : min= 32, max= 512, avg=257.60, stdev=226.86, samples=20 00:31:38.395 lat (msec) : 50=87.04%, 250=4.63%, 500=8.33% 00:31:38.395 cpu : usr=98.31%, sys=1.07%, ctx=46, majf=0, minf=25 00:31:38.395 IO depths : 1=5.8%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:31:38.395 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.395 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.395 issued rwts: total=2592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.395 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.395 filename2: (groupid=0, jobs=1): err= 0: pid=3059565: Tue Nov 26 04:43:17 2024 00:31:38.395 read: IOPS=256, BW=1028KiB/s (1052kB/s)(10.1MiB/10026msec) 00:31:38.395 slat (usec): min=8, max=101, avg=43.22, stdev=17.22 00:31:38.395 clat (msec): min=27, max=490, avg=61.92, stdev=85.14 00:31:38.395 lat (msec): min=27, max=490, avg=61.97, stdev=85.13 00:31:38.395 clat percentiles (msec): 00:31:38.395 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:31:38.395 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:31:38.395 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 228], 95.00th=[ 284], 00:31:38.395 | 99.00th=[ 388], 99.50th=[ 489], 99.90th=[ 493], 99.95th=[ 493], 00:31:38.395 | 99.99th=[ 493] 00:31:38.395 bw ( KiB/s): min= 128, max= 2048, per=4.12%, avg=1024.00, stdev=913.63, samples=20 00:31:38.395 iops : min= 32, max= 512, avg=256.00, stdev=228.41, samples=20 00:31:38.395 lat (msec) : 50=87.58%, 250=3.88%, 500=8.54% 00:31:38.395 cpu : usr=98.22%, sys=1.27%, ctx=17, majf=0, minf=28 00:31:38.395 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:31:38.395 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.395 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.395 issued rwts: total=2576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.395 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:38.395 00:31:38.395 Run status group 0 (all jobs): 00:31:38.395 READ: bw=24.3MiB/s (25.4MB/s), 1020KiB/s-1086KiB/s (1045kB/s-1112kB/s), io=243MiB (255MB), run=10011-10027msec 00:31:38.653 04:43:17 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:31:38.653 04:43:17 -- target/dif.sh@43 -- # local sub 00:31:38.653 04:43:17 -- target/dif.sh@45 -- # for sub in "$@" 00:31:38.653 04:43:17 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:38.653 04:43:17 -- target/dif.sh@36 -- # local sub_id=0 00:31:38.653 04:43:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:38.653 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.653 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.653 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.653 04:43:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:38.653 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.653 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.653 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.653 04:43:17 -- target/dif.sh@45 -- # for sub in "$@" 00:31:38.653 04:43:17 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:38.653 04:43:17 -- target/dif.sh@36 -- # local sub_id=1 00:31:38.653 04:43:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:38.653 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.653 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.653 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.653 04:43:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:38.653 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.653 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.653 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.653 04:43:17 -- target/dif.sh@45 -- # for sub in "$@" 00:31:38.653 04:43:17 -- target/dif.sh@46 -- # destroy_subsystem 2 00:31:38.653 04:43:17 -- target/dif.sh@36 -- # local sub_id=2 00:31:38.653 04:43:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:31:38.653 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.653 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.653 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.653 04:43:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:31:38.653 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.653 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.653 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.653 04:43:17 -- target/dif.sh@115 -- # NULL_DIF=1 00:31:38.653 04:43:17 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:31:38.653 04:43:17 -- target/dif.sh@115 -- # numjobs=2 00:31:38.653 04:43:17 -- target/dif.sh@115 -- # iodepth=8 00:31:38.653 04:43:17 -- target/dif.sh@115 -- # runtime=5 00:31:38.653 04:43:17 -- target/dif.sh@115 -- # files=1 00:31:38.653 04:43:17 -- target/dif.sh@117 -- # create_subsystems 0 1 00:31:38.653 04:43:17 -- target/dif.sh@28 -- # local sub 00:31:38.653 04:43:17 -- target/dif.sh@30 -- # for sub in "$@" 00:31:38.653 04:43:17 -- target/dif.sh@31 -- # create_subsystem 0 00:31:38.653 04:43:17 -- target/dif.sh@18 -- # local sub_id=0 00:31:38.653 04:43:17 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:38.653 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.653 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.653 bdev_null0 00:31:38.653 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.653 04:43:17 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:38.653 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.653 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.653 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.653 04:43:17 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:38.653 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.653 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.653 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.653 04:43:17 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:38.653 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.653 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.653 [2024-11-26 04:43:17.859051] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:38.653 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.653 04:43:17 -- target/dif.sh@30 -- # for sub in "$@" 00:31:38.653 04:43:17 -- target/dif.sh@31 -- # create_subsystem 1 00:31:38.653 04:43:17 -- target/dif.sh@18 -- # local sub_id=1 00:31:38.653 04:43:17 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:38.653 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.653 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.653 bdev_null1 00:31:38.653 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.653 04:43:17 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:38.653 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.653 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.912 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.912 04:43:17 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:38.912 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.912 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.912 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.912 04:43:17 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:38.912 04:43:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:38.912 04:43:17 -- common/autotest_common.sh@10 -- # set +x 00:31:38.912 04:43:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:38.912 04:43:17 -- target/dif.sh@118 -- # fio /dev/fd/62 00:31:38.912 04:43:17 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:31:38.912 04:43:17 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:38.912 04:43:17 -- nvmf/common.sh@520 -- # config=() 00:31:38.912 04:43:17 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:38.912 04:43:17 -- nvmf/common.sh@520 -- # local subsystem config 00:31:38.912 04:43:17 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:38.912 04:43:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:38.912 04:43:17 -- target/dif.sh@82 -- # gen_fio_conf 00:31:38.912 04:43:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:38.912 { 00:31:38.912 "params": { 00:31:38.912 "name": "Nvme$subsystem", 00:31:38.912 "trtype": "$TEST_TRANSPORT", 00:31:38.912 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:38.912 "adrfam": "ipv4", 00:31:38.912 "trsvcid": "$NVMF_PORT", 00:31:38.912 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:38.912 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:38.912 "hdgst": ${hdgst:-false}, 00:31:38.912 "ddgst": ${ddgst:-false} 00:31:38.912 }, 00:31:38.912 "method": "bdev_nvme_attach_controller" 00:31:38.912 } 00:31:38.912 EOF 00:31:38.912 )") 00:31:38.912 04:43:17 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:38.912 04:43:17 -- target/dif.sh@54 -- # local file 00:31:38.912 04:43:17 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:38.912 04:43:17 -- target/dif.sh@56 -- # cat 00:31:38.912 04:43:17 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:38.912 04:43:17 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:38.912 04:43:17 -- common/autotest_common.sh@1330 -- # shift 00:31:38.912 04:43:17 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:38.912 04:43:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:38.912 04:43:17 -- nvmf/common.sh@542 -- # cat 00:31:38.912 04:43:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:38.912 04:43:17 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:38.912 04:43:17 -- target/dif.sh@72 -- # (( file <= files )) 00:31:38.912 04:43:17 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:38.912 04:43:17 -- target/dif.sh@73 -- # cat 00:31:38.912 04:43:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:38.912 04:43:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:38.912 04:43:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:38.912 { 00:31:38.912 "params": { 00:31:38.912 "name": "Nvme$subsystem", 00:31:38.912 "trtype": "$TEST_TRANSPORT", 00:31:38.912 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:38.912 "adrfam": "ipv4", 00:31:38.912 "trsvcid": "$NVMF_PORT", 00:31:38.912 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:38.912 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:38.912 "hdgst": ${hdgst:-false}, 00:31:38.912 "ddgst": ${ddgst:-false} 00:31:38.912 }, 00:31:38.912 "method": "bdev_nvme_attach_controller" 00:31:38.912 } 00:31:38.912 EOF 00:31:38.912 )") 00:31:38.912 04:43:17 -- target/dif.sh@72 -- # (( file++ )) 00:31:38.912 04:43:17 -- target/dif.sh@72 -- # (( file <= files )) 00:31:38.912 04:43:17 -- nvmf/common.sh@542 -- # cat 00:31:38.912 04:43:17 -- nvmf/common.sh@544 -- # jq . 00:31:38.912 04:43:17 -- nvmf/common.sh@545 -- # IFS=, 00:31:38.912 04:43:17 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:38.912 "params": { 00:31:38.912 "name": "Nvme0", 00:31:38.912 "trtype": "tcp", 00:31:38.912 "traddr": "10.0.0.2", 00:31:38.912 "adrfam": "ipv4", 00:31:38.912 "trsvcid": "4420", 00:31:38.912 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:38.912 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:38.912 "hdgst": false, 00:31:38.912 "ddgst": false 00:31:38.912 }, 00:31:38.912 "method": "bdev_nvme_attach_controller" 00:31:38.912 },{ 00:31:38.912 "params": { 00:31:38.912 "name": "Nvme1", 00:31:38.912 "trtype": "tcp", 00:31:38.912 "traddr": "10.0.0.2", 00:31:38.912 "adrfam": "ipv4", 00:31:38.912 "trsvcid": "4420", 00:31:38.912 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:38.912 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:38.912 "hdgst": false, 00:31:38.912 "ddgst": false 00:31:38.912 }, 00:31:38.912 "method": "bdev_nvme_attach_controller" 00:31:38.912 }' 00:31:38.912 04:43:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:38.912 04:43:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:38.912 04:43:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:38.912 04:43:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:38.912 04:43:17 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:38.912 04:43:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:38.912 04:43:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:38.912 04:43:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:38.912 04:43:17 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:38.912 04:43:17 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:39.171 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:39.171 ... 00:31:39.171 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:39.171 ... 00:31:39.171 fio-3.35 00:31:39.171 Starting 4 threads 00:31:39.171 EAL: No free 2048 kB hugepages reported on node 1 00:31:39.736 [2024-11-26 04:43:18.751707] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:39.736 [2024-11-26 04:43:18.751789] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:44.996 00:31:44.996 filename0: (groupid=0, jobs=1): err= 0: pid=3060994: Tue Nov 26 04:43:23 2024 00:31:44.996 read: IOPS=1951, BW=15.2MiB/s (16.0MB/s)(76.2MiB/5002msec) 00:31:44.996 slat (usec): min=4, max=274, avg=15.64, stdev= 5.21 00:31:44.996 clat (usec): min=738, max=7706, avg=4039.21, stdev=469.72 00:31:44.996 lat (usec): min=752, max=7720, avg=4054.84, stdev=469.88 00:31:44.996 clat percentiles (usec): 00:31:44.996 | 1.00th=[ 1696], 5.00th=[ 3785], 10.00th=[ 3884], 20.00th=[ 3949], 00:31:44.996 | 30.00th=[ 3982], 40.00th=[ 4015], 50.00th=[ 4047], 60.00th=[ 4080], 00:31:44.996 | 70.00th=[ 4080], 80.00th=[ 4113], 90.00th=[ 4146], 95.00th=[ 4228], 00:31:44.996 | 99.00th=[ 6456], 99.50th=[ 6849], 99.90th=[ 7242], 99.95th=[ 7373], 00:31:44.996 | 99.99th=[ 7701] 00:31:44.996 bw ( KiB/s): min=15230, max=15728, per=24.95%, avg=15574.89, stdev=150.69, samples=9 00:31:44.996 iops : min= 1903, max= 1966, avg=1946.78, stdev=19.05, samples=9 00:31:44.996 lat (usec) : 750=0.02%, 1000=0.13% 00:31:44.996 lat (msec) : 2=0.96%, 4=31.44%, 10=67.45% 00:31:44.996 cpu : usr=93.18%, sys=6.14%, ctx=12, majf=0, minf=9 00:31:44.996 IO depths : 1=0.1%, 2=20.1%, 4=53.8%, 8=26.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:44.996 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.996 complete : 0=0.0%, 4=90.9%, 8=9.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.996 issued rwts: total=9759,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:44.996 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:44.996 filename0: (groupid=0, jobs=1): err= 0: pid=3060995: Tue Nov 26 04:43:23 2024 00:31:44.996 read: IOPS=1950, BW=15.2MiB/s (16.0MB/s)(76.2MiB/5002msec) 00:31:44.996 slat (nsec): min=4216, max=33965, avg=14247.27, stdev=3732.00 00:31:44.996 clat (usec): min=853, max=8015, avg=4053.87, stdev=266.21 00:31:44.996 lat (usec): min=869, max=8028, avg=4068.12, stdev=266.24 00:31:44.996 clat percentiles (usec): 00:31:44.996 | 1.00th=[ 3359], 5.00th=[ 3818], 10.00th=[ 3916], 20.00th=[ 3982], 00:31:44.996 | 30.00th=[ 4015], 40.00th=[ 4047], 50.00th=[ 4047], 60.00th=[ 4080], 00:31:44.996 | 70.00th=[ 4113], 80.00th=[ 4113], 90.00th=[ 4146], 95.00th=[ 4228], 00:31:44.996 | 99.00th=[ 4817], 99.50th=[ 5407], 99.90th=[ 7177], 99.95th=[ 7570], 00:31:44.996 | 99.99th=[ 8029] 00:31:44.996 bw ( KiB/s): min=15438, max=15744, per=24.98%, avg=15594.44, stdev=105.90, samples=9 00:31:44.996 iops : min= 1929, max= 1968, avg=1949.22, stdev=13.38, samples=9 00:31:44.996 lat (usec) : 1000=0.01% 00:31:44.996 lat (msec) : 2=0.12%, 4=25.74%, 10=74.13% 00:31:44.996 cpu : usr=93.60%, sys=5.50%, ctx=130, majf=0, minf=9 00:31:44.996 IO depths : 1=0.1%, 2=13.5%, 4=59.2%, 8=27.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:44.996 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.996 complete : 0=0.0%, 4=91.8%, 8=8.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.996 issued rwts: total=9757,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:44.996 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:44.996 filename1: (groupid=0, jobs=1): err= 0: pid=3060996: Tue Nov 26 04:43:23 2024 00:31:44.996 read: IOPS=1942, BW=15.2MiB/s (15.9MB/s)(75.9MiB/5001msec) 00:31:44.996 slat (usec): min=3, max=107, avg=15.06, stdev= 4.28 00:31:44.996 clat (usec): min=770, max=9733, avg=4058.88, stdev=418.28 00:31:44.996 lat (usec): min=783, max=9744, avg=4073.93, stdev=418.35 00:31:44.996 clat percentiles (usec): 00:31:44.996 | 1.00th=[ 2704], 5.00th=[ 3851], 10.00th=[ 3916], 20.00th=[ 3949], 00:31:44.996 | 30.00th=[ 4015], 40.00th=[ 4015], 50.00th=[ 4047], 60.00th=[ 4080], 00:31:44.996 | 70.00th=[ 4080], 80.00th=[ 4113], 90.00th=[ 4146], 95.00th=[ 4293], 00:31:44.996 | 99.00th=[ 6194], 99.50th=[ 6521], 99.90th=[ 7046], 99.95th=[ 7242], 00:31:44.996 | 99.99th=[ 9765] 00:31:44.996 bw ( KiB/s): min=15248, max=15632, per=24.88%, avg=15532.44, stdev=135.95, samples=9 00:31:44.996 iops : min= 1906, max= 1954, avg=1941.56, stdev=16.99, samples=9 00:31:44.996 lat (usec) : 1000=0.06% 00:31:44.996 lat (msec) : 2=0.66%, 4=29.90%, 10=69.38% 00:31:44.996 cpu : usr=87.94%, sys=8.20%, ctx=87, majf=0, minf=9 00:31:44.996 IO depths : 1=0.1%, 2=20.5%, 4=53.6%, 8=25.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:44.996 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.996 complete : 0=0.0%, 4=90.8%, 8=9.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.996 issued rwts: total=9716,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:44.996 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:44.996 filename1: (groupid=0, jobs=1): err= 0: pid=3060997: Tue Nov 26 04:43:23 2024 00:31:44.996 read: IOPS=1960, BW=15.3MiB/s (16.1MB/s)(76.6MiB/5003msec) 00:31:44.996 slat (nsec): min=4169, max=59753, avg=15917.32, stdev=5520.42 00:31:44.996 clat (usec): min=662, max=11498, avg=4016.29, stdev=411.95 00:31:44.996 lat (usec): min=679, max=11515, avg=4032.21, stdev=412.25 00:31:44.996 clat percentiles (usec): 00:31:44.996 | 1.00th=[ 2311], 5.00th=[ 3687], 10.00th=[ 3884], 20.00th=[ 3949], 00:31:44.996 | 30.00th=[ 3982], 40.00th=[ 4015], 50.00th=[ 4047], 60.00th=[ 4047], 00:31:44.996 | 70.00th=[ 4080], 80.00th=[ 4113], 90.00th=[ 4146], 95.00th=[ 4178], 00:31:44.996 | 99.00th=[ 5800], 99.50th=[ 6325], 99.90th=[ 7242], 99.95th=[ 8455], 00:31:44.996 | 99.99th=[11469] 00:31:44.996 bw ( KiB/s): min=15488, max=16112, per=25.10%, avg=15672.89, stdev=186.78, samples=9 00:31:44.996 iops : min= 1936, max= 2014, avg=1959.11, stdev=23.35, samples=9 00:31:44.996 lat (usec) : 750=0.03%, 1000=0.09% 00:31:44.996 lat (msec) : 2=0.55%, 4=35.08%, 10=64.23%, 20=0.01% 00:31:44.996 cpu : usr=81.41%, sys=10.66%, ctx=240, majf=0, minf=9 00:31:44.996 IO depths : 1=0.5%, 2=22.7%, 4=51.8%, 8=24.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:44.996 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.996 complete : 0=0.0%, 4=90.4%, 8=9.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.996 issued rwts: total=9808,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:44.996 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:44.996 00:31:44.996 Run status group 0 (all jobs): 00:31:44.996 READ: bw=61.0MiB/s (63.9MB/s), 15.2MiB/s-15.3MiB/s (15.9MB/s-16.1MB/s), io=305MiB (320MB), run=5001-5003msec 00:31:44.996 04:43:24 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:31:44.996 04:43:24 -- target/dif.sh@43 -- # local sub 00:31:44.996 04:43:24 -- target/dif.sh@45 -- # for sub in "$@" 00:31:44.996 04:43:24 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:44.996 04:43:24 -- target/dif.sh@36 -- # local sub_id=0 00:31:44.996 04:43:24 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:44.996 04:43:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.996 04:43:24 -- common/autotest_common.sh@10 -- # set +x 00:31:44.996 04:43:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.996 04:43:24 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:44.996 04:43:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.996 04:43:24 -- common/autotest_common.sh@10 -- # set +x 00:31:44.996 04:43:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.996 04:43:24 -- target/dif.sh@45 -- # for sub in "$@" 00:31:44.996 04:43:24 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:44.996 04:43:24 -- target/dif.sh@36 -- # local sub_id=1 00:31:44.996 04:43:24 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:44.996 04:43:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.996 04:43:24 -- common/autotest_common.sh@10 -- # set +x 00:31:44.996 04:43:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.996 04:43:24 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:44.996 04:43:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.996 04:43:24 -- common/autotest_common.sh@10 -- # set +x 00:31:44.996 04:43:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.996 00:31:44.996 real 0m24.072s 00:31:44.996 user 4m31.219s 00:31:44.996 sys 0m6.833s 00:31:44.996 04:43:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:44.996 04:43:24 -- common/autotest_common.sh@10 -- # set +x 00:31:44.996 ************************************ 00:31:44.996 END TEST fio_dif_rand_params 00:31:44.996 ************************************ 00:31:44.996 04:43:24 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:31:44.996 04:43:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:44.996 04:43:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:44.996 04:43:24 -- common/autotest_common.sh@10 -- # set +x 00:31:44.996 ************************************ 00:31:44.996 START TEST fio_dif_digest 00:31:44.996 ************************************ 00:31:44.996 04:43:24 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:31:44.996 04:43:24 -- target/dif.sh@123 -- # local NULL_DIF 00:31:44.996 04:43:24 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:31:44.996 04:43:24 -- target/dif.sh@125 -- # local hdgst ddgst 00:31:44.996 04:43:24 -- target/dif.sh@127 -- # NULL_DIF=3 00:31:44.996 04:43:24 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:31:44.996 04:43:24 -- target/dif.sh@127 -- # numjobs=3 00:31:44.996 04:43:24 -- target/dif.sh@127 -- # iodepth=3 00:31:44.996 04:43:24 -- target/dif.sh@127 -- # runtime=10 00:31:44.996 04:43:24 -- target/dif.sh@128 -- # hdgst=true 00:31:44.996 04:43:24 -- target/dif.sh@128 -- # ddgst=true 00:31:44.996 04:43:24 -- target/dif.sh@130 -- # create_subsystems 0 00:31:44.996 04:43:24 -- target/dif.sh@28 -- # local sub 00:31:44.996 04:43:24 -- target/dif.sh@30 -- # for sub in "$@" 00:31:44.996 04:43:24 -- target/dif.sh@31 -- # create_subsystem 0 00:31:44.996 04:43:24 -- target/dif.sh@18 -- # local sub_id=0 00:31:44.996 04:43:24 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:44.996 04:43:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.996 04:43:24 -- common/autotest_common.sh@10 -- # set +x 00:31:44.996 bdev_null0 00:31:44.996 04:43:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.996 04:43:24 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:44.996 04:43:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.996 04:43:24 -- common/autotest_common.sh@10 -- # set +x 00:31:44.996 04:43:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.996 04:43:24 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:44.996 04:43:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.996 04:43:24 -- common/autotest_common.sh@10 -- # set +x 00:31:44.996 04:43:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.997 04:43:24 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:44.997 04:43:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.997 04:43:24 -- common/autotest_common.sh@10 -- # set +x 00:31:44.997 [2024-11-26 04:43:24.152294] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:44.997 04:43:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.997 04:43:24 -- target/dif.sh@131 -- # fio /dev/fd/62 00:31:44.997 04:43:24 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:31:44.997 04:43:24 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:44.997 04:43:24 -- nvmf/common.sh@520 -- # config=() 00:31:44.997 04:43:24 -- nvmf/common.sh@520 -- # local subsystem config 00:31:44.997 04:43:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:44.997 04:43:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:44.997 { 00:31:44.997 "params": { 00:31:44.997 "name": "Nvme$subsystem", 00:31:44.997 "trtype": "$TEST_TRANSPORT", 00:31:44.997 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:44.997 "adrfam": "ipv4", 00:31:44.997 "trsvcid": "$NVMF_PORT", 00:31:44.997 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:44.997 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:44.997 "hdgst": ${hdgst:-false}, 00:31:44.997 "ddgst": ${ddgst:-false} 00:31:44.997 }, 00:31:44.997 "method": "bdev_nvme_attach_controller" 00:31:44.997 } 00:31:44.997 EOF 00:31:44.997 )") 00:31:44.997 04:43:24 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.997 04:43:24 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.997 04:43:24 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:44.997 04:43:24 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:44.997 04:43:24 -- target/dif.sh@82 -- # gen_fio_conf 00:31:44.997 04:43:24 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:44.997 04:43:24 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.997 04:43:24 -- target/dif.sh@54 -- # local file 00:31:44.997 04:43:24 -- common/autotest_common.sh@1330 -- # shift 00:31:44.997 04:43:24 -- target/dif.sh@56 -- # cat 00:31:44.997 04:43:24 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:44.997 04:43:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:44.997 04:43:24 -- nvmf/common.sh@542 -- # cat 00:31:44.997 04:43:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.997 04:43:24 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:44.997 04:43:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:44.997 04:43:24 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:44.997 04:43:24 -- target/dif.sh@72 -- # (( file <= files )) 00:31:44.997 04:43:24 -- nvmf/common.sh@544 -- # jq . 00:31:44.997 04:43:24 -- nvmf/common.sh@545 -- # IFS=, 00:31:44.997 04:43:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:44.997 "params": { 00:31:44.997 "name": "Nvme0", 00:31:44.997 "trtype": "tcp", 00:31:44.997 "traddr": "10.0.0.2", 00:31:44.997 "adrfam": "ipv4", 00:31:44.997 "trsvcid": "4420", 00:31:44.997 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:44.997 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:44.997 "hdgst": true, 00:31:44.997 "ddgst": true 00:31:44.997 }, 00:31:44.997 "method": "bdev_nvme_attach_controller" 00:31:44.997 }' 00:31:44.997 04:43:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:44.997 04:43:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:44.997 04:43:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:44.997 04:43:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.997 04:43:24 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:44.997 04:43:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:44.997 04:43:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:44.997 04:43:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:44.997 04:43:24 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:44.997 04:43:24 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:45.256 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:45.256 ... 00:31:45.256 fio-3.35 00:31:45.256 Starting 3 threads 00:31:45.256 EAL: No free 2048 kB hugepages reported on node 1 00:31:45.824 [2024-11-26 04:43:24.780559] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:45.824 [2024-11-26 04:43:24.780636] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:55.789 00:31:55.789 filename0: (groupid=0, jobs=1): err= 0: pid=3061853: Tue Nov 26 04:43:34 2024 00:31:55.789 read: IOPS=215, BW=26.9MiB/s (28.2MB/s)(270MiB/10044msec) 00:31:55.789 slat (nsec): min=4447, max=54988, avg=18501.56, stdev=4847.78 00:31:55.789 clat (usec): min=10042, max=54743, avg=13901.86, stdev=2133.54 00:31:55.789 lat (usec): min=10055, max=54761, avg=13920.36, stdev=2133.54 00:31:55.789 clat percentiles (usec): 00:31:55.789 | 1.00th=[11469], 5.00th=[12256], 10.00th=[12649], 20.00th=[13042], 00:31:55.789 | 30.00th=[13304], 40.00th=[13566], 50.00th=[13829], 60.00th=[14091], 00:31:55.790 | 70.00th=[14222], 80.00th=[14615], 90.00th=[15008], 95.00th=[15401], 00:31:55.790 | 99.00th=[16450], 99.50th=[16909], 99.90th=[53740], 99.95th=[53740], 00:31:55.790 | 99.99th=[54789] 00:31:55.790 bw ( KiB/s): min=25344, max=28928, per=34.53%, avg=27635.20, stdev=776.82, samples=20 00:31:55.790 iops : min= 198, max= 226, avg=215.90, stdev= 6.07, samples=20 00:31:55.790 lat (msec) : 20=99.63%, 50=0.19%, 100=0.19% 00:31:55.790 cpu : usr=93.07%, sys=6.29%, ctx=29, majf=0, minf=189 00:31:55.790 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:55.790 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:55.790 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:55.790 issued rwts: total=2161,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:55.790 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:55.790 filename0: (groupid=0, jobs=1): err= 0: pid=3061854: Tue Nov 26 04:43:34 2024 00:31:55.790 read: IOPS=206, BW=25.8MiB/s (27.0MB/s)(259MiB/10045msec) 00:31:55.790 slat (nsec): min=3903, max=45016, avg=17377.59, stdev=4173.97 00:31:55.790 clat (usec): min=8184, max=50739, avg=14501.53, stdev=1498.19 00:31:55.790 lat (usec): min=8198, max=50759, avg=14518.91, stdev=1498.15 00:31:55.790 clat percentiles (usec): 00:31:55.790 | 1.00th=[11994], 5.00th=[13042], 10.00th=[13304], 20.00th=[13698], 00:31:55.790 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:31:55.790 | 70.00th=[15008], 80.00th=[15270], 90.00th=[15664], 95.00th=[16057], 00:31:55.790 | 99.00th=[16712], 99.50th=[17171], 99.90th=[23987], 99.95th=[46924], 00:31:55.790 | 99.99th=[50594] 00:31:55.790 bw ( KiB/s): min=25394, max=27392, per=33.11%, avg=26498.50, stdev=535.96, samples=20 00:31:55.790 iops : min= 198, max= 214, avg=207.00, stdev= 4.23, samples=20 00:31:55.790 lat (msec) : 10=0.43%, 20=99.32%, 50=0.19%, 100=0.05% 00:31:55.790 cpu : usr=95.01%, sys=4.47%, ctx=26, majf=0, minf=89 00:31:55.790 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:55.790 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:55.790 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:55.790 issued rwts: total=2072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:55.790 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:55.790 filename0: (groupid=0, jobs=1): err= 0: pid=3061855: Tue Nov 26 04:43:34 2024 00:31:55.790 read: IOPS=203, BW=25.5MiB/s (26.7MB/s)(256MiB/10044msec) 00:31:55.790 slat (nsec): min=4432, max=55080, avg=18269.10, stdev=5349.66 00:31:55.790 clat (usec): min=9911, max=52279, avg=14677.47, stdev=1467.64 00:31:55.790 lat (usec): min=9927, max=52298, avg=14695.74, stdev=1467.73 00:31:55.790 clat percentiles (usec): 00:31:55.790 | 1.00th=[12387], 5.00th=[13173], 10.00th=[13435], 20.00th=[13960], 00:31:55.790 | 30.00th=[14222], 40.00th=[14353], 50.00th=[14615], 60.00th=[14877], 00:31:55.790 | 70.00th=[15139], 80.00th=[15401], 90.00th=[15795], 95.00th=[16188], 00:31:55.790 | 99.00th=[16909], 99.50th=[17171], 99.90th=[20055], 99.95th=[46924], 00:31:55.790 | 99.99th=[52167] 00:31:55.790 bw ( KiB/s): min=25088, max=27648, per=32.71%, avg=26176.00, stdev=468.92, samples=20 00:31:55.790 iops : min= 196, max= 216, avg=204.50, stdev= 3.66, samples=20 00:31:55.790 lat (msec) : 10=0.10%, 20=99.66%, 50=0.20%, 100=0.05% 00:31:55.790 cpu : usr=90.37%, sys=6.92%, ctx=472, majf=0, minf=175 00:31:55.790 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:55.790 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:55.790 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:55.790 issued rwts: total=2047,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:55.790 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:55.790 00:31:55.790 Run status group 0 (all jobs): 00:31:55.790 READ: bw=78.1MiB/s (81.9MB/s), 25.5MiB/s-26.9MiB/s (26.7MB/s-28.2MB/s), io=785MiB (823MB), run=10044-10045msec 00:31:56.048 04:43:35 -- target/dif.sh@132 -- # destroy_subsystems 0 00:31:56.048 04:43:35 -- target/dif.sh@43 -- # local sub 00:31:56.048 04:43:35 -- target/dif.sh@45 -- # for sub in "$@" 00:31:56.048 04:43:35 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:56.048 04:43:35 -- target/dif.sh@36 -- # local sub_id=0 00:31:56.048 04:43:35 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:56.048 04:43:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.048 04:43:35 -- common/autotest_common.sh@10 -- # set +x 00:31:56.048 04:43:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:56.048 04:43:35 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:56.048 04:43:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.048 04:43:35 -- common/autotest_common.sh@10 -- # set +x 00:31:56.048 04:43:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:56.048 00:31:56.048 real 0m11.054s 00:31:56.048 user 0m29.017s 00:31:56.048 sys 0m2.050s 00:31:56.048 04:43:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:56.048 04:43:35 -- common/autotest_common.sh@10 -- # set +x 00:31:56.048 ************************************ 00:31:56.048 END TEST fio_dif_digest 00:31:56.048 ************************************ 00:31:56.048 04:43:35 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:31:56.048 04:43:35 -- target/dif.sh@147 -- # nvmftestfini 00:31:56.048 04:43:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:56.048 04:43:35 -- nvmf/common.sh@116 -- # sync 00:31:56.048 04:43:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:56.048 04:43:35 -- nvmf/common.sh@119 -- # set +e 00:31:56.048 04:43:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:56.048 04:43:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:56.048 rmmod nvme_tcp 00:31:56.048 rmmod nvme_fabrics 00:31:56.048 rmmod nvme_keyring 00:31:56.048 04:43:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:56.048 04:43:35 -- nvmf/common.sh@123 -- # set -e 00:31:56.048 04:43:35 -- nvmf/common.sh@124 -- # return 0 00:31:56.048 04:43:35 -- nvmf/common.sh@477 -- # '[' -n 3055522 ']' 00:31:56.048 04:43:35 -- nvmf/common.sh@478 -- # killprocess 3055522 00:31:56.048 04:43:35 -- common/autotest_common.sh@936 -- # '[' -z 3055522 ']' 00:31:56.048 04:43:35 -- common/autotest_common.sh@940 -- # kill -0 3055522 00:31:56.048 04:43:35 -- common/autotest_common.sh@941 -- # uname 00:31:56.048 04:43:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:56.048 04:43:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3055522 00:31:56.305 04:43:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:56.305 04:43:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:56.305 04:43:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3055522' 00:31:56.305 killing process with pid 3055522 00:31:56.305 04:43:35 -- common/autotest_common.sh@955 -- # kill 3055522 00:31:56.305 04:43:35 -- common/autotest_common.sh@960 -- # wait 3055522 00:31:56.305 04:43:35 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:31:56.305 04:43:35 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:31:57.682 Waiting for block devices as requested 00:31:57.682 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:31:57.682 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:31:57.941 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:31:57.941 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:31:57.941 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:31:57.941 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:31:58.199 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:31:58.199 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:31:58.199 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:31:58.199 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:31:58.458 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:31:58.458 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:31:58.458 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:31:58.458 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:31:58.458 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:31:58.718 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:31:58.718 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:31:58.718 04:43:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:58.718 04:43:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:58.718 04:43:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:58.718 04:43:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:58.718 04:43:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:58.718 04:43:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:58.718 04:43:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:01.254 04:43:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:01.254 00:32:01.254 real 1m7.444s 00:32:01.254 user 6m28.858s 00:32:01.254 sys 0m18.007s 00:32:01.254 04:43:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:01.254 04:43:39 -- common/autotest_common.sh@10 -- # set +x 00:32:01.254 ************************************ 00:32:01.254 END TEST nvmf_dif 00:32:01.254 ************************************ 00:32:01.254 04:43:39 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:01.254 04:43:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:01.254 04:43:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:01.254 04:43:39 -- common/autotest_common.sh@10 -- # set +x 00:32:01.254 ************************************ 00:32:01.254 START TEST nvmf_abort_qd_sizes 00:32:01.254 ************************************ 00:32:01.254 04:43:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:01.254 * Looking for test storage... 00:32:01.254 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:01.254 04:43:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:01.254 04:43:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:01.254 04:43:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:01.254 04:43:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:01.254 04:43:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:01.254 04:43:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:01.254 04:43:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:01.254 04:43:40 -- scripts/common.sh@335 -- # IFS=.-: 00:32:01.254 04:43:40 -- scripts/common.sh@335 -- # read -ra ver1 00:32:01.254 04:43:40 -- scripts/common.sh@336 -- # IFS=.-: 00:32:01.254 04:43:40 -- scripts/common.sh@336 -- # read -ra ver2 00:32:01.254 04:43:40 -- scripts/common.sh@337 -- # local 'op=<' 00:32:01.254 04:43:40 -- scripts/common.sh@339 -- # ver1_l=2 00:32:01.254 04:43:40 -- scripts/common.sh@340 -- # ver2_l=1 00:32:01.254 04:43:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:01.254 04:43:40 -- scripts/common.sh@343 -- # case "$op" in 00:32:01.254 04:43:40 -- scripts/common.sh@344 -- # : 1 00:32:01.254 04:43:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:01.254 04:43:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:01.254 04:43:40 -- scripts/common.sh@364 -- # decimal 1 00:32:01.254 04:43:40 -- scripts/common.sh@352 -- # local d=1 00:32:01.254 04:43:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:01.254 04:43:40 -- scripts/common.sh@354 -- # echo 1 00:32:01.254 04:43:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:01.254 04:43:40 -- scripts/common.sh@365 -- # decimal 2 00:32:01.254 04:43:40 -- scripts/common.sh@352 -- # local d=2 00:32:01.254 04:43:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:01.254 04:43:40 -- scripts/common.sh@354 -- # echo 2 00:32:01.254 04:43:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:01.254 04:43:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:01.254 04:43:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:01.254 04:43:40 -- scripts/common.sh@367 -- # return 0 00:32:01.254 04:43:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:01.254 04:43:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:01.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:01.254 --rc genhtml_branch_coverage=1 00:32:01.254 --rc genhtml_function_coverage=1 00:32:01.254 --rc genhtml_legend=1 00:32:01.254 --rc geninfo_all_blocks=1 00:32:01.254 --rc geninfo_unexecuted_blocks=1 00:32:01.254 00:32:01.254 ' 00:32:01.254 04:43:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:01.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:01.254 --rc genhtml_branch_coverage=1 00:32:01.254 --rc genhtml_function_coverage=1 00:32:01.254 --rc genhtml_legend=1 00:32:01.254 --rc geninfo_all_blocks=1 00:32:01.254 --rc geninfo_unexecuted_blocks=1 00:32:01.254 00:32:01.254 ' 00:32:01.254 04:43:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:01.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:01.254 --rc genhtml_branch_coverage=1 00:32:01.254 --rc genhtml_function_coverage=1 00:32:01.254 --rc genhtml_legend=1 00:32:01.254 --rc geninfo_all_blocks=1 00:32:01.254 --rc geninfo_unexecuted_blocks=1 00:32:01.254 00:32:01.254 ' 00:32:01.254 04:43:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:01.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:01.254 --rc genhtml_branch_coverage=1 00:32:01.254 --rc genhtml_function_coverage=1 00:32:01.254 --rc genhtml_legend=1 00:32:01.254 --rc geninfo_all_blocks=1 00:32:01.254 --rc geninfo_unexecuted_blocks=1 00:32:01.254 00:32:01.254 ' 00:32:01.254 04:43:40 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:01.254 04:43:40 -- nvmf/common.sh@7 -- # uname -s 00:32:01.254 04:43:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:01.254 04:43:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:01.254 04:43:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:01.254 04:43:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:01.254 04:43:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:01.254 04:43:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:01.254 04:43:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:01.254 04:43:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:01.254 04:43:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:01.254 04:43:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:01.254 04:43:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:01.254 04:43:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:01.254 04:43:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:01.254 04:43:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:01.254 04:43:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:01.254 04:43:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:01.254 04:43:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:01.254 04:43:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:01.254 04:43:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:01.254 04:43:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:01.254 04:43:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:01.254 04:43:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:01.254 04:43:40 -- paths/export.sh@5 -- # export PATH 00:32:01.254 04:43:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:01.254 04:43:40 -- nvmf/common.sh@46 -- # : 0 00:32:01.254 04:43:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:01.254 04:43:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:01.254 04:43:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:01.254 04:43:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:01.254 04:43:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:01.254 04:43:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:01.254 04:43:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:01.254 04:43:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:01.254 04:43:40 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:01.254 04:43:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:01.254 04:43:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:01.254 04:43:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:01.254 04:43:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:01.254 04:43:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:01.254 04:43:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:01.254 04:43:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:01.254 04:43:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:01.254 04:43:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:01.254 04:43:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:01.254 04:43:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:01.254 04:43:40 -- common/autotest_common.sh@10 -- # set +x 00:32:03.159 04:43:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:03.159 04:43:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:03.159 04:43:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:03.159 04:43:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:03.159 04:43:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:03.159 04:43:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:03.159 04:43:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:03.159 04:43:42 -- nvmf/common.sh@294 -- # net_devs=() 00:32:03.159 04:43:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:03.159 04:43:42 -- nvmf/common.sh@295 -- # e810=() 00:32:03.159 04:43:42 -- nvmf/common.sh@295 -- # local -ga e810 00:32:03.159 04:43:42 -- nvmf/common.sh@296 -- # x722=() 00:32:03.159 04:43:42 -- nvmf/common.sh@296 -- # local -ga x722 00:32:03.159 04:43:42 -- nvmf/common.sh@297 -- # mlx=() 00:32:03.159 04:43:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:03.159 04:43:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:03.159 04:43:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:03.159 04:43:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:03.159 04:43:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:03.159 04:43:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:03.159 04:43:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:03.159 04:43:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:03.159 04:43:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:03.159 04:43:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:03.159 04:43:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:03.159 04:43:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:03.159 04:43:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:03.159 04:43:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:03.159 04:43:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:03.159 04:43:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:03.159 04:43:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:03.159 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:03.159 04:43:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:03.159 04:43:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:03.159 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:03.159 04:43:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:03.159 04:43:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:03.159 04:43:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:03.159 04:43:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:03.159 04:43:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:03.159 04:43:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:03.159 04:43:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:03.159 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:03.159 04:43:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:03.159 04:43:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:03.159 04:43:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:03.159 04:43:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:03.160 04:43:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:03.160 04:43:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:03.160 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:03.160 04:43:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:03.160 04:43:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:03.160 04:43:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:03.160 04:43:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:03.160 04:43:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:03.160 04:43:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:03.160 04:43:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:03.160 04:43:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:03.160 04:43:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:03.160 04:43:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:03.160 04:43:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:03.160 04:43:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:03.160 04:43:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:03.160 04:43:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:03.160 04:43:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:03.160 04:43:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:03.160 04:43:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:03.160 04:43:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:03.160 04:43:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:03.160 04:43:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:03.160 04:43:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:03.160 04:43:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:03.160 04:43:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:03.160 04:43:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:03.160 04:43:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:03.160 04:43:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:03.160 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:03.160 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.331 ms 00:32:03.160 00:32:03.160 --- 10.0.0.2 ping statistics --- 00:32:03.160 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:03.160 rtt min/avg/max/mdev = 0.331/0.331/0.331/0.000 ms 00:32:03.160 04:43:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:03.160 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:03.160 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.164 ms 00:32:03.160 00:32:03.160 --- 10.0.0.1 ping statistics --- 00:32:03.160 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:03.160 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:32:03.160 04:43:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:03.160 04:43:42 -- nvmf/common.sh@410 -- # return 0 00:32:03.160 04:43:42 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:03.160 04:43:42 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:04.535 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:04.535 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:04.535 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:04.535 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:04.535 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:04.535 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:04.535 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:04.535 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:04.535 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:04.535 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:04.535 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:04.535 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:04.535 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:04.535 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:04.535 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:04.535 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:05.471 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:05.471 04:43:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:05.471 04:43:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:05.471 04:43:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:05.471 04:43:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:05.471 04:43:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:05.471 04:43:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:05.471 04:43:44 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:05.471 04:43:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:05.471 04:43:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:05.471 04:43:44 -- common/autotest_common.sh@10 -- # set +x 00:32:05.471 04:43:44 -- nvmf/common.sh@469 -- # nvmfpid=3066782 00:32:05.471 04:43:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:05.471 04:43:44 -- nvmf/common.sh@470 -- # waitforlisten 3066782 00:32:05.471 04:43:44 -- common/autotest_common.sh@829 -- # '[' -z 3066782 ']' 00:32:05.471 04:43:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:05.471 04:43:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:05.471 04:43:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:05.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:05.471 04:43:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:05.471 04:43:44 -- common/autotest_common.sh@10 -- # set +x 00:32:05.729 [2024-11-26 04:43:44.707325] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:32:05.730 [2024-11-26 04:43:44.707406] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:05.730 EAL: No free 2048 kB hugepages reported on node 1 00:32:05.730 [2024-11-26 04:43:44.776240] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:05.730 [2024-11-26 04:43:44.871476] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:05.730 [2024-11-26 04:43:44.871614] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:05.730 [2024-11-26 04:43:44.871631] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:05.730 [2024-11-26 04:43:44.871643] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:05.730 [2024-11-26 04:43:44.873712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:05.730 [2024-11-26 04:43:44.873753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:05.730 [2024-11-26 04:43:44.873829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:05.730 [2024-11-26 04:43:44.873831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:06.663 04:43:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:06.664 04:43:45 -- common/autotest_common.sh@862 -- # return 0 00:32:06.664 04:43:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:06.664 04:43:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:06.664 04:43:45 -- common/autotest_common.sh@10 -- # set +x 00:32:06.664 04:43:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:06.664 04:43:45 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:06.664 04:43:45 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:06.664 04:43:45 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:06.664 04:43:45 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:06.664 04:43:45 -- scripts/common.sh@312 -- # local nvmes 00:32:06.664 04:43:45 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:06.664 04:43:45 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:06.664 04:43:45 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:06.664 04:43:45 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:06.664 04:43:45 -- scripts/common.sh@322 -- # uname -s 00:32:06.664 04:43:45 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:06.664 04:43:45 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:06.664 04:43:45 -- scripts/common.sh@327 -- # (( 1 )) 00:32:06.664 04:43:45 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:06.664 04:43:45 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:06.664 04:43:45 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:06.664 04:43:45 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:06.664 04:43:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:06.664 04:43:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:06.664 04:43:45 -- common/autotest_common.sh@10 -- # set +x 00:32:06.664 ************************************ 00:32:06.664 START TEST spdk_target_abort 00:32:06.664 ************************************ 00:32:06.664 04:43:45 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:06.664 04:43:45 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:06.664 04:43:45 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:06.664 04:43:45 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:06.664 04:43:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.664 04:43:45 -- common/autotest_common.sh@10 -- # set +x 00:32:09.943 spdk_targetn1 00:32:09.943 04:43:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:09.943 04:43:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.943 04:43:48 -- common/autotest_common.sh@10 -- # set +x 00:32:09.943 [2024-11-26 04:43:48.575801] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:09.943 04:43:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:09.943 04:43:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.943 04:43:48 -- common/autotest_common.sh@10 -- # set +x 00:32:09.943 04:43:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:09.943 04:43:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.943 04:43:48 -- common/autotest_common.sh@10 -- # set +x 00:32:09.943 04:43:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:09.943 04:43:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:09.943 04:43:48 -- common/autotest_common.sh@10 -- # set +x 00:32:09.943 [2024-11-26 04:43:48.608138] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:09.943 04:43:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:09.943 04:43:48 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:09.943 EAL: No free 2048 kB hugepages reported on node 1 00:32:13.228 Initializing NVMe Controllers 00:32:13.228 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:13.228 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:13.228 Initialization complete. Launching workers. 00:32:13.228 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 10224, failed: 0 00:32:13.228 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1313, failed to submit 8911 00:32:13.228 success 677, unsuccess 636, failed 0 00:32:13.228 04:43:51 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:13.228 04:43:51 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:13.228 EAL: No free 2048 kB hugepages reported on node 1 00:32:16.508 Initializing NVMe Controllers 00:32:16.508 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:16.508 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:16.508 Initialization complete. Launching workers. 00:32:16.508 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8624, failed: 0 00:32:16.508 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1230, failed to submit 7394 00:32:16.508 success 343, unsuccess 887, failed 0 00:32:16.508 04:43:55 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:16.508 04:43:55 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:16.508 EAL: No free 2048 kB hugepages reported on node 1 00:32:19.827 Initializing NVMe Controllers 00:32:19.827 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:19.827 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:19.827 Initialization complete. Launching workers. 00:32:19.827 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31854, failed: 0 00:32:19.827 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2773, failed to submit 29081 00:32:19.827 success 521, unsuccess 2252, failed 0 00:32:19.827 04:43:58 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:19.827 04:43:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.827 04:43:58 -- common/autotest_common.sh@10 -- # set +x 00:32:19.827 04:43:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.827 04:43:58 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:19.827 04:43:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.827 04:43:58 -- common/autotest_common.sh@10 -- # set +x 00:32:20.786 04:43:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.786 04:43:59 -- target/abort_qd_sizes.sh@62 -- # killprocess 3066782 00:32:20.786 04:43:59 -- common/autotest_common.sh@936 -- # '[' -z 3066782 ']' 00:32:20.786 04:43:59 -- common/autotest_common.sh@940 -- # kill -0 3066782 00:32:20.786 04:43:59 -- common/autotest_common.sh@941 -- # uname 00:32:20.786 04:43:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:20.786 04:43:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3066782 00:32:20.786 04:43:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:20.786 04:43:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:20.786 04:43:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3066782' 00:32:20.786 killing process with pid 3066782 00:32:20.786 04:43:59 -- common/autotest_common.sh@955 -- # kill 3066782 00:32:20.786 04:43:59 -- common/autotest_common.sh@960 -- # wait 3066782 00:32:20.786 00:32:20.786 real 0m14.174s 00:32:20.786 user 0m56.245s 00:32:20.786 sys 0m2.571s 00:32:20.786 04:43:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:20.786 04:43:59 -- common/autotest_common.sh@10 -- # set +x 00:32:20.786 ************************************ 00:32:20.786 END TEST spdk_target_abort 00:32:20.786 ************************************ 00:32:20.786 04:43:59 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:20.786 04:43:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:20.786 04:43:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:20.786 04:43:59 -- common/autotest_common.sh@10 -- # set +x 00:32:20.786 ************************************ 00:32:20.786 START TEST kernel_target_abort 00:32:20.786 ************************************ 00:32:20.786 04:43:59 -- common/autotest_common.sh@1114 -- # kernel_target 00:32:20.786 04:43:59 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:20.786 04:43:59 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:20.786 04:43:59 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:20.786 04:43:59 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:20.786 04:43:59 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:20.786 04:43:59 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:20.787 04:43:59 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:20.787 04:43:59 -- nvmf/common.sh@627 -- # local block nvme 00:32:20.787 04:43:59 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:20.787 04:43:59 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:20.787 04:43:59 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:20.787 04:43:59 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:22.166 Waiting for block devices as requested 00:32:22.166 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:22.166 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:22.166 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:22.427 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:22.427 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:22.427 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:22.427 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:22.687 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:22.687 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:22.687 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:22.687 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:22.947 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:22.947 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:22.947 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:22.947 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:23.206 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:23.206 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:23.206 04:44:02 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:23.206 04:44:02 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:23.206 04:44:02 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:23.206 04:44:02 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:23.206 04:44:02 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:23.464 No valid GPT data, bailing 00:32:23.464 04:44:02 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:23.464 04:44:02 -- scripts/common.sh@393 -- # pt= 00:32:23.464 04:44:02 -- scripts/common.sh@394 -- # return 1 00:32:23.464 04:44:02 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:23.464 04:44:02 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:23.464 04:44:02 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:23.465 04:44:02 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:23.465 04:44:02 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:23.465 04:44:02 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:23.465 04:44:02 -- nvmf/common.sh@654 -- # echo 1 00:32:23.465 04:44:02 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:23.465 04:44:02 -- nvmf/common.sh@656 -- # echo 1 00:32:23.465 04:44:02 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:23.465 04:44:02 -- nvmf/common.sh@663 -- # echo tcp 00:32:23.465 04:44:02 -- nvmf/common.sh@664 -- # echo 4420 00:32:23.465 04:44:02 -- nvmf/common.sh@665 -- # echo ipv4 00:32:23.465 04:44:02 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:23.465 04:44:02 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:23.465 00:32:23.465 Discovery Log Number of Records 2, Generation counter 2 00:32:23.465 =====Discovery Log Entry 0====== 00:32:23.465 trtype: tcp 00:32:23.465 adrfam: ipv4 00:32:23.465 subtype: current discovery subsystem 00:32:23.465 treq: not specified, sq flow control disable supported 00:32:23.465 portid: 1 00:32:23.465 trsvcid: 4420 00:32:23.465 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:23.465 traddr: 10.0.0.1 00:32:23.465 eflags: none 00:32:23.465 sectype: none 00:32:23.465 =====Discovery Log Entry 1====== 00:32:23.465 trtype: tcp 00:32:23.465 adrfam: ipv4 00:32:23.465 subtype: nvme subsystem 00:32:23.465 treq: not specified, sq flow control disable supported 00:32:23.465 portid: 1 00:32:23.465 trsvcid: 4420 00:32:23.465 subnqn: kernel_target 00:32:23.465 traddr: 10.0.0.1 00:32:23.465 eflags: none 00:32:23.465 sectype: none 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:23.465 04:44:02 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:23.465 EAL: No free 2048 kB hugepages reported on node 1 00:32:26.753 Initializing NVMe Controllers 00:32:26.753 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:26.753 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:26.753 Initialization complete. Launching workers. 00:32:26.753 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 40968, failed: 0 00:32:26.753 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 40968, failed to submit 0 00:32:26.753 success 0, unsuccess 40968, failed 0 00:32:26.753 04:44:05 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:26.753 04:44:05 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:26.753 EAL: No free 2048 kB hugepages reported on node 1 00:32:30.051 Initializing NVMe Controllers 00:32:30.052 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:30.052 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:30.052 Initialization complete. Launching workers. 00:32:30.052 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 76524, failed: 0 00:32:30.052 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19294, failed to submit 57230 00:32:30.052 success 0, unsuccess 19294, failed 0 00:32:30.052 04:44:08 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:30.052 04:44:08 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:30.052 EAL: No free 2048 kB hugepages reported on node 1 00:32:33.340 Initializing NVMe Controllers 00:32:33.340 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:33.340 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:33.340 Initialization complete. Launching workers. 00:32:33.340 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 74234, failed: 0 00:32:33.340 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18514, failed to submit 55720 00:32:33.340 success 0, unsuccess 18514, failed 0 00:32:33.340 04:44:11 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:32:33.340 04:44:11 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:32:33.340 04:44:11 -- nvmf/common.sh@677 -- # echo 0 00:32:33.340 04:44:11 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:32:33.340 04:44:11 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:33.340 04:44:11 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:33.340 04:44:11 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:33.340 04:44:11 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:32:33.340 04:44:11 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:32:33.340 00:32:33.340 real 0m11.982s 00:32:33.340 user 0m5.451s 00:32:33.340 sys 0m2.470s 00:32:33.340 04:44:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:33.340 04:44:11 -- common/autotest_common.sh@10 -- # set +x 00:32:33.340 ************************************ 00:32:33.340 END TEST kernel_target_abort 00:32:33.340 ************************************ 00:32:33.340 04:44:11 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:32:33.340 04:44:11 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:32:33.340 04:44:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:33.340 04:44:11 -- nvmf/common.sh@116 -- # sync 00:32:33.340 04:44:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:33.340 04:44:11 -- nvmf/common.sh@119 -- # set +e 00:32:33.340 04:44:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:33.340 04:44:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:33.340 rmmod nvme_tcp 00:32:33.340 rmmod nvme_fabrics 00:32:33.340 rmmod nvme_keyring 00:32:33.341 04:44:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:33.341 04:44:11 -- nvmf/common.sh@123 -- # set -e 00:32:33.341 04:44:11 -- nvmf/common.sh@124 -- # return 0 00:32:33.341 04:44:11 -- nvmf/common.sh@477 -- # '[' -n 3066782 ']' 00:32:33.341 04:44:11 -- nvmf/common.sh@478 -- # killprocess 3066782 00:32:33.341 04:44:11 -- common/autotest_common.sh@936 -- # '[' -z 3066782 ']' 00:32:33.341 04:44:11 -- common/autotest_common.sh@940 -- # kill -0 3066782 00:32:33.341 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3066782) - No such process 00:32:33.341 04:44:11 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3066782 is not found' 00:32:33.341 Process with pid 3066782 is not found 00:32:33.341 04:44:11 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:33.341 04:44:11 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:33.910 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:33.911 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:33.911 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:33.911 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:33.911 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:33.911 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:33.911 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:33.911 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:34.169 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:34.169 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:34.169 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:34.169 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:34.169 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:34.169 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:34.169 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:34.169 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:34.169 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:34.169 04:44:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:34.169 04:44:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:34.169 04:44:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:34.169 04:44:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:34.170 04:44:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:34.170 04:44:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:34.170 04:44:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:36.709 04:44:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:36.709 00:32:36.709 real 0m35.421s 00:32:36.709 user 1m4.158s 00:32:36.709 sys 0m8.499s 00:32:36.709 04:44:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:36.709 04:44:15 -- common/autotest_common.sh@10 -- # set +x 00:32:36.710 ************************************ 00:32:36.710 END TEST nvmf_abort_qd_sizes 00:32:36.710 ************************************ 00:32:36.710 04:44:15 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:32:36.710 04:44:15 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:32:36.710 04:44:15 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:32:36.710 04:44:15 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:32:36.710 04:44:15 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:32:36.710 04:44:15 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:32:36.710 04:44:15 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:32:36.710 04:44:15 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:32:36.710 04:44:15 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:32:36.710 04:44:15 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:32:36.710 04:44:15 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:32:36.710 04:44:15 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:32:36.710 04:44:15 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:32:36.710 04:44:15 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:32:36.710 04:44:15 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:32:36.710 04:44:15 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:32:36.710 04:44:15 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:32:36.710 04:44:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:36.710 04:44:15 -- common/autotest_common.sh@10 -- # set +x 00:32:36.710 04:44:15 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:32:36.710 04:44:15 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:32:36.710 04:44:15 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:32:36.710 04:44:15 -- common/autotest_common.sh@10 -- # set +x 00:32:38.087 INFO: APP EXITING 00:32:38.087 INFO: killing all VMs 00:32:38.087 INFO: killing vhost app 00:32:38.087 INFO: EXIT DONE 00:32:39.465 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:39.465 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:39.465 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:39.465 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:39.465 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:39.465 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:39.465 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:39.465 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:39.465 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:39.465 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:39.465 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:39.465 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:39.465 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:39.465 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:39.465 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:39.465 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:39.465 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:40.842 Cleaning 00:32:40.842 Removing: /var/run/dpdk/spdk0/config 00:32:40.842 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:32:40.842 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:32:40.842 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:32:40.842 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:32:40.842 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:32:40.842 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:32:40.842 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:32:40.842 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:32:40.842 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:32:40.842 Removing: /var/run/dpdk/spdk0/hugepage_info 00:32:40.842 Removing: /var/run/dpdk/spdk1/config 00:32:40.842 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:32:40.842 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:32:40.842 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:32:40.842 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:32:40.842 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:32:40.842 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:32:40.842 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:32:40.842 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:32:40.842 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:32:40.842 Removing: /var/run/dpdk/spdk1/hugepage_info 00:32:40.842 Removing: /var/run/dpdk/spdk1/mp_socket 00:32:40.842 Removing: /var/run/dpdk/spdk2/config 00:32:40.842 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:32:40.842 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:32:40.842 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:32:40.842 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:32:40.842 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:32:40.842 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:32:40.842 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:32:40.842 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:32:40.842 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:32:40.842 Removing: /var/run/dpdk/spdk2/hugepage_info 00:32:40.842 Removing: /var/run/dpdk/spdk3/config 00:32:40.842 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:32:40.842 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:32:40.842 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:32:40.842 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:32:40.842 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:32:40.842 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:32:40.842 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:32:40.842 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:32:40.842 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:32:40.842 Removing: /var/run/dpdk/spdk3/hugepage_info 00:32:40.842 Removing: /var/run/dpdk/spdk4/config 00:32:40.842 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:32:40.842 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:32:40.842 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:32:40.842 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:32:40.842 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:32:40.842 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:32:40.842 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:32:40.842 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:32:40.842 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:32:40.842 Removing: /var/run/dpdk/spdk4/hugepage_info 00:32:40.842 Removing: /dev/shm/bdev_svc_trace.1 00:32:40.842 Removing: /dev/shm/nvmf_trace.0 00:32:40.842 Removing: /dev/shm/spdk_tgt_trace.pid2787694 00:32:40.842 Removing: /var/run/dpdk/spdk0 00:32:40.842 Removing: /var/run/dpdk/spdk1 00:32:40.842 Removing: /var/run/dpdk/spdk2 00:32:40.842 Removing: /var/run/dpdk/spdk3 00:32:40.842 Removing: /var/run/dpdk/spdk4 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2785970 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2786847 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2787694 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2788186 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2789542 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2790493 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2790807 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2791029 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2791363 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2791693 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2791850 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2792006 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2792203 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2792789 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2795340 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2795519 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2795819 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2795956 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2796265 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2796407 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2796722 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2796862 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2797155 00:32:40.842 Removing: /var/run/dpdk/spdk_pid2797190 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2797463 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2797509 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2798079 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2798258 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2798461 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2798762 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2798782 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2798851 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2799484 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2799783 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2799929 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2800102 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2800354 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2800510 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2800648 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2800821 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2801082 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2801244 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2801382 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2801542 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2801809 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2801965 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2802109 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2802275 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2802526 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2802692 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2802830 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2803033 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2803253 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2803411 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2803557 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2803721 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2803974 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2804138 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2804279 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2804438 00:32:40.843 Removing: /var/run/dpdk/spdk_pid2804697 00:32:41.101 Removing: /var/run/dpdk/spdk_pid2804862 00:32:41.101 Removing: /var/run/dpdk/spdk_pid2805009 00:32:41.101 Removing: /var/run/dpdk/spdk_pid2805162 00:32:41.101 Removing: /var/run/dpdk/spdk_pid2805430 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2805595 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2805745 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2805956 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2806162 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2806328 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2806469 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2806748 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2806824 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2807044 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2809247 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2866008 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2868668 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2875928 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2879283 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2881660 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2882084 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2886092 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2886094 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2886773 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2887329 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2888004 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2888465 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2888492 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2888798 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2888819 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2888939 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2890005 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2890685 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2891359 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2891766 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2891778 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2891923 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2893096 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2893860 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2899483 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2899770 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2902456 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2906348 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2908592 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2915091 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2920633 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2922213 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2923170 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2933797 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2936047 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2938887 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2940100 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2941588 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2941609 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2941876 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2942035 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2942625 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2943997 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2945006 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2945333 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2948953 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2952536 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2956780 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2980694 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2983599 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2988075 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2989164 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2990287 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2992996 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2995525 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2999923 00:32:41.102 Removing: /var/run/dpdk/spdk_pid2999925 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3002874 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3003014 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3003151 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3003423 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3003475 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3004662 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3005880 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3007095 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3008330 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3009553 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3010765 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3014772 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3015115 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3016548 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3017829 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3021725 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3023768 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3027380 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3031142 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3034704 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3035194 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3035662 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3036084 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3036675 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3037231 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3037785 00:32:41.102 Removing: /var/run/dpdk/spdk_pid3038287 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3040888 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3041154 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3045019 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3045196 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3046849 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3052621 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3052629 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3055706 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3057140 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3058579 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3059384 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3060827 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3061707 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3067221 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3067624 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3068036 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3069514 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3069921 00:32:41.360 Removing: /var/run/dpdk/spdk_pid3070334 00:32:41.360 Clean 00:32:41.360 killing process with pid 2757524 00:32:49.486 killing process with pid 2757521 00:32:49.486 killing process with pid 2757523 00:32:49.745 killing process with pid 2757522 00:32:49.745 04:44:28 -- common/autotest_common.sh@1446 -- # return 0 00:32:49.745 04:44:28 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:32:49.745 04:44:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:49.745 04:44:28 -- common/autotest_common.sh@10 -- # set +x 00:32:49.745 04:44:28 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:32:49.745 04:44:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:49.745 04:44:28 -- common/autotest_common.sh@10 -- # set +x 00:32:49.745 04:44:28 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:32:49.745 04:44:28 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:32:49.745 04:44:28 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:32:49.745 04:44:28 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:32:49.745 04:44:28 -- spdk/autotest.sh@383 -- # hostname 00:32:49.745 04:44:28 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:32:50.003 geninfo: WARNING: invalid characters removed from testname! 00:33:22.064 04:44:56 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:22.064 04:45:00 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:23.964 04:45:03 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:27.247 04:45:05 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:29.775 04:45:08 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:32.302 04:45:11 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:35.629 04:45:14 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:33:35.629 04:45:14 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:33:35.629 04:45:14 -- common/autotest_common.sh@1690 -- $ lcov --version 00:33:35.629 04:45:14 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:33:35.629 04:45:14 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:33:35.629 04:45:14 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:33:35.629 04:45:14 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:33:35.629 04:45:14 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:33:35.629 04:45:14 -- scripts/common.sh@335 -- $ IFS=.-: 00:33:35.629 04:45:14 -- scripts/common.sh@335 -- $ read -ra ver1 00:33:35.629 04:45:14 -- scripts/common.sh@336 -- $ IFS=.-: 00:33:35.629 04:45:14 -- scripts/common.sh@336 -- $ read -ra ver2 00:33:35.629 04:45:14 -- scripts/common.sh@337 -- $ local 'op=<' 00:33:35.629 04:45:14 -- scripts/common.sh@339 -- $ ver1_l=2 00:33:35.629 04:45:14 -- scripts/common.sh@340 -- $ ver2_l=1 00:33:35.629 04:45:14 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:33:35.629 04:45:14 -- scripts/common.sh@343 -- $ case "$op" in 00:33:35.629 04:45:14 -- scripts/common.sh@344 -- $ : 1 00:33:35.629 04:45:14 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:33:35.629 04:45:14 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:33:35.629 04:45:14 -- scripts/common.sh@364 -- $ decimal 1 00:33:35.629 04:45:14 -- scripts/common.sh@352 -- $ local d=1 00:33:35.629 04:45:14 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:33:35.629 04:45:14 -- scripts/common.sh@354 -- $ echo 1 00:33:35.629 04:45:14 -- scripts/common.sh@364 -- $ ver1[v]=1 00:33:35.629 04:45:14 -- scripts/common.sh@365 -- $ decimal 2 00:33:35.629 04:45:14 -- scripts/common.sh@352 -- $ local d=2 00:33:35.629 04:45:14 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:33:35.629 04:45:14 -- scripts/common.sh@354 -- $ echo 2 00:33:35.629 04:45:14 -- scripts/common.sh@365 -- $ ver2[v]=2 00:33:35.629 04:45:14 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:33:35.629 04:45:14 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:33:35.629 04:45:14 -- scripts/common.sh@367 -- $ return 0 00:33:35.629 04:45:14 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:33:35.629 04:45:14 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:33:35.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:35.629 --rc genhtml_branch_coverage=1 00:33:35.629 --rc genhtml_function_coverage=1 00:33:35.629 --rc genhtml_legend=1 00:33:35.629 --rc geninfo_all_blocks=1 00:33:35.629 --rc geninfo_unexecuted_blocks=1 00:33:35.629 00:33:35.629 ' 00:33:35.629 04:45:14 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:33:35.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:35.629 --rc genhtml_branch_coverage=1 00:33:35.629 --rc genhtml_function_coverage=1 00:33:35.629 --rc genhtml_legend=1 00:33:35.629 --rc geninfo_all_blocks=1 00:33:35.629 --rc geninfo_unexecuted_blocks=1 00:33:35.629 00:33:35.629 ' 00:33:35.629 04:45:14 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:33:35.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:35.629 --rc genhtml_branch_coverage=1 00:33:35.629 --rc genhtml_function_coverage=1 00:33:35.629 --rc genhtml_legend=1 00:33:35.629 --rc geninfo_all_blocks=1 00:33:35.629 --rc geninfo_unexecuted_blocks=1 00:33:35.629 00:33:35.629 ' 00:33:35.629 04:45:14 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:33:35.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:35.629 --rc genhtml_branch_coverage=1 00:33:35.629 --rc genhtml_function_coverage=1 00:33:35.629 --rc genhtml_legend=1 00:33:35.629 --rc geninfo_all_blocks=1 00:33:35.629 --rc geninfo_unexecuted_blocks=1 00:33:35.629 00:33:35.629 ' 00:33:35.629 04:45:14 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:33:35.629 04:45:14 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:33:35.629 04:45:14 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:35.629 04:45:14 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:35.629 04:45:14 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:35.629 04:45:14 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:35.629 04:45:14 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:35.629 04:45:14 -- paths/export.sh@5 -- $ export PATH 00:33:35.629 04:45:14 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:35.629 04:45:14 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:33:35.629 04:45:14 -- common/autobuild_common.sh@440 -- $ date +%s 00:33:35.629 04:45:14 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732592714.XXXXXX 00:33:35.629 04:45:14 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732592714.a5mHKj 00:33:35.629 04:45:14 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:33:35.629 04:45:14 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:33:35.629 04:45:14 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:33:35.629 04:45:14 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:33:35.629 04:45:14 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:33:35.629 04:45:14 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:33:35.629 04:45:14 -- common/autobuild_common.sh@456 -- $ get_config_params 00:33:35.629 04:45:14 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:33:35.629 04:45:14 -- common/autotest_common.sh@10 -- $ set +x 00:33:35.629 04:45:14 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:33:35.629 04:45:14 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:33:35.629 04:45:14 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:35.629 04:45:14 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:33:35.629 04:45:14 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:33:35.629 04:45:14 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:33:35.629 04:45:14 -- spdk/autopackage.sh@19 -- $ timing_finish 00:33:35.629 04:45:14 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:33:35.629 04:45:14 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:33:35.629 04:45:14 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:35.629 04:45:14 -- spdk/autopackage.sh@20 -- $ exit 0 00:33:35.629 + [[ -n 2703223 ]] 00:33:35.629 + sudo kill 2703223 00:33:35.640 [Pipeline] } 00:33:35.656 [Pipeline] // stage 00:33:35.661 [Pipeline] } 00:33:35.676 [Pipeline] // timeout 00:33:35.681 [Pipeline] } 00:33:35.695 [Pipeline] // catchError 00:33:35.701 [Pipeline] } 00:33:35.748 [Pipeline] // wrap 00:33:35.754 [Pipeline] } 00:33:35.765 [Pipeline] // catchError 00:33:35.774 [Pipeline] stage 00:33:35.776 [Pipeline] { (Epilogue) 00:33:35.788 [Pipeline] catchError 00:33:35.789 [Pipeline] { 00:33:35.801 [Pipeline] echo 00:33:35.802 Cleanup processes 00:33:35.807 [Pipeline] sh 00:33:36.093 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:36.093 3083213 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:36.107 [Pipeline] sh 00:33:36.393 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:36.393 ++ grep -v 'sudo pgrep' 00:33:36.393 ++ awk '{print $1}' 00:33:36.393 + sudo kill -9 00:33:36.393 + true 00:33:36.407 [Pipeline] sh 00:33:36.691 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:33:46.673 [Pipeline] sh 00:33:46.960 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:33:46.960 Artifacts sizes are good 00:33:46.977 [Pipeline] archiveArtifacts 00:33:46.984 Archiving artifacts 00:33:47.158 [Pipeline] sh 00:33:47.444 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:33:47.459 [Pipeline] cleanWs 00:33:47.470 [WS-CLEANUP] Deleting project workspace... 00:33:47.470 [WS-CLEANUP] Deferred wipeout is used... 00:33:47.477 [WS-CLEANUP] done 00:33:47.479 [Pipeline] } 00:33:47.497 [Pipeline] // catchError 00:33:47.512 [Pipeline] sh 00:33:47.798 + logger -p user.info -t JENKINS-CI 00:33:47.808 [Pipeline] } 00:33:47.825 [Pipeline] // stage 00:33:47.831 [Pipeline] } 00:33:47.848 [Pipeline] // node 00:33:47.855 [Pipeline] End of Pipeline 00:33:47.899 Finished: SUCCESS